Skip to content

Gemma-4-26B

In this article

Information

Gemma-4-26B is a next-generation multimodal large language model from Google, available for local deployment via Ollama. The Mixture of Experts (MoE) architecture with 26 billion parameters, of which only ~3.8B are actively used per token, provides performance comparable to a 4B model while maintaining the intelligence of much larger dense models. The model supports a 256K context window, Thinking Mode, native function calling, and image processing. Deployment on Ubuntu 22.04 with Open WebUI integration ensures full data control and a user-friendly interface.

Key Features

  • Mixture of Experts (MoE) Architecture: The model contains 25.2B active parameters out of 26B total, activating only ~3.8B parameters per token; this provides the speed of a dense 4B model with the intelligence level of a 26B model;
  • Multimodality: Native support for processing text and image input with text output generation;
  • Massive Context Window: Support for up to 256K tokens allows working with long documents, large codebases, and complex dialogues;
  • Thinking Mode: A customizable reasoning mode for solving complex logical and analytical tasks;
  • Agentic Capabilities: Native support for function calling and structured output for integration with external tools and APIs;
  • Deployment Flexibility: The full version requires ~80GB VRAM, but Q4 quantization allows running the model on a 24GB GPU, while optimized builds can run on 16GB VRAM;
  • Open WebUI Integration: A modern web interface for interaction via port 8080 with full control over data and request processing;
  • Scalability: Support for multi-GPU configurations and load balancing across several GPUs;
  • Security and Control: Local deployment ensures data privacy; OLLAMA_HOST and OLLAMA_ORIGINS settings guarantee network security;
  • Performance: Utilization of LLAMA_FLASH_ATTENTION and efficient MoE architecture to accelerate request processing;
  • Fault Tolerance: Built-in automatic restart system for containers and services to ensure stable operation.

Deployment Features

ID Software Name OS VPS BM VGPU GPU Min. CPU (Cores) Min. RAM (GB) Min. HDD/SSD (GB) Custom Domain Available

Information

You can find information regarding the deployment features of this software at this link

Note

Unless otherwise specified, we install the latest release version of the software from the developer's website or the operating system repositories by default.

Getting Started After Deploying Gemma-4-26B

After payment is completed, a notification will be sent to the email address provided during registration once the server is ready for operation. This notification will include the VPS IP address, login and password for server connection, and a link to access the Open WebUI panel. Customers can manage their hardware in the Server Control Panel and APIInvapi.

  • Authorization credentials for accessing the server operating system (e.g., via SSH) will be sent to you in an email.

  • Link to access the Ollama control panel with Open WebUI web interface: located under the webpanel tag in the Configuration >> Tags section of the Invapi control panel. The exact link, formatted as https://gemma26b<Server_ID_from_Invapi>.hostkey.com, is sent in the email delivered upon server handover.

After clicking the link from the webpanel tag, the Get started with Open WebUI authorization window will open, where you must create an administrator username, email, and password for the chatbot, and then click the Create Admin Account button:

Attention

After the first user registers, the system automatically assigns them the Administrator role. To ensure security and control over the registration process, all subsequent registration requests must be approved in the Open WebUI interface from an administrator account.

Note

A detailed description of how to work with the Ollama control panel and Open WebUI can be found in the AI Chatbot on Your Own Server article.

Note

For optimal performance, it is recommended to use a GPU with more than the minimum 24GB VRAM requirement; this provides overhead for processing large contexts and parallel requests. Detailed information regarding core Ollama and Open WebUI settings can be found in the Ollama developer documentation and the Open WebUI developer documentation.

Ordering a Server with Gemma-4-26B via API

To install this software using the API, follow these instructions.

question_mark
Is there anything I can help you with?
question_mark
AI Assistant ×