Gemma4-26b: OpenWebUI with Ollama Deployment Overview on Server¶

Prerequisites¶

The following system parameters and network settings are required for the application to function correctly:

• Operating System: Ubuntu (version 22.04 is recommended).

• Drivers: Presence of an NVIDIA GPU and installed drivers (automatic installation via ubuntu-drivers autoinstall).

• Kernel: HWE kernel installed (linux-generic-hwe-22.04).

• Ports:

  • Internal application port: 8080

  • External port (HTTPS): 443

FQDN of the final panel on hostkey.in domain¶

The following domain name template is used to access the interface:

File and Directory Structure¶

Core data and configurations are distributed across the following paths:

• /root/nginx/ — directory containing Docker Compose files for the proxy server.

• /data/nginx/user_conf.d/ — directory for Nginx user configurations.

• /data/nginx/nginx-certbot.env — environment variables file for Certbot.

Application Installation Process¶

Deployment includes the following stages:

1. Update system packages and install HWE kernel.

2. Install NVIDIA drivers (if hardware is present) and reboot the system.

3. Install and start the Ollama service.

4. Download the gemma4:26b language model.

5. Deploy the OpenWebUI container.

6. Configure the Nginx proxy server with automatic SSL certificate acquisition via Certbot.

Access Rights and Security¶

• User: All primary operations are performed as root.

• Nginx Configurations: Files in /root/nginx/compose.yml have permissions 0644, owner — root:root.

• Nginx Directory: The /root/nginx directory has access permissions 0755.

Databases¶

In this configuration, the database is not deployed separately; application data is stored in a Docker Volume.

Docker Containers and Execution¶

OpenWebUI¶

• Image Name: ghcr.io/open-webui/open-webui:main

• Container Name: open-webui

• Network Mode: host

• Volumes: open-webui:/app/backend/data

• Environment Variables:

  • OLLAMA_BASE_URL=http://127.0.0.1:11434

• Restart Policy: always

Nginx (via Docker Compose)¶

• Image Name: jonasal/nginx-certbot:latest

• Network Mode: host

• Volumes:

  • nginx_secrets:/etc/letsencrypt

  • /data/nginx/user_conf.d:/etc/nginx/user_conf.d

• Environment Variables:

  • [email protected] (from .env file)

• Restart Policy: unless-stopped

Application Update Instructions¶

Updates are performed via pull and restarting containers:

docker compose pull && docker compose up -d

Permissions Settings¶

Permissions for directories and files are set as follows:

• /root/nginx: 0755 (owner root)

• Configuration files in /root/nginx/: 0644 (owner root)

Location of Configuration Files and Data¶

• OpenWebUI Data: Stored in a Docker Volume named open-webui.

• Nginx Configuration: User .conf files are located in /data/nginx/user_conf.d/.

Available Connection Ports¶