OpenWebUI Deployment Overview for Gemma4-31b on Server¶

Prerequisites¶

The following system parameters and network settings are required for the application to function correctly:

• Operating System: Ubuntu (version 22.04 with HWE kernel installed is recommended).

• Drivers: Presence of an NVIDIA GPU and installed NVIDIA drivers.

• Ports:

• 8080 — internal application port.

• 443 — external HTTPS port.

FQDN of the final panel on hostkey.in domain¶

The following domain name template is used to access the interface:

Application Installation Process¶

Installation is performed by deploying Docker containers and configuring system services:

1. Update system packages and install the HWE kernel.

2. Install NVIDIA drivers (if hardware is present).

3. Install and start the Ollama service.

4. Download the gemma4:31b language model via ollama pull.

5. Deploy the OpenWebUI container.

6. Configure the Nginx reverse proxy with automatic SSL certificate acquisition via Certbot.

Docker Containers and Execution¶

The following containers are deployed in the system:

OpenWebUI¶

• Image Name: ghcr.io/open-webui/open-webui:main

• Network Mode: host

• Volumes: open-webui:/app/backend/data

• Environment Variables:

• OLLAMA_BASE_URL=http://127.0.0.1:11434

• Restart Policy: always

Nginx (Certbot)¶

• Image Name: jonasal/nginx-certbot:latest

• Network Mode: host

• Volumes:

• nginx_secrets:/etc/letsencrypt

• /data/nginx/user_conf.d:/etc/nginx/user_conf.d

• Environment Variables: [email protected]

• Restart Policy: unless-stopped

Databases¶

The application uses an embedded database inside the OpenWebUI container. Data is stored in a Docker volume named open-webui.

Application Update Instructions¶

Updates are performed via pull and restarting containers. To update, execute the following commands: docker compose pull && docker compose up -d (in the /root/nginx directory) or restart the corresponding services via Docker.

Configuration Files and Data Location¶

• Nginx Configuration: /data/nginx/user_conf.d/

• OpenWebUI Data: open-webui (Docker volume)

• Compose Files: /root/nginx/compose.yml

• SSL Secrets: nginx_secrets (Docker volume)

Available Connection Ports¶

Starting and Stopping the Application¶

Managing the Nginx reverse proxy:

• Reload configuration: docker exec nginx-nginx-1 nginx -s reload

Managing containers (in the /root/nginx directory):

• Start: docker compose up -d

• Stop: docker compose down