OpenWebUI Deployment Overview on Server for North MiniCode¶
Prerequisites¶
The following system parameters are required for the application to function correctly:
-
Operating System: Ubuntu.
-
Kernel: Linux HWE kernel (22.04).
-
Drivers: NVIDIA drivers must be present and installed for GPU support.
-
Access: Superuser (
root) privileges for installing system packages and Docker.
FQDN of the final panel on hostkey.in domain¶
| Parameter | Value |
|---|---|
| Prefix | north-mini |
| Domain | hostkey.in |
| Full Template | north-mini{Server_ID_from_Invapi}.hostkey.in |
File and Directory Structure¶
Main directories used in the system:
-
/root/nginx— working directory for Nginx reverse proxy configuration. -
/data/nginx/user_conf.d— directory containing custom Nginx configurations. -
/data/nginx/nginx-certbot.env— environment variables file for Certbot.
Application Installation Process¶
Deployment includes the following stages:
-
Updating system packages and installing the HWE kernel.
-
Installing NVIDIA drivers (if hardware is present).
-
Installing and starting the Ollama service.
-
Downloading the
north-mini-code-1.0language model via Ollama. -
Deploying the OpenWebUI container.
-
Configuring the Nginx reverse proxy with SSL certificates via Docker.
Docker Containers and Execution¶
The following containers are deployed in the system:
open-webui¶
User interface container for interacting with models.
-
Image:
ghcr.io/open-webui/open-webui:main -
Network Mode:
host -
Volumes:
open-webui:/app/backend/data -
Environment Variables:
OLLAMA_BASE_URL=http://127.0.0.1:11434
-
Restart Policy:
always
nginx¶
Container for SSL certificate management and traffic proxying.
-
Image:
jonasal/nginx-certbot:latest -
Network Mode:
host -
Volumes:
-
nginx_secrets:/etc/letsencrypt -
/data/nginx/user_conf.d:/etc/nginx/user_conf.d
-
-
Environment Variables:
[email protected](from.envfile)
-
Restart Policy:
unless-stopped
Databases¶
The application uses a local Ollama service running as a system service (systemd) to manage models and execute queries. OpenWebUI data is stored in a Docker Volume named open-webui.
Application Update Instructions¶
Updates are performed by restarting the containers: docker compose pull && docker compose up -d (in the /root/nginx directory).