Qwen Deployment Overview on Server¶

Prerequisites¶

The following system parameters are required for the application to function correctly:

• Operating System: Ubuntu (version 22.04 LTS is recommended).

• Access Rights: root privileges for installing drivers and system packages.

• Ports:

• 8080 — internal application port.

• 443 — external port (HTTPS) via proxy server.

FQDN of the final panel on hostkey.in domain¶

The following domain name template is used to access the interface:

File and Directory Structure¶

Main directories used in the system:

• /root/nginx — Docker Compose configuration files for the Nginx proxy server.

• /data/nginx/user_conf.d — user Nginx configurations.

• /etc/letsencrypt — SSL certificates (stored in the nginx_secrets volume).

• /app/backend/data — OpenWebUI application data (stored in the open-webui volume).

Application Installation Process¶

Deployment includes the following stages:

1. Updating system packages and installing the HWE kernel.

2. Installing NVIDIA drivers (if a GPU is present) and the ubuntu-drivers utility.

3. Installing and launching the Ollama service via the official installation script.

4. Downloading the qwen3.6-35b model into Ollama.

5. Deploying the OpenWebUI container.

6. Configuring the Nginx proxy server with automatic SSL certificate acquisition via Certbot.

Docker Containers and Execution¶

The following containers are deployed in the system:

OpenWebUI¶

• Image Name: ghcr.io/open-webui/open-webui:main

• Network Mode: host

• Volumes: open-webui:/app/backend/data

• Environment Variables:

• OLLAMA_BASE_URL=http://127.0.0.1:11434

• Restart Policy: always

Nginx (with Certbot)¶

• Image Name: jonasal/nginx-certbot:latest

• Network Mode: host

• Volumes:

• nginx_secrets:/etc/letsencrypt

• /data/nginx/user_conf.d:/etc/nginx/user_conf.d

• Environment Variables:

• [email protected]

• Restart Policy: unless-stopped

Databases¶

The application uses Ollama as a backend for model operations. Model data and OpenWebUI configurations are stored in Docker volumes:

• open-webui — application data.

Application Update Instructions¶

Updates are performed by restarting containers or updating packages. To update the proxy server, use the command:

docker compose up -d

docker exec nginx-nginx-1 nginx -s reload

Available Connection Ports¶