Անցնել պարունակությանը

OpenWebUI Deployment Overview on Server for North MiniCode

Prerequisites

The following system parameters are required for the application to function correctly:

  • Operating System: Ubuntu.

  • Kernel: Linux HWE kernel (22.04).

  • Drivers: NVIDIA drivers must be present and installed for GPU support.

  • Access: Superuser (root) privileges for installing system packages and Docker.

FQDN of the final panel on hostkey.in domain

Parameter Value
Prefix north-mini
Domain hostkey.in
Full Template north-mini{Server_ID_from_Invapi}.hostkey.in

File and Directory Structure

Main directories used in the system:

  • /root/nginx — working directory for Nginx reverse proxy configuration.

  • /data/nginx/user_conf.d — directory containing custom Nginx configurations.

  • /data/nginx/nginx-certbot.env — environment variables file for Certbot.

Application Installation Process

Deployment includes the following stages:

  1. Updating system packages and installing the HWE kernel.

  2. Installing NVIDIA drivers (if hardware is present).

  3. Installing and starting the Ollama service.

  4. Downloading the north-mini-code-1.0 language model via Ollama.

  5. Deploying the OpenWebUI container.

  6. Configuring the Nginx reverse proxy with SSL certificates via Docker.

Docker Containers and Execution

The following containers are deployed in the system:

open-webui

User interface container for interacting with models.

  • Image: ghcr.io/open-webui/open-webui:main

  • Network Mode: host

  • Volumes: open-webui:/app/backend/data

  • Environment Variables:

    • OLLAMA_BASE_URL=http://127.0.0.1:11434
  • Restart Policy: always

nginx

Container for SSL certificate management and traffic proxying.

  • Image: jonasal/nginx-certbot:latest

  • Network Mode: host

  • Volumes:

    • nginx_secrets:/etc/letsencrypt

    • /data/nginx/user_conf.d:/etc/nginx/user_conf.d

  • Environment Variables:

  • Restart Policy: unless-stopped

Databases

The application uses a local Ollama service running as a system service (systemd) to manage models and execute queries. OpenWebUI data is stored in a Docker Volume named open-webui.

Application Update Instructions

Updates are performed by restarting the containers: docker compose pull && docker compose up -d (in the /root/nginx directory).

question_mark
Is there anything I can help you with?
question_mark
AI Assistant ×