Phi-4-14b¶

In this article

• Deployment Features
• Deployment Features
• System Requirements and Technical Characteristics
• Getting Started After Deploying Phi-4-14b
• Ordering a Server with Phi-4-14b Using API

Deployment Features¶

• Powerful Base Architecture: the model has 14 billion parameters and a context window of 16 thousand tokens, allowing it to process long texts and complex tasks with high accuracy;

• Convenient Open Web UI Interface: provides a modern web interface for interacting with the model, including chat history, parameter settings, and management of different models in a single interface;

• Advanced RAG Capabilities: built-in support for searching documents in various formats (PDF, PPT, text files) and web scraping, allowing the model to work with current information and user data;

• Multitasking: the model efficiently handles various tasks, including dialogue management, answering questions, data analysis, text creation, and basic programming;

• Security and Accuracy: the model underwent multi-stage training considering user preferences under expert supervision, ensuring high accuracy of responses, adherence to ethical norms, and following user instructions;

• Openness and Flexibility: thanks to Ollama's open source code, the system can be configured and modified for specific needs, including integration with other tools and services;

• Support for Various Data Types: the model is capable of working with text data, code, structured and semi-structured data, expanding its applicability in various fields.

• Examples of Use:

  • Customer Support: automation of responses to user questions;

  • Education: creation of educational materials, assistance in solving tasks;

  • Marketing: generation of advertising texts, analysis of reviews;

  • Software Development: creation and documentation of code.

Deployment Features¶

• Installation time is 15-30 minutes together with OS;

• Ollama server loads and runs LLM in memory;

• Open WebUI is deployed as a web application connected to the Ollama server;

• Users interact with LLM through the web interface of Open WebUI, sending requests and receiving responses;

• All computations and data processing occur locally on the server. Administrators can configure LLM for specific tasks using OpenWebUI tools.

System Requirements and Technical Characteristics¶

• Graphical Accelerator: NVIDIA A4000 (or more powerful) or an AMD equivalent with at least 16 GB of video memory;

• Disk Space: sufficient for installing the system, drivers, and model;

• Drivers: NVIDIA drivers and CUDA for correct GPU operation;

• Video Memory Consumption: 12 GB at a context of 2K tokens;

• Automatic Restart: automatic container restart is configured in case of failures;

• GPU Support: full integration with NVIDIA CUDA for maximum performance.

Getting Started After Deploying Phi-4-14b¶

After payment, an order notification will be sent to the email specified during registration indicating that the server is ready for use. It will include the VPS IP address, as well as the login and password for connecting to the server and a link to access the OpenWebUI panel. Our company's clients manage equipment in the server management and API control panel — Invapi.

• Login Data for Accessing the Server's Operating System (e.g., via SSH) will be sent to you in the received email.

• Link for Access to Ollama Management Panel with Open WebUI Web Interface: in the tag webpanel in the tab Info >> Tags of the Invapi control panel. The exact link in the format https://phi<Server_ID_from_Invapi>.hostkey.in will be sent in the email upon server delivery.

After following the link from the tag webpanel, an OpenWebUI login window will open where you need to create an Administrator account by setting its Name, Login, and Password.

Ordering a Server with Phi-4-14b Using API¶

To install this software using the API, follow these instructions.

Some of the content on this page was created or translated using AI.