Dedicated Servers
  • Instant
  • Custom
  • Single CPU servers
  • Dual CPU servers
  • Servers with 4th Gen CPUs
  • Servers with AMD Ryzen and Intel Core i9
  • Storage Servers
  • Servers with 10Gbps ports
  • Hosting virtualization nodes
  • GPU
  • Sale
  • VPS
    GPU
  • Dedicated GPU server
  • VM with GPU
  • Tesla A100 80GB & H100 Servers
  • Sale
    Apps
    Cloud
  • VMware and RedHat's oVirt Сlusters
  • Proxmox VE
  • Colocation
  • Colocation in the Netherlands
  • Remote smart hands
  • Services
  • Network equipment
  • Intelligent DDoS protection
  • IPv4 and IPv6 address
  • Managed servers
  • SLA packages for technical support
  • Monitoring
  • Software
  • VLAN
  • Announcing your IP or AS (BYOIP)
  • USB flash/key/flash drive
  • Traffic
  • Hardware delivery for EU data centers
  • About
  • Careers at HOSTKEY
  • Server Control Panel & API
  • Data Centers
  • Network
  • Speed test
  • Hot deals
  • Sales contact
  • Reseller program
  • Affiliate Program
  • Grants for winners
  • Grants for scientific projects and startups
  • News
  • Our blog
  • Payment terms and methods
  • Legal
  • Abuse
  • Looking Glass
  • The KYC Verification
  • Hot Deals

    13.02.2023

    Which graphics card is better for business - RTX 4090 or server RTX A5000?

    server one
    HOSTKEY
    Please, use our convenient online configurator to order a custom-built GPU server with NVIDIA RTX 4090 card for your specific needs.

    In this article, we will compare the new product from Nvidia - the GeForce RTX 4090 - with various professional cards from this manufacturer and try to answer the question, "Is it more beneficial to use a new graphics card in workflows or is it still better to use server graphics cards?"

    Professional and gaming GPU-cards have a number of significant differences, determined by the purpose of use:

    • Scope of application. Server graphics cards are used in ML development, rendering and modeling of complex objects, scientific research, cinematography, and more. Gaming graphics cards are designed for individual use.
    • Cooling. The professional card cooling system blows hot air out of the server or workstation. Their cooling turbine is designed for continuous operation. Gaming cards blow air over the cards. They must be installed in special cases with a good ventilation system. Gaming card fans are not designed for long-term operation and fail during long-term, continuous operation.
    • Performance and energy efficiency. Professional GPUs allow you to do more computing with less power. This feature largely accounts for the high cost of server video cards.
    • Production features. Quality control in the manufacture of professional cards is stricter than in the creation of gaming cards.
    • Connectors. Professional cards are not equipped with connectors (HDMI, DVI) for video output - there is only DisplayPort.
    • Additional functionality. Not all server GPUs can be used for gaming.

    GeForce RTX 4090 Technology Overview

    The GeForce RTX 4090 GPU was released at the end of 2022 and represents a continuation of the line of desktop accelerators from NVIDIA, which aroused great interest among players around the world.

    The key features of the card are:

    • As with the entire GeForce RTX 40 line, the new AD10x GPUs (AD102 in the 4090) are based on the Ada Lovelace architecture and use the 4N process (TSMC).
    • Improved performance of ray tracing and machine compute operations on tensor cores.
    • The 4N technological process allows them to increase energy efficiency by several percentage points.
    • The size of the card (304 by 137 mm, 3 slots) makes it difficult to mount it in both desktop PCs and servers.
    • The gaming cooling system often makes it impossible to mount the 4090 in GPU servers.
    • Compared to the 3090, the AD102 has 70% more CUDA cores.
    • NVIDIA DLSS 3 technology uses motion vector analysis and OFA algorithms.
    • The low latency NVIDIA Reflex platform enhances the gaming experience for professional gamers.
    • 8th generation NVEnc encoder with AV1 encoding support.
    • NVIDIA Broadcast app.
    • NVIDIA Studio.

    Specifications for NVIDIA RTX A4000, NVIDIA RTX A5000, NVIDIA RTX 3090 and NVIDIA RTX 4090 Graphics Cards

    RTX A4000 RTX A5000 RTX 3090 RTX 4090
    Archi­tec­ture Ampere Ampere Ampere Ada Lovelace
    Techno­logy pro­cess 8 nm 8 nm 8 nm 4N
    GPU GA104 GA102 GA102 AD102
    Number of transis­tors (billion) 17,4 28,3 28,3 76,3
    Clock frequency (GHz) 0,74 1.17 1,39 2,23
    Boost Clock (GHz) 1.56 1.70 1.70 2,52
    Memory frequency (MHz) 1,750 2,000 1,219 1,325
    Memory Band­width (Gb/s) 448 768 936.2 1008
    GPU memory(Gb) 16 Gb 24 24 24
    Memory type GDDR6 GDDR6 GDDR6X GDDR6X
    Cache memory (Mb) 4 6 6 72
    ECC memory yes yes no no
    CUDA cores 6 144 8192 10496 16384
    Tensor cores 192 256 328 512
    RT cores 48 64 82 128
    Number of texture modules 192 256 328 512
    Maximum power (W) 140 230 350 450
    Compu­ting perfor­mance FP16 (half) (tera­flops) 19.2 27.8 35.6 82.6
    Compu­ting perfor­mance FP32 (float) (tera­flops) 19.2 27.8 35.6 Up to 82,6
    Compu­ting perfor­mance FP64 (double) 599 giga­flops 867.8 giga­flops 556 giga­flops 1.3 tera­flops
    Theore­tical maximum fill rate (giga­pixels/s) 149.8 162.7 189.8 444
    Theore­tical texture fetch rate (giga­texels/s) 149.8 433.9 566 1290
    Inter­face PCI-E 4.0 x16 PCI-E 4.0 x16 PCI-E 4.0 x16 PCI-E 4.0 x16
    NVIDIA DLSS no no yes 3
    Nvlink no 2-board low-profile confi­gura­tion (2-slot and 3-slot bridges) no no
    CUDA Support 8.6 8.6 8.6 8.9
    VULKAN Support 1.3 1.3 1.2 1.3
    DirectX 12 Ulti­mate 12 Ulti­mate 12 Ulti­mate 12 Ulti­mate
    Shader Model 6.6 6.6 6.7 6.7
    OpenGL 4.6 4.6 4.6 4.6
    OpenCL 3.0 3.0 3.0 3.0
    Virtual GPU (vGPU) software support NVIDIA Virtual PC (vPC) and Vir­tual Appli­cations (vApps), NVIDIA RTX vWS, NVIDIA Vir­tual Com­pute Ser­ver
    Cost (€) 1 500 3 000 1 600 from 1 900

    The new architecture, memory bandwidth and number of tensor cores, DLSS 3 technology and other characteristics of the GeForce RTX 4090 define a wide range of applications for the GPU - not only gaming, but also working with artificial intelligence and complex calculations.

    HOSTKEY Testing

    Description of the test environment

      AMD Ryzen 9 5900 X 12-Core Processor (3.80 GHz)

      32 GB DDR4-3200 ECC DDR4 SDRAM 1600 MHz

      Microsoft Windows 10 Professional 64-bit

    V-Ray GPU CUDA test

    V-Ray GPU RTX Test

    Blender Benchmark

    In this test and in LuxMark, we will only compare the RTX A5000 and RTX 4090 cards, as they are the most relevant in the context of this article.

    LuxMark

    We measured relative GPU performance in rendering. The performance of the GeForce RTX 4090 in the tests looks impressive and almost doubles not only the results of the RTX 3090, but also the professional GPUs. The V-Ray GPU RTX benchmark demonstrates ray-traced GPU performance. The RTX 4090 also outperforms the RTX 3090 by two times.

    "Dogs vs. Cats"

    To compare GPU performance for neural networks, we used the Dogs vs. Cats dataset. The test analyzes the contents of a photo and distinguishes between a cat or a dog in the photo. All necessary initial data is here. We ran this test on different GPUs and in different cloud services, and we got the following results:

    Full cycle of training (min.)

    The full training cycle of the test neural network took from 31 to 60 minutes. The result for the GeForce RTX 4090 was 31 minutes and surpassed the performance of all the other GPUs. The most noticeable difference in the results was between the RTX 3090 and RTX 4090 cards: the new generation of GPUs from NVIDIA coped with the calculations almost twice as fast as the previous Nvidia generation.

    Tests have shown that the closest competitor to the 4090 card is the A5000. It remains to compare these cards in terms of their price-quality ratio. In all the tests, the new card from Nvidia showed a result that exceeded the RTX A5000 by about two times. At the same time, the cost of the RTX 4090 is much lower: 138,000 rubles (minimum price) compared to 216,000. It would seem that the choice is obvious, but there are nuances. The A5000 GPU consumes significantly less power and can be a cost-effective solution for tasks with a constant high load on the GPU over a long term. The RTX A5000 supports NVLink technology, which is useful when training neural networks. A5000 GPUs have no restrictions on using NVENC/NVDEC for parallel video transcoding tasks. With the purchase of a specialized license, the A5000-class professional GPUs can be virtualized and available in the server as several smaller virtual GPUs. Another problem is Nvidia's ban on using drivers for its gaming cards in data centers and remotely outside the office.

    Although NVidia's promotional photo shows a lot of 4090s with large fans and a 3U format, in reality this configuration is almost impossible to buy. In stock there are only large-size gaming cards for 4 units with an increased height and fans blowing out up and down. Such cards cannot be used in servers and in most workstations.

    Conclusion

    The transition to the new Ada Lovelace architecture has significantly increased the performance of the GeForce RTX 4090. Improved tensor cores and RT cores significantly improve the quality and expand the capabilities of real-time ray tracing. The 24 GB memory capacity allows you to process large amounts of data.

    The GeForce RTX 4090 is primarily designed for gaming and is great for various types of computing solutions: AI, data analysis, machine learning. The new architecture greatly outperforms the previous generation of NVIDIA GPUs. An important limitation in the professional use of this video card is its high power consumption and the inability to combine several cards using Nvlink.

    An alternative to purchasing a video card is to rent a GPU server. Our calculations show that monthly rentals for the GeForce RTX 4090 and RTX A5000 cards are comparable in price. Accordingly, if you need to perform professional tasks, renting a GeForce RTX 4090 card can be beneficial due to its high performance.

    Rent GPU servers with instant deployment or a server with a custom configuration with professional-grade NVIDIA RTX 5500 / 5000 / A4000 and RTX 4090 / 3090 / 3080 cards. VPS with dedicated GPU cards are also available . The GPU card is dedicated to the VM and cannot be used by other clients. GPU performance in virtual machines matches GPU performance in dedicated servers.

    Other articles

    05.02.2024

    Test Build: Supermicro X13SAE-F Intel Core i9-14900KF 6.0 GHz

    Test results of a computer assembly based on the Supermicro X13SAE-F motherboard and the new Intel Core i9-14900KF processor overclockable up to 6.0 GHz.

    23.11.2023

    Why is it crucial to host a CRM system on your personal server?

    Which option is better: deploying a CRM on an internal server, purchasing a SaaS solution, or renting hosting?

    06.11.2023

    Guide to deploying and managing a Linux server without bash and sh using ispmanager

    Discover how a server pre-equipped with ispmanager can ease the management of your website and its online infrastructure.

    06.11.2023

    Ispmanager – web server and site control panel

    We tell you how a server with ispmanager pre-installed can simplify your work with site administration and its web environment.

    18.10.2023

    Hiddify personal VPN server

    Step-by-step instructions for setting up a Hiddify personal VPN server.

    HOSTKEY Dedicated servers and cloud solutions Pre-configured and custom dedicated servers. AMD, Intel, GPU cards, Free DDoS protection amd 1Gbps unmetered port 30
    4.3 67 67
    Upload