Quad GPU 5U Rackmount Workstation for AI Training & Inference
Convertible 5U rackmount server / tower workstation for machine learning training, fine-tuning, and inference with AI large language models
Puget Labs Certified
These hardware configurations have been developed and verified through frequent testing by our Labs team. Click here for more details.
Overview
Convertible 5U rackmount server / tower workstation for machine learning training, fine-tuning, and inference with AI large language models.
- Supports up to four NVIDIA RTX 6000 Ada video cards with a total of 192GB of VRAM
- Tested with Llama-2-70b-chat-hf and Falcon-40b
- Runs on 120V power – requires a single 20 amp or two 15 amp circuits
Not sure what you need?
Tell us your situation and one of our experts will reply within 1 business day to help configure the right computer for your workflow. If you don’t see what you are looking for here, check out our other systems for more options.
System Ports
Back Ports:
- USB BIOS Flashback Button
- Clear CMOS Switch
- USB 2.0 Port(s)
- iKVM LAN Port (RJ-45)
- USB 3.2 Gen 2 (USB 3.1) Port(s)
- 10G LAN Ports (RJ-45)
- USB 3.2 Type C Port(s)
- USB 3.2 Gen 2×2 Type C
- VGA Out Port
- Audio Jacks
Front ports:
- Power Switch
- Reset Switch
- HDD LED
- LAN LED
- USB 3.2 Gen 1 (USB 3.0) Port(s)
- USB 3.2 Type C Port(s)