Nvidia at CES 2025: a desktop supercomputer that can run 200B parameter LLMs
Announced this Monday at CES, Nvidia's Project DIGITS personal AI supercomputer aims to put a petaflop of AI processing power in the hands of every data scientist, AI researcher and student. The small and mighty unit packs a GB10 Grace Blackwell Superchip and can run models of up to 200 parameters.
On Monday at CES, Nvidia unveiled Project DIGITS, a $3000 personal AI supercomputer sporting the novel NVIDIA GB10 Grace Blackwell Superchip to deliver a petaflop of computing performance, enough for prototyping, fine-tuning and running LLMs up to 200 billion parameters in size. In addition to the GB10, Project DIGITS units feature Wi-Fi, Bluetooth and USB connectivity, 128 GB of unified memory and a 4 TB solid-state drive. Nvidia's ConnectX technology enables two Project DIGITS devices to be linked together to double up capacity and run LLMs with as many as 405 billion parameters.
The new NVIDIA GB10 Grace Blackwell Superchip is a system-on-a-chip (SoC) featuring an Nvidia Blackwell GPU with latest-generation CUDA cores and fifth-generation Tensor Cores connected to a 20-Arm core Nvidia Grace CPU. Nvidia built the SoC in collaboration with leading Arm SoC designer MediaTek. Project DIGITS harnesses the power of the GB1o through Nvidia's Linux-based DGX operating system. Additionally, and delivering Nvidia CEO Jensen Huang's promise that Project DIGITS runs the entire Nvidia AI stack, Project DIGITS have access to Nvidia's software and libraries, including the NVIDIA NeMo framework for model fine-tuning, RAPIDS libraries for data science, and NVIDIA Blueprints and NVIDIA NIM microservices for agentic AI applications.
Project DIGITS is expected to be available this May.
An entrepreneur with over a decade of experience in AI, Cloud, and HPC. He is currently a DevOps Architect and the founder of Data Phoenix, an influential media voice for the AI industry, with a strong focus on community building and open source.
More news
CES 2025: Delta announced a new AI-powered assistant is coming to its app
Dmytro Spodarets·Jan 10, 2025
Nvidia at CES 2025: Introducing Cosmos, the chipmaker's contribution to 'physical AI' research
Dmytro Spodarets·Jan 9, 2025
Nvidia at CES 2025: announcing the RTX Blackwell 5090, "the most powerful consumer GPU ever created"
Dmytro Spodarets·Jan 8, 2025
AMD at CES 2025: new consumer chips for gaming, content creation and AI PCs
Dmytro Spodarets·Jan 7, 2025