Nvidia announces $3,000 personal AI supercomputer called Digits

Each Project Digits system comes equipped with 128GB of unified, coherent memory — by comparison, a good laptop might have 16GB or 32GB of RAM — and up to 4TB of NVMe storage. For even more demanding applications, two Project Digits systems can be linked together to handle models with up to 405 billion parameters (Meta’s best model, Llama 3.1,  has 405 billion parameters).

The GB10 chip delivers up to 1 petaflop of AI performance — meaning it can perform 1 quadrillion AI calculations per second — at FP4 precision (which helps make the calculations faster by making approximations). The system features Nvidia’s latest-generation CUDA cores and fifth-generation Tensor Cores connected via NVLink-C2C to a Grace CPU containing 20 power-efficient Arm-based cores. MediaTek, known for their Arm-based chip designs, collaborated on the GB10’s development to optimize its power efficiency and performance.

Owners of Digits will also get access to Nvidia’s AI software library, including development kits, orchestration tools, and pre-trained models available through the Nvidia NGC catalog. The system runs on Linux-based Nvidia DGX OS and supports popular frameworks like PyTorch, Python, and Jupyter notebooks.  Developers can fine-tune models using the Nvidia NeMo framework and accelerate data science workflows with Nvidia RAPIDS libraries.

They can then deploy them to cloud services or data center infrastructure using the Grace Blackwell architecture and Nvidia AI Enterprise software platform. Nvidia offers a range of similar devices in the same accessibility style. In December, it announced a $249 version of its Jetson computer for AI applications, targeting hobbyists and startups, called the Jetson Orin Nano Super.