NVIDIA debuts DGX Spark, the AI supercomputer you can fit on your desk

Source Cryptopolitan

NVIDIA has launched the DGX Spark, the world’s smallest AI supercomputer, which will start shipping this week. The device integrates GPUs, CPUS, networking, CUDA libraries, and AI software. 

The new release has been integrated with the GB10 Grace Blackwell Superchip. It can deliver up to 1 petaflop of AI performance and 128 GB of unified CPU-GPU memory in a compact desktop form factor. The supercomputer uses ConnectX-7 200 Gb/s networking and NVLink-C2C technology, which provides five times the bandwidth of the fifth-generation PCIe. 

Huang says DGX Spark will democratize AI computing power

NVIDIA’s CEO, Jensen Huang, revealed that the DGX Spark returns the firm to its original mission of democratizing AI computing power. 

“In 2016, we built DGX-1 to give AI researchers their supercomputer. I hand-delivered the first system to Elon at a small startup called OpenAI, and from it came ChatGPT. With DGX Spark, we return to that mission, placing an AI computer in the hands of every developer to ignite the next wave of breakthroughs.”

Jensen Huang, NVIDIA CEO

The DGX Spark enables developers to run inference on models with up to 200 billion parameters and fine-tune models of up to 70 billion parameters locally, eliminating the need to rely solely on cloud or data center services. The latest blog revealed that the DGX Spark has been preloaded with the full NVIDIA AI software stack, including CUDA libraries and NIM microservices. The software stack enables immediate deployment of AI workflows, including image generation, vision search, and language model tuning.

Early adopters include Anaconda, Google, Hugging Face, Meta, Microsoft, JetBrains, Docker, and LM Studio, who have validated and optimized their tools for Spark. Research institutions, such as NYU’s Global Frontier Lab, have also begun testing the unit. Kyunghyun Cho, professor of computer and data science at NYU, said that the DGX Spark allows them to access petascale computing on a desktop. He added that it enables rapid prototyping and experimentation with advanced AI models, even for privacy-sensitive applications such as healthcare.

DGX Spark runs on NVIDIA’s Linux-based DGX OS and is purpose-built for developing and training AI models, rather than consumer applications. Users can also link two Spark systems to support models of up to 405 billion parameters.

Huang personally delivered one of the first DGX Spark units to Elon Musk at SpaceX’s Starbase facility in Texas to commemorate the launch, echoing the 2016 delivery of the original DGX-1 to OpenAI.

NVIDIA stock jumps 2.88% today following the announcement

NVIDIA announced that the DGX Spark will be available for order starting October 15 through NVIDIA’s website and select partner manufacturers, including Acer, ASUS, Dell Technologies, GIGABYTE, HP, Lenovo, and MSI. It will also be available at Micro Center retail outlets in the U.S. and will be made globally available through the AI lab’s distribution network later.

The launch follows NVIDIA’s ongoing GPU supply deals with OpenAI, xAI, Amazon, Microsoft, Meta, Google, and other AI companies. The company recently announced a $100 billion GPU supply agreement with OpenAI and a $6.3 billion deal with CoreWeave.

Cryptopolitan reported that the AI chip maker will invest $100 billion into OpenAI to help the AI lab build massive data centers centered on NVIDIA’s processors. The companies revealed that OpenAI will deploy NVIDIA systems that will require 10 gigawatts of power collectively. The gigawatt measure, used more often now to better describe large AI chip clusters, sets the scale of the project. Jensen Huang told CNBC’s Jon Fortt in San Jose, California, that 10 gigawatts equals around 4 to 5 million GPUs. That matches what the AI chip maker expects to ship this year, twice as much as last year. 

According to Google Finance data, NVIDIA stock was trading at $188.32 at the time of publication, representing a 2.88% increase over the past 24 hours. The stock has also maintained a positive YTD of +40.23%, showing sustained positive investor confidence in the AI chip maker’s performance. 

Claim your free seat in an exclusive crypto trading community - limited to 1,000 members.

Disclaimer: For information purposes only. Past performance is not indicative of future results.
placeholder
Natural Gas sinks to pivotal level as China’s demand slumpsNatural Gas price (XNG/USD) edges lower and sinks to $2.56 on Monday, extending its losing streak for the fifth day in a row. The move comes on the back of China cutting its Liquified Natural Gas (LNG) imports after prices rose above $3.0 in June. It
Author  FXStreet
Jul 01, 2024
Natural Gas price (XNG/USD) edges lower and sinks to $2.56 on Monday, extending its losing streak for the fifth day in a row. The move comes on the back of China cutting its Liquified Natural Gas (LNG) imports after prices rose above $3.0 in June. It
placeholder
Gold Price Forecast: XAU/USD opens lower around $4,450 on fears of widening Iran conflictsGold price (XAU/USD) opens over 1% lower to near $4,445.00 on Monday, as oil prices have rallied further on fears of further widening of conflicts in the Middle East. WTI Oil price is up almost 3% above $102.50 in the opening trade, increasing fears of higher inflation expectations globally.
Author  FXStreet
Mar 30, Mon
Gold price (XAU/USD) opens over 1% lower to near $4,445.00 on Monday, as oil prices have rallied further on fears of further widening of conflicts in the Middle East. WTI Oil price is up almost 3% above $102.50 in the opening trade, increasing fears of higher inflation expectations globally.
placeholder
Gold rises on softer US Dollar, traders await Trump's address on Iran warGold price (XAU/USD) extends the rally to near $4,775 during the early Asian session on Thursday. The precious metal surges amid a weakening US Dollar (USD) and cooling geopolitical tensions in the Middle East.
Author  FXStreet
14 hours ago
Gold price (XAU/USD) extends the rally to near $4,775 during the early Asian session on Thursday. The precious metal surges amid a weakening US Dollar (USD) and cooling geopolitical tensions in the Middle East.
placeholder
Silver Price Forecast: XAG/USD falls to near $72.00 amid fading safe-haven demandSilver price (XAG/USD) continues to lose ground after registering tiny losses in the previous day, trading around $72.90 during the Asian hours on Thursday. The safe-haven demand for the precious metal fades amid rising optimism over Middle East peace.
Author  FXStreet
7 hours ago
Silver price (XAG/USD) continues to lose ground after registering tiny losses in the previous day, trading around $72.90 during the Asian hours on Thursday. The safe-haven demand for the precious metal fades amid rising optimism over Middle East peace.
placeholder
Gold retreats sharply from two-week top/$4,800 as Trump’s Iran comments boost USDGold (XAU/USD) witnessed an intraday turnaround from the $4,800 mark, or a fresh two-week high set earlier this Thursday, and for now, seems to have snapped a four-day winning streak amid resurgent US Dollar (USD) demand.
Author  FXStreet
8 hours ago
Gold (XAU/USD) witnessed an intraday turnaround from the $4,800 mark, or a fresh two-week high set earlier this Thursday, and for now, seems to have snapped a four-day winning streak amid resurgent US Dollar (USD) demand.
goTop
quote