From semiconductors to software libraries, AI training to deployment, and systems to cloud services, NVIDIA says it is bringing AI to the world’s fingertips.
Jensen Huang introduced how the company is bringing AI to virtually every industry during his 2023 GTC keynote. From semiconductors to software libraries, AI training to deployment, and systems to cloud services, NVIDIA says it is bringing AI to the world’s fingertips.
The 2023 GTC Developer Conference, now in its 14th year, will include 650 talks from leaders in AI development. This includes NVIDIA’s CEO Jensen Huang. Huang’s keynote speech spanned how NVIDIA and its partners are offering everything from training to deployment for cutting-edge services. Following the launch of ChatGPT last year, the CEO remarked, « We are at the iPhone moment of AI. » This year, Huang discussed how NVIDIA and its partners are seeking to overcome a breadth of challenges with AI technology.
NVIDIA H100 NVL With NVLink
Huang announced a new GPU, the H100 NVL with dual-GPU NVLink. This new GPU is based on NVIDIA’s Hopper architecture and features a Transformer Engine design to process models such as the GPT model which powers ChatGPT. In comparison, the new H100 with dual-GPU NVLink is up to 10 times faster than the previous HGX A100 for GPT-3 processing.
« H100 can reduce large language model processing costs by an order of magnitude, » explained Huang.
Grace Hopper
The company’s new superchip, Grace Hopper, connects the Grace CPU and Hopper GPU over a high-speed 900GB/sec coherent chip-to-chip interface.
