Start United States USA — software Nvidia thinks its GPUs are better for onboard AI than NPUs

Nvidia thinks its GPUs are better for onboard AI than NPUs

53
0
TEILEN

A recently leaked internal presentation from Nvidia explains the company’s apparent preference for discrete GPUs over Neural Processing Units (NPUs) for running local generative AI applications. The.
The big picture: Competing standards could soon emerge as companies like Microsoft, Intel, Qualcomm, and Apple prepare to promote PCs and other devices that prioritize on-device AI operations. Microsoft and Intel recently outlined what they think should be classified as an „AI PC,“ but the AI sector’s current leader, Nvidia, has different ideas.
A recently leaked internal presentation from Nvidia explains the company’s apparent preference for discrete GPUs over Neural Processing Units (NPUs) for running local generative AI applications. The graphics card giant could view NPUs from other companies as a threat since its earnings have skyrocketed since its processors became integral for operating large language models.
Since launching its Meteor Lake CPUs late last year, Intel has tried to push laptops featuring the processors and their embedded NPUs as a new class of „AI PC“ designed to perform generative AI operations without relying on massive data centers in the cloud.

Continue reading...