Developers creating Windows apps that leverage generative AI will soon gain access to an API for running GPU-accelerated small language models through the Windows Copilot Runtime. The.
The big picture: Microsoft, Intel, AMD, and Qualcomm recently presented their plans to introduce “AI PCs” leveraging neural processing units NPUs for onboard generative AI, primarily through Microsoft’s Copilot AI assistant. However, AI industry leader Nvidia believes its RTX graphics chips are better suited to the task. Among the company’s announcements is a confirmation that Microsoft and Nvidia are collaborating to enable Copilot to utilize RTX hardware.
Developers creating Windows apps that leverage generative AI will soon gain access to an API for running GPU-accelerated small language models through the Windows Copilot Runtime. The collaboration between Microsoft and Nvidia will allow Copilot and related generative AI applications to run on both NPUs and RTX GPUs, potentially bringing locally processed AI workloads to more PCs.
