Home United States USA — IT Modder converts $95 AMD APU into a 16GB Linux AI workhorse

Modder converts $95 AMD APU into a 16GB Linux AI workhorse

329
0
SHARE

A modder recently published instructions for coaxing AMD APUs that cost around $100 into running AI tasks usually associated with far more expensive graphics cards. If it.
Forward-looking: The AI boom has companies scrambling for Nvidia’s H100 and A100 GPUs, which are in short supply and cost tens of thousands of dollars. Meanwhile, a modder has discovered and shared a method of performing AI tasks on hardware available for less than one percent of that price.
A modder recently published instructions for coaxing AMD APUs that cost around $100 into running AI tasks usually associated with far more expensive graphics cards. If it catches on, the method could significantly expand the number of people who can at least experiment with AI.
The most prominent players in AI today operate tools like large language models using H100 and A100 graphics cards that Nvidia sells for $25,000 to $30,000 (reportedly a 1,000 percent profit margin for the GPU manufacturer), and they can’t get enough of them.

Continue reading...