NVIDIA is absolutely dominating the AI conversation right and for good measure – their GPUs perform out-of-the-box and are a top choice for professionals and businesses that want to dabble […]
NVIDIA is absolutely dominating the AI conversation right and for good measure – their GPUs perform out-of-the-box and are a top choice for professionals and businesses that want to dabble in consumer AI. But just this week, both Intel and AMD optimized their software stacks to get massive speedups in generative AI which has seen AMD’s RTX 7900 XTX get higher performance per dollar than an NVIDIA RTX 4080 in generative AI (specifically Stable Diffusion with A111). Considering Stable Diffusion accounts for the vast majority of non-SaaS, localized generative AI right now – this is a major milestone and finally offers some competition to NVIDIA.AMD’s 7900 XTX achieves higher iterations per second per dollar in Stable Diffusion than NVIDIA RTX 4080
Using Microsoft Olive and DirectML instead of the PyTorch pathway results in the AMD 7900 XTX going form a measly 1.87 iterations per second to 18.59 iterations per second! You can read the detailed guide by AMD over here. This level of performance in Automatic111 is pretty close to the SHARK-based approach to Stable Diffusion and definitively puts the company on the map with regards to generative AI.
