The breakthrough could make it easier for Apple to bring a GPT-like feature to the iPhone.
Apple’s AI researchers say they’ve made a huge breakthrough in their quest to deploy large language models (LLMs) on Apple devices like the iPhone without using a ton of memory. Researchers are instead bringing LLMs to the device using a new flash memory technique, MacRumors reports.
In a research paper called « LLM in a Flash: Efficient Large Language Model Inference with Limited Memory, » researchers note that in the world of mobile phones, flash storage is more prevalent than the RAM that is traditionally used to run LLMs.
