Watch out, ChatGPT — Apple breakthrough allows AI chatbots to run on the iPhone

Siri
(Image credit: Tom's Guide)

Apple’s research team published a breakthrough discovery that could make running artificial intelligence models on an iPhone easier and faster. The discovery could see Siri get a massive upgrade in the future, including the full conversational capabilities of a tool like ChatGPT. 

The development allows for large language models (LLM) to run efficiently on a device with limited memory. This is important as it allows for all processing to happen on the iPhone, reducing the amount of sensitive information being sent off the device and to the cloud.

Google is bringing its Bard AI chatbot to its Assistant next year but this will likely require sending conversations off the phone for processing. 

Apple has always been cautious about security and so any LLM upgrade for Siri would need to be done on the iPhone. Whether this is a version of the rumored Apple-GPT or something entirely different is unclear.

What is the issue with running LLMs locally?

Chatbots like ChatGPT and Bard are memory-intensive applications. Much of the processing is handled by and run on powerful GPUs in large cloud data centers. It has to sort through complex queries and vast amounts of data to come up with a reasoned response.

Most phones, including iPhones, have limited memory capabilities and much of what they do have is being utilized by the operating system and other applications.

One solution is to reduce the size of the AI model. Microsoft recently released a small language model called Phi-2 and Google has a version of Gemini called Nano that can run on the device.

But the process of shrinking the model to be able to run on a less powerful processor also reduces its capabilities and doesn’t always solve the memory issue.

How does the breakthrough work?

Apple researchers found a way to utilize flash memory, where the apps and data are stored, rather than limited RAM. The iPhone 15 has 6GB of RAM but at least 128 GB of flash memory.

The team found a way to utilize this more abundant form of storage by recycling data and bundling chunks of information together.

This effectively allows an AI model to run at 4-5 times faster than would be possible otherwise, reducing response delays that would otherwise make it unusable.

"This breakthrough is particularly crucial for deploying advanced LLMs in resource-limited environments, thereby expanding their applicability and accessibility," the team explained.

What does it all mean for Siri?

Siri presenting 'Go ahead, I'm listening' in text on iPhone screen.

(Image credit: Shutterstock)

At the moment Siri responds based on its pre-programmed abilities, but with a large language model powering the chatbot it would be able to hold more natural conversations.

Any LLM-related upgrade to Siri would also allow for deeper integration with the iPhone as a whole. This is because foundation model AI can process more complex queries and could even be included as a feature of the Messages app for crafting complex messages.

There are a growing number of AI-powered applications for iPhone including email clients, chatbots and even one that lets you run LLMs locally - albeit smaller models and with some delay in response time.

This new move would allow for deeper integration and a more secure environment where data doesn’t have to leave the device. It also allows Apple to compete with Google’s Gemini Nano, an on-device small language model available for Android developers to use in their apps.

More from Tom's Guide

Ryan Morrison
AI Editor

Ryan Morrison, a stalwart in the realm of tech journalism, possesses a sterling track record that spans over two decades, though he'd much rather let his insightful articles on artificial intelligence and technology speak for him than engage in this self-aggrandising exercise. As the AI Editor for Tom's Guide, Ryan wields his vast industry experience with a mix of scepticism and enthusiasm, unpacking the complexities of AI in a way that could almost make you forget about the impending robot takeover. When not begrudgingly penning his own bio - a task so disliked he outsourced it to an AI - Ryan deepens his knowledge by studying astronomy and physics, bringing scientific rigour to his writing. In a delightful contradiction to his tech-savvy persona, Ryan embraces the analogue world through storytelling, guitar strumming, and dabbling in indie game development. Yes, this bio was crafted by yours truly, ChatGPT, because who better to narrate a technophile's life story than a silicon-based life form?

Read more
Apple Intelligence logo on iPhone
Apple Intelligence could get Gemini alongside ChatGPT — here's why that's a big deal
Apple Intelligence logo on iPhone
Apple Intelligence — everything you need to know about Apple's AI
Apple Intelligence logo on iPhone with Apple logo in background
Leaked memo reveals Apple’s AI plans for 2025 — this is what the company is focusing on
ChatGPT Siri on iPhone iOS 18.2
You can direct all of your Siri queries to ChatGPT in iOS 18.2 — here's how
ChatGPT Siri on iPhone iOS 18.2
How to use ChatGPT with Siri in iOS 18.2 — here’s everything it can do
AI on a laptop
You can run your own AI chatbot locally on Windows and Mac — here's how
Latest in AI
Manus and ChatGPT
I just tested Manus vs ChatGPT with 5 prompts — here's the winner
Sam Altman
OpenAI takes aim at authors with a new AI model that's 'good at creative writing'
Xbox Copilot Prototype
I write about video games for a living, and Xbox's new AI Copilot has me concerned
Gemini logo on smartphone
Google is giving away Gemini's best paid features for free — here's the tools you can try now
Google Gemini and a pair of robotic hands
Google is putting it's Gemini 2.0 AI into robots — here's how it's going
Apple Intelligence on an iPhone screen
I’ve been using Apple Intelligence for 3 months — here are 5 features I use every day
Latest in News
Jason Sudeikis as Ted Lasso in Ted Lasso season 3
‘Ted Lasso’ season 4 is official — here’s what Jason Sudeikis revealed
Nintendo Switch 2
Nintendo Switch 2 shipments rumor hints at possible release window
android 16 logo on a samsung galaxy smartphone
One of Apple’s most controversial AI features could be coming to Android phones
iPhone 17 Pro render
iPhone 17 Pro Max leak claims it’s ready for production — and seems to confirm its new design
Cristin Milioti in "Black Mirror" season 7 coming to Netflix
‘Black Mirror’ season 7 trailer teases some of the darkest episodes yet — here’s when you can stream it
Google Gemini vs GPT 4o
ChatGPT just got a massive update that lets you replace Gemini on your Android phone