Apple WWDC 2024: Apple Intelligence, iOS 18, new Siri, iPadOS 18 and more
AI takes center stage at Apple's developer event
Apple has launched a new era of AI — as in Apple Intelligence, the company's branding for the AI-powered features coming to its various devices later this year. At WWDC 2024, Apple detailed AI-assisted tools for writing, image editing and organization that are being offered as a preview of what Apple Intelligence has to offer.
Apple Intelligence will have a fairly limited audience to start with. The features will only work on the iPhone 15 Pro, iPhone 15 Pro Max and any Mac or iPad powered by Apple's M series chips. Older devices will be on the sidelines.
The tools Apple showcased during its developer conference add things like writing suggestions, an new Image Playground that creates graphics from prompts and Genmoji. Photo editing tools include a Magic Eraser-like feature that removes background objects from photos and also gathers up photos and videos to create a story based on your prompts.
Many Apple Intelligence features will take place on supported devices, though some tasks may be offloaded to secure Apple services. Apple insists that it won't see or store any of data related to Apple Intelligence activities.
Apple Intelligence may have been the highlight of WWDC, but it wasn't the only announcement. Here's everything Apple announced.
WWDC 2024 Biggest Announcements
- Apple Intelligence: With Apple Intelligence Apple is focusing on AI tools that understand you and context to provide practical and fun tools to help you get more done using a mix of on-device and cloud processing. It's coming to iOS 18, macOS Sierra and iPadOS 18.
- iOS 18: You'll be able to better customize your home screen and control center, with the ability to now lock apps with Face ID. Additional features include improvements to Messages, Mail and Maps, plus a big redesign for Photos.
- iPadOS 18: All of the above features for the iPhone are also coming to the iPad, which also gets its own calculator app, plus a floating tool bar across multiple built-in apps.
- macOS Sequoia: Otherwise known as macOS 15, the upcoming Mac software update will include new Continuity features for access your iPhone from your Mac and Safari upgrades that include page summaries.
- watchOS 11: Apple's smartwatch software is gaining several new fitness-focused features. Highlights include Training Load, which measures workout intensity, and the ability to pause ring progress for rest days and injuries without losing your streaks. A Vitals app collects your health metrics and warns you if something is out of whack, while interface changes improve smart stacks and Photos watch feaces.
- visionOS 2: The Vision Pro software lets you turn 2D photos into spatial photos and support for new gestures. Apple is also launching its headset in additional countries outside the U.S.
- tvOS 18: The software that powers Apple TV devices will gain a feature called InSight that lists info on actors appearing in the shows you're watching. (Any similarity to Prime Video's X-Ray feature is purely coincidental.) Subtitles can kick in automatically when you mute a show or jump back a few seconds, and dialogue audio will be enhanced.
Watch the WWDC keynote replay
The WWDC keynote is over, but you can watch the replay via the embedded video above or on YouTube. Meanwhile, we'll continue to update our blog with more details about today's announcements.
What will macOS be called this year?
An annual tradition just ahead of each year’s WWDC keynote that’s beloved by all — well, beloved by me, anyhow — is trying to guess what name the new version of macOS will be released under. As you may well remember, since macOS 10.9, Apple has named its Mac software after various locations around California, the home state of the Mac maker. If you’ll excuse this stroll down memory lane, those nicknames since macOS 11 have included
- macOS Big Sur;
- macOS Monterey;
- macOS Ventura; and the current version,
- macOS Sonoma
So what’s it going to be this year? Coastlines (Mavericks), mountains (Sierra), deserts (Mojave) and national parks (Yosemite and El Capitan) are already well-represented. My guess is that the name will reflect the arrival of AI features in macOS, with a revamped Siri as the star of the show.
Ladies and gentlemen, I suggest that macOS 15 is going to be unveiled as macOS Hollywood. The good people of Hollywood, Fla., will just have to live with it.
iOS 18 may offer some iPhone 16 clues
As exciting a time as WWDC is, it usually takes a back seat on the Apple events calendar to the fall iPhone launch. (Apple hasn’t announced a date for that yet, obviously, but if we were to make an educated guess, we’d suggest September 10 as the ideal iPhone 16 release date.) But this year might be different.
That’s coming straight from Tom’s Guide editorial director Mark Spoonauer, who thinks that iOS 18 may overshadow the iPhone 16 this year. The reason? While the iPhones are going to see some changes this year — the most notable might be larger screen sizes for the iPhone 16 Pro models — we’re not expecting anything dramatic, at least not along the lines of the AI features Apple has planned for the iPhone at least.
So if you’re eager to see what the highlights of the next batch of iPhones will be, today’s iOS 18 preview may give you a pretty good clue.
Which iPhones will get Apple AI?
I have some big questions about iOS 18 heading into WWDC, and chief among them is exactly which AI features will run on what iPhones.
We’ve heard that the best experience for AI on the iPhone will require an iPhone 15 Pro or later. That would essentially mean you’d need either an iPhone 15 Pro or an iPhone 15 Pro Max — or you’ll need to upgrade to one of the new iPhones coming out this fall. The idea is that only a phone powered by an A17 chipset or later will have the processing power and neural engine to handle iOS 18’s new AI features.
Here’s what’s not clear about that, though: does that suggest only those phones will be able to handle on-device AI and that older iPhones will need to off-load things to the cloud? Or will older iPhones be shut out of AI entirely? A comment in a recent Mark Gurman column at Bloomberg seemingly suggests the latter:
The processing requirements of AI will mean that users need an iPhone 15 Pro or one of the models coming out this year.
I choose to believe that we’re talking about on-device AI here, and that older iPhones will be able to turn to cloud-based servers to assist with AI. We’ll find out for certain later today.
Apple Vision Pro could go international
While we’re not expecting Apple to announce a successor to the Apple Vision Pro at WWDC 2024, that doesn’t mean the keynote will ignore the headset entirely. Rumor has it that Apple is gearing up to release the Vision Pro outside the U.S., meaning international buyers may not have to resort to buying from scalpers for much longer.
It’s been reported that Apple has flown “hundreds of employees from its international stores” to its headquarters in Cupertino, all to train them on all things Vision Pro. That way they can be ready to demo the headset to prospective buyers around the world, and hopefully pick things up after the Vision Pro’s sales slump.
The countries expecting to get the Vision Pro next include Germany, France, Australia, Japan, South Korea, Singapore and China. Sadly there’s been no word on whether the headset will expand to other large countries later on.
The main benefit is that prospective buyers should be able to demo the Vision Pro at the Apple Store, and order a headset that’s been configured to their face shape. Plus you won’t have to pay the markup that resellers tend to charge. And when the device in question if $3,500, you definitely don’t want to have to pay more than you need to.
OpenAI could be key to Apple AI's success
AI is going to play a huge role in iOS 18, and from the sound of things OpenAI is locked in to power a bunch of the generative AI features Apple is set to offer. Of course bringing in a third party company opens up a whole discussion about privacy and security — two things Apple has been pushing hard the past few years. Thankfully there’s a very simple solution.
OpenAI features on iPhone (and iPad) will be opt-in. That way anyone with concerns about the kind of data OpenAI may have access to, or how it will be used, can avoid those features entirely. You just turn them on, and your device will be kept free of anything to do with OpenAI.
You’ll miss out on everything those new AI features will have to offer, but if you’d rather wait for Apple to develop its own systems then you’ll be able to carry on as normal.
Siri 2.0 and Apple Watch are the perfect pairing
WatchOS isn’t getting a lot of attention in the build up to WWDC. But fitness editor James Frew suggests that maybe it ought to. And Siri is a big reason why.
The Siri overhaul predicted for this year isn’t only going to impact the iPhone; rather, it’s supposed to stretch across different Apple platforms, including the Mac and the Apple Watch. It’s that latter device that most interests our fitness editor, who argues that a smarter Siri could make the Apple Watch the ultimate AI wearable.
iPad could finally get a calculator
It seems incomprehensible that 24 years into this millennium, the iPad lacks a built-in calculator app of its own. That’s supposed to change in iPadOS 18, which is et to introduce a Calculator app to Apple’s tablet. And the app is rumored to be getting new features like a resizable window and a list of recent calculations to make this a much more formidable calculator.
It could be a very big WWDC for the Calculator, as the Notes app is supposed to feature tighter Calculator integration. Specifically, a “Math Notes” feature is supposed to allow the Notes app to better display equations, graphs and the like, as Notes becomes a more useful tool for students.
Apple AI may not be perfect at launch
If you had plans to sign up for the iOS 18 public beta to get hold of the upcoming AI features a little early, here’s some warning. According to a report from Mark Gurman at Bloomberg, those beta features could be “especially buggy”. And those features could be official in beta all the way up to the stable release of iOS 18 this fall.
Gurman has spoken about this before, and it’s been claimed that Apple will be referring to AI features as a “preview” rather than finished tech. Beta testing does come with certain risks, and there’s no guarantee that the software will work as advertised. Figuring out where things go wrong is the whole point, after all.
So expect iOS 18’s AI features to behave more like experimental new features, rather than a more-refined software you typically get in one of Apple’s betas. Though whether the situation will change by September, when iOS 18 launches for real, is still unclear.
Apple is coming for the best password manager apps
While AI may be getting most of the attention, WWDC 2024 may also see Apple launch some other incredibly useful (and long-awaited) features. One of those features is reported to be a fully-fledged Apple Password manager, designed to work across iPhones, iPads, Macs and even the Vision Pro.
According to Mark Gurman, this feature will be built on iCloud Keychain, which Apple users will no doubt be familiar with already. But the key difference is that all your saved passwords will be accessible in a single place — making them easier to access. The app is also said to be able to store Wi-Fi details and passkeys, while also acting as an authenticator app with two-factor authentication codes.