I just tried Visual Intelligence on the iPhone 16 — this is actually upgrade worthy

Apple Intelligence Visual Intelligence detecting multiple contact details and dates on a bus route consultation notice
(Image credit: Tom's Guide)

Visual Intelligence was one of the big new features announced as part of the iPhone 16 series launch, but users up until now won't have been able to access it. But with the launch of iOS 18.2 developer beta, any users signed up to Apple Developer can try it out, which is exactly what I've been doing.

Apple touts Visual Intelligence as a way to give you a helping hand with whatever you want to know about immediately in front of you, via your phone's camera. With a press-and-hold of the Camera Control, you can quickly access Visual Intelligence even with your iPhone 16 locked and get some answers. It's basically the Apple take on Google Lens or Circle to Search, except with it being limited to the iPhone 16 series, it's more exclusive.

There are a lot of potential uses for Visual Intelligence, but for this first impressions I tried out as many as I could get to work. Not everything Apple's promised seems to be ready yet, but it's more than enough to get a flavor of what it's trying to do.

Visual Intelligence: The features

Opening up Visual Intelligence with Camera Control is super simple, and comes with a fun rainbow-colored flash to indicate it's active. You can then use the Camera Control to take a snap (as well as with an on-screen shutter button), or zoom in up to 3x. This is digital zoom though, which can make for fuzzy shots that are harder for Visual Intelligence to read. Hopefully Apple will add support for telephoto camera zoom on compatible iPhones in the future.

Apple Intelligence Visual Intelligence being activated from the lock screen and scanning the entrance to Paddington station

(Image credit: Tom's Guide)

Once you have an image captured, you can then in theory learn all sorts of things, like details about a location, or reviews and opening hours for a shop or eatery. While I could do this via the search function, I couldn't get these to pop up immediately like Apple showed off in its demo clips, even with the feature capable of detecting my location.

Perhaps it's because I'm using this in the U.K., which is a step behind the U.S. in Apple Intelligence's rollout, or just because this ability will appear in a later beta. At least for now you can just use the Google search function to get effectively the same information.

A GIF showing Apple Intelligence Visual Intelligence searching for a coffee shop

(Image credit: Tom's Guide)

If there's enough text to read in the image, Visual Intelligence can generate a quick summary for you, similar to what you can do with your notifications or writing in the Notes app, or read it aloud if you can't or don't want to read it at that moment. This works well for a bottom line-style overview of a message, but it is limited by what you can fit into the viewfinder. Signs, posters and documents out in the real world aren't always designed to fit well on an phone-shaped display.

The cover of an issue of ImagineFX magazine, read by Apple Intelligence Visual Intelligence and summarizing the main headlines.

(Image credit: Tom's Guide)

Any text detected by Visual Intelligence can be copied and pasted elsewhere, for example if you want to make a note of something you've passed by to then look up later. It's an ability you've been able to do with images on your iPhone since Live Text debuted in iOS 15, but having it included here too is a wise choice.

It's the same story with Visual Intelligence's ability to scan QR codes. Again, this is something your iPhone's regular camera can do, but there's nothing wrong with having it available in Visual Intelligence mode too.

You can also translate the text if it's written in a different language to the one you're using. Which is why I now know what the name of the nearby Italian restaurant to the TG office literally means.

A restaurant named "Vapiano" being translated by Apple Visual Intelligence as "It goes slowly"

(Image credit: Tom's Guide)

To me, the most impressive thing Visual Intelligence can do right now is grab phone numbers, emails and dates from an image, and suggest further actions. You can immediately send a message to these numbers or emails, add them to your Contacts, or make a calendar event with just a couple of taps, just from a single shot.

Apple Intelligence Visual Intelligence detecting multiple contact details and dates on a bus route consultation notice

(Image credit: Tom's Guide)

Going beyond the on-device features, Visual Intelligence lets you start an image search for an item on Google, which worked perfectly well for me each time I used it. It correctly identified my mug, for example, and offered up some relevant websites to learn more or buy another.

Apple Intelligence Visual Intelligence being used to search for a mug

(Image credit: Tom's Guide)

Perhaps the ability with the most potential is the option to explore a Visual Intelligence image further via ChatGPT integration, something also added in iOS 18.2 beta. However, I kept getting an error message saying ChatGPT couldn't use screenshots from Visual Intelligence. Plus, I kept getting errors when trying to log into my OpenAI account to see if that would fix the problem. That's the beta lifestyle folks, so we'll have to revisit the ChatGPT-powered parts of Visual Intelligence at a later date.

Visual Intelligence: Outlook

Visual Intelligence has me impressed already, even if there is clearly more work to be done at this point. It feels like the equal and opposite to Circle to Search, which is designed to offer similar information and services, except for what's on your screen.

Circle to Search can work similarly to Visual Intelligence if you activate it while your camera's open and looking at what you want to search. But Visual Intelligence has been designed to work much more smoothly with iOS and its associated apps. It's just a pity it's limited to only the latest iPhones.

There's still plenty of time to go until Visual Intelligence arrives on regular users' iPhone 16 devices, and hopefully the only way is up for this feature as future betas refine it. While we love the iPhone 16 series already, the addition of Visual Intelligence will finally give it something completely fresh over previous iPhones — and give potential upgraders the reason they need to upgrade.

More from Tom's Guide

TOPICS
Richard Priday
Assistant Phones Editor

Richard is based in London, covering news, reviews and how-tos for phones, tablets, gaming, and whatever else people need advice on. Following on from his MA in Magazine Journalism at the University of Sheffield, he's also written for WIRED U.K., The Register and Creative Bloq. When not at work, he's likely thinking about how to brew the perfect cup of specialty coffee.

Read more
The Action button settings in iOS 18.4 with a Visual Intelligence shortcut for the iPhone 15 Pro
iOS 18.4 adds a crucial Apple Intelligence feature to the iPhone 15 Pro — and it makes your phone more powerful
The initial splash screen that displays when opening up Apple Visual Intelligence for the first time. It reads "Visual Intelligence with Camera Control - Learn about the objects and places around you and get even more information about what you see. Images from your camera are not stored on iPhone or shared with Apple."
The iPhone 15 Pro is getting one of the best iPhone 16 Pro features for free soon
Writing tools in Apple Intelligence on an iPhone 16e
Getting an iPhone 16e? These are the 7 Apple Intelligence features I'd try out first
Apple Intelligence logo on iPhone
iOS 18.3 proves Apple Intelligence is far from finished
Apple iPhone 16 held in the hand.
Just got a new iPhone 16? Try these 10 features first
Apple Intelligence logo on iPhone
Apple says the iPhone 16 is selling well and Apple Intelligence is a big reason why
Latest in iPhones
Apple iPhone 16 & 16 Plus hands-on.
Forget USB-C — a truly portless iPhone just got the all-clear from the EU
iPhone Flip render
iPhone Flip could solve one of the biggest problems with foldable phones — here's how
iPhone 17 Air concept image
iPhone 17 Air just tipped for exclusive upgrade regular iPhone 17 won't get
iPhone 16 Pro Max
iPhone 18 may miss out on this performance upgrade — what we know
iPhone 17 Air render
iPhone 17 Air — 5 biggest revelations from new in-depth report
Zens Quattro Wireless Charging Pro 4 charging station with 3 iphones and an AirPods case
Double-decker 'AirPower' charger now available from Apple — here's what it costs
Latest in Features
The outline of a hand holding a phone, wrapped in barbed wire to indicate censorship
What are anti-censorship features and how is Proton VPN leading the way?
Casetify Bounce Suitcase
I ditched my Away Carry-On for a bright red suitcase made by a phone case brand, and I was shocked by how much I liked it
Astell and Kern HB1
I just turned my wired audio headphones into Bluetooth cans with this DAC — and the sound quality is shockingly good
Bare feet poking out of the covers at the end of a bed
Twitching in your sleep? Expert shares 5 most common causes of hypnic jerks
Two people sit on top of the Plank Firm flippable double-sided mattress in a bedroom
I've been using a luxury mattress for a year and my sleep is better than ever — here's why
Half-Life 2 RTX
I just went back to Ravenholm in Half-Life 2 RTX — Nvidia’s new RTX remix tech makes it 10x more terrifying