Apple Vision Pro — this new free app turns any image into a 3D spatial photo

Spatial Media Converter
(Image credit: Spatial Media Converter)

Apple Vision Pro’s Spatial Photos give you a completely new perspective on the scenes and people you capture. It allows you to place the image, much like a statue, in your view.

You can create dedicated spatial photos and videos using the Apple Vision Pro itself or using your iPhone camera. This is only available in the iPhone 15 Pro or Pro Max and lets you capture 3D scenes, storing them in the Photos app on the Vision Pro.

Indie developer J Paris Morgan has also released a new app for Apple Silicon Macs that lets you convert existing photos into the types of 3D creations viewable on the Vision Pro.

How does the converter app work?

Spatial Media Converter

(Image credit: Spatial Media Converter)

The Spatial Media Converter app can take any .png or .jpg picture, including older photos or images generated by AI, and convert it into a fully realized Spatial Photo.

Images have to be at least 381 pixels wide or tall, as there is a bug in Apple’s image processing that causes it to reject the conversion if the picture is smaller than that size.

It starts by converting from the Red Blue Green (RGB) image to a depth map, which is then projected onto a 3D mesh to create an RGB-Depth image. This is then turned into a stereo image by working out the disparity between left and right eyes when viewing the picture.

“Finally, we convert the stereo image to a HEIC file which is compatible with Apple Vision Pro,” explains Paris. All of this happens on device using the AI processing capabilities of Apple Silicon.

How well does the app work?

Spatial Media Converter

(Image credit: Spatial Media Converter)

From the demo video and examples shared by users of the app (on Discord) it does an impressive job of converting 2D images into three dimensional creations. 

I’ve used the app to create a couple of Spatial Photos myself, but without a Vision Pro I haven’t been able to view them. However, in the preview the color holds well and the detail accurately reflects the original.

This format also extends beyond the Vision Pro, as the Meta Quest headsets also support Spatial Photos and there could be a variety of uses for them. As Paris explains, “converting RGB images to spatial photos is useful for various computer vision and 3D modeling applications.”

We’re likely to see more tools like this in future as spatial computing grows in popularity, with users wanting a way to bring their existing images over to the new format. 

More from Tom's Guide

Ryan Morrison
AI Editor

Ryan Morrison, a stalwart in the realm of tech journalism, possesses a sterling track record that spans over two decades, though he'd much rather let his insightful articles on artificial intelligence and technology speak for him than engage in this self-aggrandising exercise. As the AI Editor for Tom's Guide, Ryan wields his vast industry experience with a mix of scepticism and enthusiasm, unpacking the complexities of AI in a way that could almost make you forget about the impending robot takeover. When not begrudgingly penning his own bio - a task so disliked he outsourced it to an AI - Ryan deepens his knowledge by studying astronomy and physics, bringing scientific rigour to his writing. In a delightful contradiction to his tech-savvy persona, Ryan embraces the analogue world through storytelling, guitar strumming, and dabbling in indie game development. Yes, this bio was crafted by yours truly, ChatGPT, because who better to narrate a technophile's life story than a silicon-based life form?

Read more
Apple Vision Pro on table
Apple Vision Pro is getting a big Apple Intelligence upgrade with visionOS 2.4 — here's all the new features
The Action button settings in iOS 18.4 with a Visual Intelligence shortcut for the iPhone 15 Pro
iOS 18.4 adds a crucial Apple Intelligence feature to the iPhone 15 Pro — and it makes your phone more powerful
Apple Vision Pro
Apple Vision Pro major upgrade tipped with visionOS 2.4 — here's all the new features
Apple Vision Pro
Apple Vision Pro review: A revolution in progress
The initial splash screen that displays when opening up Apple Visual Intelligence for the first time. It reads "Visual Intelligence with Camera Control - Learn about the objects and places around you and get even more information about what you see. Images from your camera are not stored on iPhone or shared with Apple."
The iPhone 15 Pro is getting one of the best iPhone 16 Pro features for free soon
Galaxy Z Fold 6 running PhotoDirector app.
Portrait or landscape? I used generative AI to put an end to this photo controversy for good
Latest in AI
ChatGPT logo in a kitchen with ants
I used ChatGPT Vision and Deep Research to rid my kitchen of sugar ants for good — here’s how I did it
ChatGPT logo on phone
ChatGPT’s new image generator is now 'delayed for a while' for free users
Apple Intelligence on an iPhone screen
Apple Maps data will be used to train AI models — here's what we know
Gemini and ChatGPT logos on a phone
I've made Gemini my primary AI tool instead of ChatGPT — here's 5 reasons why
Microsoft Copilot app running on a phone with Microsoft logo in background
Microsoft 365 Copilot debuts new research tools for work: here's what that means
AI Mode of google search
Google’s making it easier to start new AI Mode searches — here’s how
Latest in News
NYTimes Connections
NYT Connections today hints and answers — Friday, March 28 (#656)
Reddit logo and Reddit logo on phone
Reddit, X and MLB.TV were down — live updates on outage
Nintendo Switch 2 console, Joy-Con controllers and dock
The Switch 2's mysterious "C" button may have just been confirmed by Nintendo
Nintendo Switch virtual game card
Nintendo just announced 'Virtual Game Cards' ahead of Switch 2 launch
Gerard Butler as Detective Nick "Big Nick" O'Brien in "Den of Thieves 2: Pantera"
Netflix top 10 movies — here’s the 3 worth watching right now
Graphic screen displaying malware detection warning
This dangerous new Windows malware hides from your antivirus while impersonating a popular PC brand