Apple Intelligence is heading towards Vision Pro as part of upcoming operating system updates. Apple confirmed Friday that its generative AI platform will arrive in augmented reality headsets as part of Visionos 2.4. The software beta version is currently available to developers. The public version is set for the April release.
Like the iPhone and Mac before that, Vision Pro receives Apple Intelligence updates on Waves. The first set includes several familiar products that focus primarily on text and image generation. The company is seeing the addition of features such as rewrite, calibration and summarization as key components of the device workflow.
It’s worth keeping in mind that Apple has built the Vision Pro as a “spatial computing” device from the start. For all video, gaming and other entertainment features, the company is trying to set the system apart from its expansion reality predecessors by deploying it as an extension to desktop computing. . ”
Currently, creating text is a mixed bag of headsets. The default typing method requires the wearer to look at the letters before pinching two fingers to select. It’s well implemented, but it’s a hassle when you’re faced with writing more than one or two words at a time. Voice deals with this bottleneck to some extent, and Apple’s latest AI-powered Siri SuperCharge is suitable for Smart Assistant’s Vision Pro Future.
Apple is supplying banks to a combination of voice dictation and generative AI writing tools to provide a smoother experience and convince more Vision Pro users to incorporate headsets into their existing workflows . At the very least, features like message overviews and smart email replies streamline interaction with different apps without taking users away from specific tasks.
Image Playground is another big piece of the puzzle, bringing image generation to wearable displays as part of the Visionos 2.4 update. This feature is integrated directly into the Visionos Photos app, allowing users to create images via oral prompts.
All of the above features have previously been deployed on iOS, MacOS, and iPados. There are no new Apple Intelligence features specific to Vision Pro that arrives in this update.
In addition to Visionos 2.4, Apple has also launched the Vision Pro iPhone app, which will arrive on iOS 18.4. This is also currently in beta. This app serves several different purposes. Most importantly, it is the ability to view VisionOS content, such as TV shows and movies, and can be transferred to your headset. This feature appears to be part of the response to the limitations of wearing a headset, both in terms of personal comfort and battery life. If you want to scroll through content, you can also do it from the comfort of your iPhone.
If your iPhone is unlocked and is near your headset, you can also use the new app to manage your guest account. Vision Pro encourages the owner when someone is about to sign in as a guest. Streaming images of guest headset views can also be accessed through the new app.