Apple Vision Pro 'Visual Search' Feature Can Identify Items, Copy Printed Text, Translate and More
The Apple Vision Pro headset's visionOS operating system includes a feature called "Visual Search," which sounds like it is similar to the Visual Look Up feature on the iPhone and the iPad.
With Visual Search, users can use the Vision Pro headset to get information about an item, detect and interact with text in the world around them, copy and paste printed text from the real world into apps, translate text between 17 different languages, and more.
Real world text that includes contact information, webpages, and unit conversions and similar information can be acted upon in visionOS. So, for example, if a printed handout has a website link in it, you can scan the link with the Vision Pro, opening up a Safari window to view the website. Or, if a recipe calls for grams and you need ounces, you can convert using the headset.
Real-time text translation will also be useful for traveling and other instances when you might want to quickly translate what you're seeing in the real world. The Apple Vision Pro headset will be able to automatically detect text and documents, similar to how the iPhone can detect text in photos and allow it to be interacted with.
The Visual Search function was found in visionOS by Steve Moser. visionOS can be accessed through the latest Xcode beta at the moment, as Apple released the first version of the software earlier today.
Popular Stories
2024 is just a few days away, and there are many iOS 17 and iOS 18 features that are expected to launch throughout the year. Below, we have recapped new iOS features expected in 2024, including Stolen Device Protection, collaborative Apple Music playlists, AirPlay on hotel room TVs, app sideloading in the EU, next-generation CarPlay, roadside assistance via satellite outside of the U.S., RCS ...
Apple released the first beta of iOS 17.3 earlier this month, and the upcoming software update includes two new features so far. iOS 17.3 will likely be released in January like iOS 16.3 and iOS 15.3 were, but February is also a possibility if testing is prolonged. Below, we provide additional details about the new features in iOS 17.3 so far. Stolen Device Protection Earlier this...
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models concurrently, which is why we sometimes get rumored feature leaks so far ahead of launch. The iPhone 17 series is no different, and already we have some idea of what to expect from Apple's 2025 smartphone lineup. If you plan to skip...
Inverse's Raymond Wong today published an in-depth overview of Apple's increasing push towards high-end gaming on the Mac. The story includes commentary from Apple marketing managers Gordon Keppel and Leland Martin. One of the biggest reasons that gaming has improved on the Mac in recent years is the switch from Intel processors to Apple silicon, resulting in MacBooks providing...
Apple Watch Series 9 and the Apple Watch Ultra 2 are back in some of Apple's retail stores in the United States today, according to Bloomberg's Mark Gurman. Select stores will have availability today, while all stores will have the Apple Watch models back in stock by December 30. Online sales of the devices are set to resume tomorrow by 12:00 p.m. Pacific Time. Apple is able to begin selling ...
Apple's iPhones include several headline camera features that are worth using, such as Portrait Mode and Photographic Styles. But if all you want to use is the standard photo mode, there are still several tools and settings that can improve the composition of your pictures and help you capture the perfect shot using more traditional techniques. Whether you are the owner of a new iPhone or a...
The ban on imports of Apple Watch Series 9 and Apple Watch Ultra 2 models has today been temporarily paused, meaning that the devices can now go back on sale for a short while longer in the United States. Apple filed an emergency request to the United States Court of Appeals following President Biden's decision to decline a veto on the sales ban, allowing it to take effect earlier this week. ...
Top Rated Comments
And I wonder, 5-10 years from now?, what will this thing look like, how slim will it get, will it replace the glasses I wear now and be just a few ounces and look like normal glasses? Seems crazy to even think that...
But considering that my first gen iPod I listen to led to my thin and powerful iPhone, and the iMac g4 on my home desk is archaic compared to my 11" super thin iPad Pro → I look fwd to what the future holds for this tech and the innovation that comes along with it.