Apple's Visual Intelligence Feature Exclusive to iPhone 16 Models
The new Visual Intelligence feature offers a variety of camera-enhanced capabilities on the iPhone 16 series with iOS 18.2.
Apple has introduced an advanced feature called Visual Intelligence, available exclusively on the iPhone 16 and iPhone 16 Pro models with iOS 18.2. This feature enhances the camera experience by offering a range of intelligent tools that leverage Apple’s AI to analyze and interact with images. Here’s an overview of what Visual Intelligence can do.
Activating and Using Visual Intelligence
To activate Visual Intelligence, users need to hold down the Camera Control button for a few seconds. A simple press will just open the camera app with Camera Control, but holding it longer activates Visual Intelligence mode. The feature works only when the camera isn’t already in use. Once activated, the interface provides a live camera view, a capture button, and options to “Ask” or “Search.”
Get Details About Places
When you’re out and about, Visual Intelligence can offer detailed information about your surroundings. For example, if you’re at a restaurant or retail store, taking a photo of the location can provide you with business hours, menu details, ordering options, reservation capabilities, and direct access to the location’s website.
Summarize Text
The “Summarize” option is ideal for long text. By capturing an image of text, users can tap “Summarize” to get a brief overview. Though concise, this feature is useful for quickly digesting content without diving into lengthy details.
Read Text Aloud
For captured text, the “Read Aloud” button will prompt Siri to read the text aloud, providing an auditory option for easier access. This feature supports the selected Siri voice, offering a convenient way to consume text on the go.
Translate Text
If the captured text is in a different language, users can tap “Translate” to convert the text into their preferred language (currently limited to English). This function enables quick translations without needing additional apps.
Go to Website Links
Should an image contain a URL, Visual Intelligence detects the link and presents it as a clickable option, taking you directly to the associated website.
Send Emails and Make Calls
If an image contains an email address or phone number, users can directly tap the contact information to either compose an email or initiate a call. This feature streamlines communication without needing to manually input the information.
Create Calendar Events
For any images containing dates, Visual Intelligence offers the option to add the event to your calendar. This makes it easier to stay organized and quickly add appointments or events to your schedule.
Scan QR Codes
Visual Intelligence also supports QR code scanning. Simply point the camera at a QR code, and a link will appear, which users can tap to open in a browser. This functionality also works in the Camera app without needing Visual Intelligence mode to be activated.
Ask ChatGPT
One of the standout features is the integration with ChatGPT. Users can take a picture of an object and tap “Ask” to send the image to ChatGPT for identification or to ask a question related to it. The AI will provide a response, and users can continue the conversation if they wish. This functionality is linked to Siri’s ChatGPT integration, and although no data is collected by default, users can opt-in by signing into their OpenAI account.
Search Google for Items
Using the “Search” button, Visual Intelligence enables users to conduct a Google Image Search. Taking a photo of an item will help users find similar items online, which can be particularly helpful for shopping.
Visual Intelligence is a powerful addition to the iPhone 16’s capabilities, providing users with enhanced functionality for a variety of everyday tasks, from identifying objects to facilitating communication and streamlining online searches.