How to Use Visual Intelligence on iPhone to Translate, Search, and Ask ChatGPT

Apple first introduced Visual Intelligence with iOS 18.2, a feature that could recognize what your iPhone’s camera saw in real time. With iOS 26, Apple takes it a step further. Visual Intelligence can now analyze both what’s in front of your camera and anything displayed on your screen. That means you can identify objects, translate text, shop online, or even ask ChatGPT questions about what you see.

Here’s a full guide on how to use Visual Intelligence on your iPhone.

What is Visual Intelligence?

Visual Intelligence is an Apple Intelligence-powered feature that combines on-device AI with real-time visual understanding. It debuted with the iPhone 16 series and requires at least an A17 Pro chip with an advanced Neural Engine for fast, private processing.

With it, your iPhone can recognize and extract details from what your camera or screen shows, from identifying a plant to translating a menu, finding products online, or getting instant help from ChatGPT.

Your Complete iOS 26 Playbook:

Get our exclusive Ultimate iOS 26 Guide 📚 — absolutely FREE when you sign up for our newsletter below.

Which iPhones Support Visual Intelligence?

Visual Intelligence is part of Apple Intelligence, available on the following models:

iPhone 15 Pro, 15 Pro Max, iPhone 16, 16 Plus, 16e, 16 Pro, 16 Pro Max, iPhone 17, 17 Pro, 17 Pro Max, and iPhone Air.

How to Use Visual Intelligence on iPhone

From learning about nearby businesses to translating text or chatting with ChatGPT, Visual Intelligence can be your everyday AI assistant. Here’s how to use it.

1. Get Information About Places and Businesses

Visual Intelligence can show you business hours, menus, and contact details just by pointing your camera.

1. Point your iPhone camera toward the business and long press the Camera Control to invoke Visual Intelligence.
2. Press the Camera Control again or tap the capture button on the display to analyze the business.
3. Now, based on the business type, Visual Intelligence will suggest actions including but not limited to:
   • View Schedule: To reveal the operational hours
   • Order: For placing an order with the business
   • Menu: To view the business’s menu or services

Besides these actions, you’ll also find options to call the business, view its website, and more.

Note

This feature is currently available only in the U.S.

2. Interact with Text in Real Time

Visual Intelligence brings Live Text to a new level. Aim your camera at any printed or on-screen text, and your iPhone can instantly summarize, translate, or act on it.

1. Point the camera toward the text and long-press the Camera Control to bring up Visual Intelligence.
2. Press the Camera Control again or tap the capture button on the display to analyze the text.
3. Depending on the text, Visual Intelligence will suggest actions such as summarizing, translating, reading aloud, visiting the website, calling the phone number, and more. Tap the one you prefer.
   • For example, I used Visual Intelligence to summarize the text in the image below.
     
     

3. Ask ChatGPT for More Information

Apple’s ChatGPT integration in iOS 18 makes Visual Intelligence even smarter. You can ask detailed follow-up questions about anything your camera sees.

1. Frame the subject in your iPhone’s Camera app and tap the Ask button at the bottom.
2. Grant ChatGPT the necessary permissions when prompted and tap Enable ChatGPT. You can choose to use ChatGPT with an account if you want. (You only need to do this the first time you use the ChatGPT integration with Visual Intelligence.)
   
   
3. Give it a few seconds, and you’ll see the result for your search in a ChatGPT card at the top of the screen. You can also type or dictate a follow-up question in the text field below if you need further information.
4. Tap the X button in the bottom-right corner to exit Visual Intelligence.
   
   

4. Search for Related Images on Google

Want to find similar items online? Visual Intelligence can reverse-image search using Google.

1. Direct your iPhone’s camera toward the object and long-press the Camera Control to access Visual Intelligence.
2. Tap the Search button in the bottom-right corner, and a Searching with Google dialog box will appear, followed by the search results.
   
   

5. Add Events to Calendar from Posters or Flyers

Starting with iOS 18.3, Visual Intelligence can detect event details from posters or flyers and help you add them to your Calendar.

How to do it:

1. Press & hold the Camera Control button to open Visual Intelligence.
2. Position the iPhone cameras on a flyer or poster with a date.
3. A Create Event button will appear at the top center; tap on it to let Visual Intelligence identify the event.
4. Once identified, Visual Intelligence will prompt you to schedule the event; tap the Schedule button to complete calendar event creation.
   
   

6. Instantly Identify a Plant or Animal

With iOS 18.3 or later, identifying flora and fauna is effortless.

1. Open Visual Intelligence and position the iPhone camera towards the subject (plant or animal) you want to identify.
2. Visual Intelligence will automatically identify the subject and display its name at the top center.
3. Tap on the subject’s name to get more information.
   
   

Note

Visual Intelligence may show “May Be” if it’s unsure.

How to Use Visual Intelligence via the Action Button

If your iPhone doesn’t have a Camera Control button, you can still access Visual Intelligence using the Action Button.

To set it up:

1. Open Settings and head to the Action Button settings.
2. Here, swipe right or left until the Visual Intelligence appears.

Use Visual Intelligence via Action Button

Once configured, long-press the Action Button to invoke Visual Intelligence and start using it just like on the iPhone 16 and 17 series.

What’s New with Visual Intelligence in iOS 26

iOS 26 introduces a major upgrade. Visual Intelligence now works with screenshots. You can circle any part of a screenshot to search or ask ChatGPT instantly.

1. Take a screenshot by pressing the Side button + Volume button.
2. Now, use your finger to circle the part of the image you’re interested in. A new Siri-style glow animation will appear around the circled part.  
3. Tap the Ask button and type a question, or tap the Image Search button or swipe up to reverse image search on the internet.

Use this to compare prices, research images, or get more context about what’s on your screen.

Unlock the Full Potential of Visual Intelligence

Visual Intelligence redefines how your iPhone sees and understands the world. Whether you’re identifying a plant, translating signs, or using ChatGPT for instant answers, it’s a powerful new way to connect the physical and digital worlds.

Are you using Visual Intelligence on your iPhone 17? Share your favorite feature in the comments below. We’d love to hear how you’re using it.

Also read:

• How to use Clean Up to remove objects from photos
• How to create a memory movie with Apple Intelligence on your iPhone
• Here are All the New Camera Features on the iPhone 17 Pro