Read signs, menus and supermarket labels abroad with Gemini Live

Posted

Jun 21, 2026 by Rajesh Pandey (Android Police)

·

Last checked

Oct 17, 2026

·

Method:

How we verify

Evidence: Article or interviewA newsletter, journalist or interview account of what happened.

Outcome

On a trip to Barcelona, Android Police's Rajesh Pandey pointed Gemini Live's camera at Spanish signs and asked what they meant, had it find vegetarian lasagna and other vegetarian ready meals on a supermarket shelf, and used it to understand local café menus instead of ordering the one dish he recognized. He still used Google Translate's Live Conversation for talking with locals and hospital staff.

Agent

Gemini Live

The source didn't share its exact prompt, so we wrote this from what it describes.

Before you start, ask me 1–3 short questions about anything important that's missing below. Keep them quick. Then do the task, checking in with me at the key points.

Goal: Be my on-the-spot travel helper abroad: explain signs and menus I point my camera at, and find food that fits my diet.

What I can give you (ask for whatever's missing):
- Country and language
- My diet or allergies (e.g. vegetarian)
- What I'm pointing at: sign, menu, shelf, label
- How much detail I want (one line or a full explanation)

Rules:
- Translate first, then explain what it means for me in one sentence.
- For menus, say what each dish is and flag anything that doesn't fit my diet.
- On a shop shelf, point out which products match my diet and say if you're unsure from the label.
- For anything important (medicine, allergies, legal notices), tell me to confirm with a person.
- Check facts that can change (prices, opening hours, dates, availability, rules) against the official source, and tell me anything you couldn't verify.

Output: Short spoken or written answers: translation, what it means, and a suggestion.

You'll know it worked when: I can order and shop confidently without guessing.

Before you start, ask me 1–3 short questions about anything important that's missing below. Keep them quick. Then do the task, checking in with me at the key points.

Goal: Be my on-the-spot travel helper abroad: explain signs and menus I point my camera at, and find food that fits my diet.

What I can give you (ask for whatever's missing):
- Country and language
- My diet or allergies (e.g. vegetarian)
- What I'm pointing at: sign, menu, shelf, label
- How much detail I want (one line or a full explanation)

Rules:
- Translate first, then explain what it means for me in one sentence.
- For menus, say what each dish is and flag anything that doesn't fit my diet.
- On a shop shelf, point out which products match my diet and say if you're unsure from the label.
- For anything important (medicine, allergies, legal notices), tell me to confirm with a person.
- Check facts that can change (prices, opening hours, dates, availability, rules) against the official source, and tell me anything you couldn't verify.
- If the camera image is blurry or cut off, ask me to move closer rather than guessing.

Output: Short spoken or written answers: translation, what it means, and a suggestion.

You'll know it worked when: I can order and shop confidently without guessing.

Before you finish: re-read my goal and constraints, check your answer against each one, and list anything you assumed or couldn't confirm.

Source

https://www.androidpolice.com/gemini-live-the-travel-assistant-i-didnt-know-i-needed/