Real Agent Cases

Fill an online grocery cart from a handwritten list with ChatGPT agent

Source date:
Last verified:
Method:
How we verify

Evidence: Article or interviewA newsletter, journalist or interview account of what happened.

PartialThe source says it only partly worked, or had a significant problem a person had to deal with.

What went wrong: Missed one of 16 items and gave up at the store login until the user stepped in; the author called it still not very useful.

Outcome

ChatGPT agent transcribed 15 of 16 items from a photographed shopping list (missing onions), found the nearest Harris Teeter and added them to the cart; a safety monitor first blocked the Kroger login, but after the user said they'd log in themselves and entered the password, it ordered the groceries.

Agent

ChatGPT agent

Prompt Improved prompt

Improved prompt: strengthened by us to avoid the problem in the source. Not tested by the poster. It doesn't change what happened in the source.

Not sure how to start? Tell me what you're trying to get done and I'll help you turn it into a clear request.

Goal: Turn a photo of my handwritten shopping list into a grocery cart at my nearest store, ready for me to check out.

Quick check first: Which store, and which items on the list should I add (for example, only the ones marked in red)?

What I need from you:
- A clear photo of your list
- Your store or ZIP code ([STORE / ZIP])
- Your store account (you'll log in yourself)

Rules:
- First, write out every item you can read from the photo and number them. Show me the list and the total count before you shop.
- Mark any word you can't read clearly and ask me about it instead of guessing.
- If the site asks me to sign in, stop and tell me. I'll log in, then you carry on from where you stopped.
- Add each item, then tick it off. Before finishing, compare the cart against the numbered list and name anything missing.
- Pick the closest match for brand-free items and note any substitutions.
- Don't check out or pay. Stop at the cart.

Output: The numbered list you read, the cart with every item, and a short note of anything missing, swapped or unclear.

If any of this is unclear, tell me what you have and I'll help fill the gaps.

You'll know it worked when: the number of items in the cart matches the number on your list, with no surprises.
What the poster tried (recreated by us)

The source didn't publish its exact prompt; this is our reconstruction of what was asked.

Here is a photo of my shopping list. Add the items marked in red to my cart at my nearest grocery store's website and get it ready to order.

Source

https://www.understandingai.org/p/chatgpt-agent-a-big-improvement-but

By Timothy B. Lee · Published Jul 22, 2025 · Added Oct 15, 2026 · Last verified Oct 15, 2026

Related cases

  • Order groceries from H-E-B with ChatGPT agent (access denied)Improved promptEvidence: Screenshots or logsFailure

    The poster tried to order groceries from H-E-B in Austin with ChatGPT agent, but it failed because access was denied.

    ChatGPT agent · Shopping · Source date:

  • Prep an Instacart order from history and sales with ChatGPT agent (odd picks)Recreated promptEvidence: Described by poster

    Given access to Instacart and told to prep an order from the poster's history and current sales, ChatGPT agent picked items with reasoning the poster found oddly generic ("cereal, which is on sale and a usual part of groceries").

    ChatGPT agent · Shopping · Source date:

  • Order groceries from a 16-item list with OpenAI OperatorRecreated promptEvidence: Article or interview

    Operator misread parts of a 16-item grocery list and added only 13 items to the cart even after corrections; the author concluded it wasn't ready for real use.

    OpenAI Operator · Shopping · Source date: