Real Agent Cases

Fill a Walmart pickup cart with 26 meal-plan groceries using ChatGPT computer control, stopping before checkout

Posted
by Arthur Sullivan (LinkedIn)
Last checked
Method:
How we verify

Evidence: Described by posterThe person describes what happened in words, without screenshots or video.

PartialThe source says it only partly worked, or had a significant problem a person had to deal with.

What went wrong: All 26 items were added, but one quantity was wrong (1 lemon instead of 2); the poster reviewed and placed the order themselves.

Outcome

With school and sports starting, Arthur Sullivan had ChatGPT make a meal plan and grocery list, then logged into Walmart and asked it to arrange the order: pickup time, store brands over name brands, and no purchase without review. Using ChatGPT Work's computer control, it added all 26 items to the cart; the only mistake was one lemon instead of two. Sullivan reviewed the order before buying.

Agent

ChatGPT

Prompt Recreated prompt

The source didn't share its exact prompt, so we wrote this from what it describes.

Run this task now, exactly as written below. Everything you need is here, so start straight away and only stop if something required is missing or a rule below tells you to.

Goal: Turn my meal plan's grocery list into a ready-to-review online grocery cart, without checking out.

Fill in before running:
- The grocery list with quantities: [LIST]
- Store and pickup or delivery time: [STORE / TIME]
- Preferences (e.g. store brand first, organic, budget): [PREFERENCES]

Rules:
- I'll sign in myself before you start.
- Add each item at the quantity on the list and follow my brand preferences.
- If an item is missing, pick the closest match and note it.
- Do not check out or pay; stop when the cart is ready.
- If a site asks me to sign in, pause and let me do it myself (including any CAPTCHA or two-step code); never guess or store passwords.
- Ask for my OK before you pay, book, send, submit or cancel anything.
- Check facts that can change (prices, opening hours, dates, availability, rules) against the official source, and tell me anything you couldn't verify.

Output: A filled cart and a list of every item added, with substitutions and quantity checks marked.

You'll know it worked when: the cart matches my list item-for-item and I only need to review and pay.

Try this in:

This prompt has blanks to fill in, like [LIST]. We'll copy it instead of filling it in, so you can edit it before you send.

Opens in a new tab. We don't see what you send.

These links are only a shortcut. We're not affiliated with OpenAI, Google or xAI, and your results may not match the source.

Optional stronger version

Our rewrite with extra checks. The poster didn't test it.

Run this task now, exactly as written below. Everything you need is here, so start straight away and only stop if something required is missing or a rule below tells you to.

Goal: Turn my meal plan's grocery list into a ready-to-review online grocery cart, without checking out.

Fill in before running:
- The grocery list with quantities: [LIST]
- Store and pickup or delivery time: [STORE / TIME]
- Preferences (e.g. store brand first, organic, budget): [PREFERENCES]

Rules:
- I'll sign in myself before you start.
- Add each item at the quantity on the list and follow my brand preferences.
- If an item is missing, pick the closest match and note it.
- Do not check out or pay; stop when the cart is ready.
- If a site asks me to sign in, pause and let me do it myself (including any CAPTCHA or two-step code); never guess or store passwords.
- Ask for my OK before you pay, book, send, submit or cancel anything.
- Check facts that can change (prices, opening hours, dates, availability, rules) against the official source, and tell me anything you couldn't verify.
- Before stopping, re-read the list and compare quantities against the cart line by line.

Output: A filled cart and a list of every item added, with substitutions and quantity checks marked.

You'll know it worked when: the cart matches my list item-for-item and I only need to review and pay.

Before you finish: re-read my goal and constraints, check your answer against each one, and list anything you assumed or couldn't confirm.

Source

https://www.linkedin.com/posts/arthurjsullivan_this-weeks-practical-ai-experiment-meal-activity-7497760598911279104-RWvL

  • Betting they could do the weekly shop in five minutes, Kirk Simmons connected ChatGPT to the family Google Calendar to find a delivery window, gave it a spreadsheet of favourite recipes and household needs, and let its in-app browser shop. It asked what food was left, suggested a meal plan, turned it into a list, chose between two supermarkets on budget and fresh food, and clicked items into the cart one by one. It took nearly an hour, picked a fruit-and-veg box when asked for a fruit box, and spent time comparing ethical chocolate brands; the shop arrived on time and well under budget.

    ChatGPT · Shopping · Source date:

  • Order weekly meal delivery with ChatGPT agentRecreated promptEvidence: Described by poster

    ChatGPT agent logged into Gym Meals Direct, chose meals and sizes, picked Monday delivery and applied a discount.

    ChatGPT agent · Shopping · Source date:

  • Fill an online grocery cart from a handwritten list with ChatGPT agentImproved promptEvidence: Article or interviewPartial

    ChatGPT agent transcribed 15 of 16 items from a photographed shopping list (missing onions), found the nearest Harris Teeter and added them to the cart; a safety monitor first blocked the Kroger login, but after the user said they'd log in themselves and entered the password, it ordered the groceries.

    ChatGPT agent · Shopping · Source date: