Lay out what was paid and owed in a vendor billing dispute with ChatGPT (it invented invoice numbers)
- Posted
- by Jamaal Glenn (LinkedIn)
- Last checked
- Method:
- How we verify
Evidence: Described by posterThe person describes what happened in words, without screenshots or video.
FailureThe source says the agent did not get the job done.
What went wrong: ChatGPT invented every invoice number; caught by a spot-check just before sending.
Outcome
A business owner fed ChatGPT all of the payment history, invoices and email threads from a vendor billing misunderstanding and asked it to set out exactly what had been paid and what was still owed. Five seconds before sending the email, he spot-checked a couple of invoice numbers and found they were all made up: they looked real and had the right format, but none existed. He didn't send it.
Agent
Prompt Recreated prompt
The source didn't share its exact prompt, so we wrote this from what it describes.
Run this task now, exactly as written below. Everything you need is here, so start straight away and only stop if something required is missing or a rule below tells you to. Goal: Reconcile what has been paid and what is still owed, using only the documents I provide. Fill in before running: - Invoices: [ATTACH] - Payment records: [ATTACH] - Email thread with the vendor: [ATTACH] Rules: - Use only invoice numbers, dates and amounts that appear word for word in my documents. - For every line, name the document and page it came from. - If something is missing or unclear, write 'not found' instead of filling it in. - Draft the email only after I approve the reconciliation table. - If a site asks for a login, a CAPTCHA or payment details, stop and hand control back to me. - Ask for my OK before you pay, book, send, submit or cancel anything. - Check facts that can change (prices, opening hours, dates, availability, rules) against the official source, and tell me anything you couldn't verify. Output: A reconciliation table with sources, then a draft email. You'll know it worked when: every number in the email matches a document I can point to.
Optional stronger version
Our rewrite with extra checks. The poster didn't test it.
Run this task now, exactly as written below. Everything you need is here, so start straight away and only stop if something required is missing or a rule below tells you to. Goal: Reconcile what has been paid and what is still owed, using only the documents I provide. Fill in before running: - Invoices: [ATTACH] - Payment records: [ATTACH] - Email thread with the vendor: [ATTACH] Rules: - Use only invoice numbers, dates and amounts that appear word for word in my documents. - For every line, name the document and page it came from. - If something is missing or unclear, write 'not found' instead of filling it in. - Draft the email only after I approve the reconciliation table. - If a site asks for a login, a CAPTCHA or payment details, stop and hand control back to me. - Ask for my OK before you pay, book, send, submit or cancel anything. - Check facts that can change (prices, opening hours, dates, availability, rules) against the official source, and tell me anything you couldn't verify. - Before sending, check every invoice number and amount against the original documents yourself. Output: A reconciliation table with sources, then a draft email. You'll know it worked when: every number in the email matches a document I can point to. Before you finish: re-read my goal and constraints, check your answer against each one, and list anything you assumed or couldn't confirm.
Source
Related cases
- Plan a 4-year-old's birthday run of show and rain backup with ChatGPTRecreated promptEvidence: Described by poster
Planning her daughter's fourth birthday, a poster used ChatGPT to create the party's run of show for everyone helping, think through a rain backup plan comparing restaurants with covered space, and draft emails to those restaurants with what she needed and could spend. She reads every draft and approves what gets sent; a virtual assistant handled invitations and vendor coordination.
ChatGPT · Personal · Source date:
- Clear a $1,195 medical bill after a Medicaid-to-Medicare switch with GrokRecreated promptEvidence: Described by poster
A poster says Grok helped him fix a $1195 spurious medical bill that arose when the government moved him from Medicaid to Medicare after his SSDI was approved.
Grok · Personal · Source date:
- Let ChatGPT watch your Gmail and only interrupt you for emails that need actionEvidence: Article or interview
TechRadar's Eric Hal Schwartz set an event-triggered ChatGPT task on his Gmail: alert him only when an email required him to do something or came from family, explain it in one sentence, draft a reply, and never reply without his input. Over an afternoon with Gmail closed he got just 3 alerts (his bank, a family member whose drafted reply he sent after small edits, and an event itinerary change); afterwards he found only two emails he might have wanted earlier, neither urgent.
ChatGPT · Personal · Source date: