Real Agent Cases

QA-test a department chatbot and file Jira bugs with Claude Cowork and Chrome

Posted
by @Kole_Sam
Last checked
Method:
How we verify

Evidence: Screenshots or logsThe source shows screenshots, a transcript or the agent's output.

Outcome

Using Claude Cowork with the Chrome extension, the poster had it navigate a new chatbot like a user and produce a report of what worked, what needed improvement, bugs, repro steps and fixes; after the poster reproduced the bugs, Claude created Jira tickets assigned to the right teammates.

Agent

Claude Cowork, Claude in Chrome

Prompt Recreated prompt

The source didn't share its exact prompt, so we wrote this from what it describes.

Before you start, ask me 1–3 short questions about the details below and wait for my answers. Once I've answered, confirm the plan in one line and run the whole task start to finish.

Goal: Test a web app like a real user and turn what breaks into clear bug reports.

Quick-check questions: Which app, which flows matter most, and where should bugs go (Jira project)?

What I need from you:
- The app URL ([URL])
- The main flows or test questions
- Your Jira project (tickets only after I approve)

Rules:
- Click through each flow and log what happened at each step.
- For every bug, write numbered repro steps, expected vs actual, and a suggested fix.
- Don't create tickets until I've reproduced the bugs and said go.

Output: A findings report (works well / needs improvement / bugs with repro steps), then Jira tickets once approved.

If my answers leave a gap, make a sensible choice, say what you assumed, and keep going.

You'll know it worked when: you can reproduce every listed bug by following its steps.

Source

https://x.com/Kole_Sam/status/2062964099974369751