Real Agent Cases

Upgrade a plugin to a new framework alpha with Codex CLI

Source date:
Last verified:
Method:
How we verify

Evidence: Screenshots or logsThe source shows screenshots, a transcript or the agent's output.

Outcome

A one-line `codex exec` loop read the Datasette 1.0a20 upgrade docs, fixed the failing tests, and got the datasette-checkbox plugin passing again.

Agent

OpenAI Codex CLI

Prompt Original prompt

Exact prompt as published in the source.

Run the command tadd and look at the errors and then read ~/dev/datasette/docs/upgrade-1.0a20.md and apply fixes and run the tests again and get them to pass

Source

https://simonwillison.net/2025/Nov/6/upgrading-datasette-plugins/

By Simon Willison · Published Nov 6, 2025 · Added Oct 15, 2026 · Last verified Oct 15, 2026

  • Migrate two websites from WordPress to Wagtail with Claude CodeRecreated promptEvidence: Described by poster

    Over a weekend Claude Code migrated two sites from WordPress to Wagtail (PHP to Python), including server setup, data transfer, testing and fixes, and redesigned a homepage; the poster reports nothing broke and traffic and tools stayed in place.

    Claude Code · Coding · Source date:

  • Migrate a 50-screen app from Firebase to Supabase with Claude CodeRecreated promptEvidence: Described by poster

    Going feature by feature, the poster used Claude Code to generate database schemas, write queries and fix daily errors; they report migrating about 85% of a 45–50 screen Flutter app from Firebase to Supabase in 10–20 days.

    Poster says:~85% migrated in 10–20 days

    Claude Code · Coding · Source date:

  • Automate defect remediation across C/C++ codebases with Codex CLIRecreated promptEvidence: Company case study

    According to OpenAI's case study, Cisco's Codex CLI defect-repair workflow raised defect resolution throughput 10–15x, and Codex build optimization saved more than 1,500 engineering hours a month.

    According to OpenAI:10–15x defect resolution throughput

    OpenAI Codex CLI · Coding · Source date: