Migrating a production AI agent to GPT-5.6: 2.2x faster, 27% cheaper

230 points · 106 comments on HN · read original →

Points and comments are a snapshot, not live.

Migrating from Claude Opus to GPT-5.6 Sol cut build times 2.2x and costs 27%.

Ploy, which builds marketing websites via AI agents, replaced Claude Opus 4.8 with OpenAI's GPT-5.6 Sol. In benchmarked redesigns, GPT-5.6 completed builds in 3m 42s vs 8m 0s, cost $2.22 vs $3.06, used fewer tokens, and scored higher on visual quality.

However, the migration required fixing hidden assumptions. GPT-5.6 sent all 25 optional parameters on every tool call (filling unused ones with invented values), causing 52% empty file reads until the schema was transformed. Prompt caching differed: OpenAI uses per-workspace keys with a 15 req/min per-node budget vs Anthropic's organization-wide cache, so misconfiguration initially made GPT-5.6 appear 50% more expensive. Reasoning replay also required switching to self-contained blobs instead of server-side pointers.

What commenters are saying

Many commenters criticized the article's writing style as obviously LLM-generated-citing short phrases separated by commas and colons-calling it hard to read and a signal of low substance. Several argued that detecting LLM authorship is a useful heuristic to skip content, while others defended LLM-assisted writing as helping authors finish and reach audiences. A few commenters disputed that GPT-5.6 is better than Claude for design work, asking for side-by-side evidence. One commenter noted the article contains real insights (e.g., prompt caching differences) despite the style.