StoryFirst seen

Adding an owner prompt raises cost per coding task, not per pass

Early results from a partial run suggest the added instruction doubles tokens per task while leaving cost per successful solution unchanged.

Archived Updated

Everything it touches

2 names 1 voices 1 source posts

The story’s neighborhood

NAMESVOICESPOSTS

Explore the graph, or choose a connection below.

Follow the evidence

The source posts

This brief comes from Tech Twitter’s edited headlines. The posts below are the sources grouped with the story; statements in them belong to their authors.

dexLead source
still only 10% of the way through running fable 5.2 on slopcodebench, and testing two variants: 1) the standard "just solve" prompt 2) the standard prompt, with anthropics recommended "you are the long term owner of this codebase" addendum so far "you are the owner" doubles the # of tokens per task - unclear if it leads to better results interesting the owner line on circuit_eval leads to a full-pass, vs. 50% pass for the default prompt ALSO - while the cost per task is much higher, the cost per PASS is about the same across both prompts also, the "you own this prompt" leads to more formal tests (doesn't mean without it you get no tests, in past runs I've seen models used much more ad-hoc scripts etc for testing)
Read original on X

Shared connections

Related stories