--- title: "Generation Scales. Verification Doesn't." date: 2026-03-21 url: "https://x.com/ccatalini/status/2035347943323279800" tags: ['ai-agi'] deck: "Verifying whether a paper is a breakthrough requires roughly the same expertise as producing one. AI science is the extreme case: infinite generation, fixed verification bandwidth." tweetCount: 4 likes: 45 reposts: 7 --- The answer is you can’t — not cheaply. Verifying whether a paper is a breakthrough requires roughly the same expertise as producing one. Generation scales. Verification doesn’t. [x.com](https://twitter.com/dwarkesh_sp/status/2035083959499972976) We call this the Measurability Gap. The harder a task is to verify relative to how hard it is to execute, the less safely you can automate it. AI science is the extreme case: infinite generation, fixed verification bandwidth. We formalize this, and map the conditions under which verification becomes the binding constraint on AI progress, in Section 5: [arxiv.org](https://arxiv.org/html/2602.20946v2#S5) “Reality is the ultimate eval” is exactly right. The question is whether world models can internalize enough physics to run that eval without a human expert in the loop. If they can’t, we have a ceiling. [x.com](https://twitter.com/elonmusk/status/2035235191586017537)