StoryFirst seen
Benchmarks are becoming saturated faster each year, so measurement tools must keep pace with models.
Everything it touches
0 names 1 voices 1 source posts
The story’s neighborhood
Explore the graph, or choose a connection below.
Follow the evidence
This brief comes from Tech Twitter’s edited headlines. The posts below are the sources grouped with the story; statements in them belong to their authors.
AI is getting better faster than our measurements are I threw together SatBench, which measures how quickly major AI benchmarks become saturated (effectively beaten). Of 173 benchmarks cited by the Labs since 2023, 63% are now saturated. Saturation is happening faster each year.Read original on X