XNews

EvolveScaler: Information Evolution Benchmark via Executable State Machine

EvolveScaler: Information Evolution Benchmark via Executable State Machine

EvolveScaler models information evolution as an executable state machine, generating natural language logs. It includes 117 prototypes, 159 question operators, and 5 difficulty tiers. On the hardest tier, frontier models score median avg@5 of 11.3; training on it improves +5.25 across 8 benchmarks.

Source posts