TypeSafe CEO Argues KV Cache Distorts Agent Design, Proposes Explicit State

TypeSafe CEO Diogo presented a thought experiment: designing coding agents without KV cache reveals that many standard features are workarounds for token costs. He identified six anomalies and proposed a design with explicit state and query-aware context rebuilding, enabling cost-aware routing, effective sub-agents, and better skills.