XNews

TypeSafe CEO: Rethinking coding agents without KV cache constraints

TypeSafe CEO: Rethinking coding agents without KV cache constraints

TypeSafe CEO Diogo argues that many standard features of coding agents are patches to work around KV cache and per-token costs, not user value. He suggests a thought experiment: design a coding agent without KV cache to identify true design vs. limitations. He notes that agentic parts are simple while loops, with innovation in state, context, and cost management, and that sub-agents' main cost is figuring out what state to pass.

Source posts