Databricks' Five Observations from Deploying GPT-6 Astra: Cost Up 60%, Gains on Hard Tasks

Databricks co-founder Patrick Wendell shared internal data on GPT-6 Astra deployment: capability gains concentrated on complex tasks, overall spending rose 60%, and they used a gateway with queue experiments for rollout. They implemented budget-based routing to steer engineers to appropriate models.