XNews

Armature Study: Agent Product Selection – Stripe 88%, Codebase Context Decisive

Armature Study: Agent Product Selection – Stripe 88%, Codebase Context Decisive

Armature ran 16,893 sessions with three coding agents (Claude Code, Codex, Cursor) choosing third‑party products to add capabilities. From 5,292 valid sessions across 18 sectors, Stripe dominated payments (88%), Neon databases (66%), AWS cloud (62%), and PostHog analytics (53%). Five key findings: agents' information sources diverge (only 42% agreement); codebase context is decisive (Vercel 100% in Next.js, 0% in Python); high mentions do not equal selection (PayPal, LangChain); a single pricing‑page line can flip outcomes (Mailgun’s short log retention); and persona/wording changes winners (enterprise persona swaps to Entra ID, Grafana). The same codebase and agent gave inconsistent choices across rephrased prompts in most domains.

Source posts