SimulationMaxxing: How Nubank ships agents 20× faster with simulations — Shreya Rajpal, Snowglobe
Nubank ships AI customer support agents 20x faster by generating eval data in simulation rather than waiting for production data.
“If you generate your eval data in sim instead of waiting on production data you can ship agents 20x faster and we'll give you evidence for that.”
Nubank (135M customers, Latin America's largest digital bank) partnered with Snowglobe to replace production-data-dependent evals with synthetic simulation-generated data, achieving a 20x speedup in agent shipping velocity. Their AI customer support agents have reached and in some cases exceeded human-level satisfaction scores (TNPS) across five production agents. The approach — using simulated conversations to bootstrap eval datasets — offers a concrete, evidence-backed solution to the eval data bottleneck that slows most teams shipping LLM agents.