
Eric Kontargyris
Eric is a Solutions Engineer at Braintrust, helping engineering teams move AI from experiment to production through evaluation and observability. He previously spent a decade in pre-sales at AI and data startups, including Rasa and OmniSci (formerly MapD), where he was an early sales engineer. Earlier in his career, he designed electronic trading systems for fixed income at Lehman Brothers, and now focuses on turning real-world AI use cases into production systems.
Braintrust, Germanykontargyris
Why Building Eval Platforms Is Hard
Why Building Eval Platforms Is Hard

An eval platform is not just a test runner. You are building shared definitions of “good,” reliable data pipelines, labelling workflows, versioning, and trust in results across many teams and model changes. This session breaks down the hidden complexity, the common failure modes, and the design principles that make evals credible and usable in day-to-day engineering.