
Yusuf Tayman
Yusuf Tayman is a Lead QA Engineer at Insider One with eight years of experience in test automation and QA architecture. He specializes in building AI-driven systems that augment and automate manual testing processes, serving as the automation mentor across engineering teams. Yusuf is passionate about leveraging AI agents to eliminate repetitive testing bottlenecks, reduce human error, and give teams real-time visibility into application quality.
Usage Lies - What Actually Proves an Internal AI Tool Works
Usage Lies - What Actually Proves an Internal AI Tool Works

Our telemetry dashboard was green — a bug-fixer skill firing hundreds of times a week, a test-coverage agent running on every diff, manual-tester agents driving browser test cases across products, security reviews kicking off across teams, daily active users climbing. And I still couldn't answer one question: did any of it make us better? Every usage metric was lying. This talk is how we drove real adoption of an internal AI plugin marketplace across 30+ engineering teams — hands-on workshops and embedded champions — and how we now measure what actually matters: fewer bugs, faster cycles, less busywork, not call counts.