DevOpsDays Philadelphia 2025

Is your investment in AI paying off... or just generating more sh*tposts?
2025-10-01 , Room 1

We all know investing in developer experience is a good call...but how do you really know if those investments are working? Traditional DevOps metrics? Sure, they help. But now AI is everywhere, promising to save the day. So how do you measure if AI is actually doing anything besides producing the internet's finest sh*tposts?

In this light-hearted talk, I’ll break down real ways to measure AI’s impact—beyond the memes. We’ll look at metrics for individual contributors, teams, and departments, exploring whether AI is a true game-changer or just another shiny buzzword.

Michael Stahnke is a seasoned technology leader and open-source advocate, and VP of Engineering Flox. With experience in leading operations and engineering departments, Michael has played a pivotal role in shaping DevOps practices and automation in software development. Prior to joining Flox he held senior leadership positions at CircleCI and Puppet, where he built and led engineering teams solving problems for developers and operations. He is a regular speaker at technology conferences, sharing insights on DevOps transformations, scalability challenges, and the future of automated workflows. He’s obsessed with measurements of engineering performance and finding a great night of karaoke.