Maxim Salnikov’s Post

Are you measuring GitHub Copilot usage… or real impact? 🤔 Many teams proudly track seats, active users, and suggestion acceptance in GitHub Copilot. That’s adoption. But leadership conversations are shifting toward something else: 👉 Is AI actually improving engineering performance? This is where gh-devlake changes the game. Built as a GitHub CLI extension, gh-devlake connects Copilot usage data with real delivery metrics across your engineering systems. More details and how to start: https://msft.it/6048Q5AMC Instead of looking at AI stats in isolation, you can correlate: - Copilot usage - PR cycle time - Deployment frequency - Change failure rate - Mean time to recovery Now we’re talking about impact. What I like about this approach is that it moves the conversation from opinion to evidence. You’re no longer asking whether AI “feels” productive. You’re analyzing how AI adoption aligns with actual delivery outcomes in your organization. For engineering leaders, this is critical. AI investments need defensible ROI narratives. gh-devlake gives you the foundation to build them using your own DevOps data. We are entering the phase where AI in engineering is not about experimentation anymore. It is about measurable value. Are you already correlating Copilot adoption with delivery metrics? Or still tracking usage alone? Eldrick Wega, Morten Stange Bye, Haakon Hasli, Else Tefre, Christian Tryti, Majid Hajian, Pankaj Agrawal, Muhammad Daniyal (Dani), Chris Romp, Daniel Meppiel, Jonas Helin, Joel Norman, Adil I., Ömür Sert, Francesco Manni, Jaime De Mora #GitHubCopilot #EngineeringLeadership #DeveloperProductivity #DevLake #DevLakeCopilot #msftadvocate

  • No alternative text description for this image

I agree. Tracking usage alone doesn't tell the whole story. Correlating Copilot usage with PR cycle time, deployment frequency and change failure rate as you mentioned, gives a much better picture of real impact.I'd also love to see how this translates into business value. Higher velocity is great, but only if we are shipping the right things for our customers 😉

Thanks for the share Maxim Salnikov! We're hard at work to provide more impact-related information (e.g. how do PRs with Copilot Code Review or Coding Agent do vs PRs without them?) Stay tuned!

Thanks for sharing, we have been asking a lot of these questions, good to see such a valuable resource

This is interesting. Indeed very hard to measure what value AI adds in the development process.

Wait, I'm not supposed to be tracking lines of code?! 😅

See more comments

To view or add a comment, sign in

Explore content categories