The Problem-Solving Process: A Modern, Data-Driven Approach for Engineering leaders
28 October, 2021

CEO at Insightly Analytics
Problem
In an engineering organization, when it comes to people and process efficiency, it is subjectivity-driven and not data-driven, which is a significant problem.
- We cannot tell if all our retrospectives and process changes are making our teams better or worse.
- Are we going faster or slower? Who is overloaded, and who has capacity?
- Why do we miss deadlines when enough time has been spent on sprint planning?
- Why can't we predict issues early when we check in with the team every day on the scrum calls?
- When you add a new engineer to the team, is your throughput going up or down?
All these happen due to the lack of data-driven nature. As a CTO, I had to make decisions for different parts of the engineering teams, relying on subjectivity, and as we all know, that's not always done right.
Actions taken
To tackle this situation, I reached out to other engineering organizations and leaders to understand how they were dealing with this situation and understood this had been a broader problem than I assumed. But, to become data-driven, the number one challenge was to identify the right metrics that would bring in the desired behaviors.
As part of my research, I came across the DORA metrics, which Google launched. DORA did an extensive analysis with over 33K companies globally and came up with metrics that would help bring data culture to any company. I quickly jumped in to hack some dashboards together and realized that it's a lot of work to get this data from disparate tools like Git and Jira and show them in real-time dashboards. Although I could see the value, I couldn't build it internally as it distracted our core business. That's when I went ahead and launched my startup, Insightly Analytics, to solve precisely this challenge.
Now, we use Insightly to make all team decisions using data, which is the starting point of our conversations in any scrum meeting. We were surprised with many myth busters about our efficiency and how we were investing the efforts in the wrong places due to lack of data.
Today, instead of asking round-robin about the status updates during our standup call, we look at the dashboard, understand the work completed, and finish our calls in half time. With every release, our retrospective meetings clearly show if our previous decisions are helping us get better or worse. Most importantly, we can look backward, identify patterns and celebrate successes on our improvements.
Lessons learned
- Data-driven processes will bring a universal language based on which teams can be aligned and easily communicated across.
- Having real-time dashboards with data can reduce a lot of meeting times.
- When data is available at managers' fingertips, there are fewer slack interruptions asking for status updates and reports.
Discover Plato
Scale your coaching effort for your engineering and product teams
Develop yourself to become a stronger engineering / product leader
Related stories
16 May
Snehal Shaha, Lead Technical Program Manager at Momentive (fka SurveyMonkey), details her short-term technical strategy to unify processes among teams following an acquisition.

Snehal Shaha
Senior EPM/TPM at Apple Inc.
9 May
Pavel Safarik, Head of Product at ROI Hunter, shares his insights on how to deal with disagreements about prioritization when building a product.

Pavel Safarik
Head of Product at ROI Hunter
4 May
Kamal Qadri, Senior Manager at FICO, drives the importance of setting expectations when optimizing large-scale requirements.

Kamal Qadri
Head of Software Quality Assurance at FICO
25 April
Matias Pizarro, CTO and VP of Residents at ComunidadFeliz, recalls a time in his early career when he took a technology risk that had wide-ranging benefits to his product's user experience.

Matias Pizarro
CTO and VP of Residents at ComunidadFeliz
6 April
Henning Muszynski, Head of Frontend at Doist, promotes his ideas on how documentation ensures consistency, efficiency, and standardization.

Henning Muszynski
Head of Frontend at Doist
You're a great engineer.
Become a great engineering leader.
Plato (platohq.com) is the world's biggest mentorship platform for engineering managers & product managers. We've curated a community of mentors who are the tech industry's best engineering & product leaders from companies like Facebook, Lyft, Slack, Airbnb, Gusto, and more.
