Often when engineering leaders think about the productivity of their team they rely primarily on output metrics. Did we ship features on time? Did we accomplish our goals for the quarter? These are useful questions to ask but the challenge is that they are lagging indicators. By the time you know the result it's too late to adapt.
This is why the best engineering leaders also include leading indicators of productivity (input metrics) in their analysis to enable their teams to adapt to obstacles real-time and maximize their team's ability to deliver value.
Paul Graham, the founder of Y Combinator, wrote about the most important input metric for software engineer productivity, Maker Time — large uninterrupted blocks of time:
When you're operating on the maker's schedule, meetings are a disaster. A single meeting can blow a whole afternoon, by breaking it into two pieces each too small to do anything hard in.
Software engineers are makers. Their days need to be chock full of uninterrupted blocks of time to allow deep thought and concentration for them to do their best work.
Measuring Maker Time
Tanooj Luthra manages the Observability team at Brex, responsible for metrics and alerting for a stack that processes billions of dollars of transactions. Being naturally data-driven, he decided to start tracking his team's maker time by analyzing his team's calendar data with Okay. He suspected that if he dug into the metrics driving his team the same way the Observability team's metrics drive Brex he would find opportunities to help his team be more productive.
Okay breaks down a team's time into three buckets:
- Maker Time: Free blocks of at least 2 hours of focus time
- Friction time: Free blocks less than 2 hours long
- Meeting Time: All the time spent in meetings
Tanooj was surprised to learn that on a typical week his team only had 50% Maker Time. This is not uncommon and most engineering managers that start measuring Maker Time with Okay see that their team's baseline is ~45%. Equipped with the data, Tanooj immediately went to work with his team. In 6 weeks he was able to increase his team's productivity by 40% by improving average engineer Maker Time from 20 to 28 hours per week (the equivalent of adding 2.4 engineers to his team of 6).
Improving Maker Time
Tanooj leveraged three techniques to get his team to best in class maker time:
- Align 1/1s to the team's schedule instead of the manager's: As a manager there's always the temptation to batch your 1/1s into chunks so that they work well for your schedule. Seeing how much friction time 1/1s created for his team, Tanooj immediately saw an opportunity to defragment his team's calendars. By using his team's calendars as the anchor for scheduling instead of his own, he was able to avoid ruining otherwise productive mornings and afternoons.
- Increase team awareness of the real cost of meetings: As soon as Tanooj analyzed his calendar data he shared the metrics with his team. Almost immediately his team became more aware about the cost of interruptions. His engineers had already suspected that their meeting load was problematic. Now that they had the data, they were suddenly empowered to make changes to their habits and see the results. Tanooj's team started declining/cancelling old recurring meetings and working to make sure necessary recurring meetings were scheduled at the best times.
- Optimize ad-hoc meeting scheduling: Typically 20% of meetings are scheduled last minute (a few days or less in advance) and many of them are organized by the team itself. Tanooj's team ensured that these meetings were thoughtfully placed at the right times by minimizing interruptions to flow for the team. One easy best practice is to always schedule new meetings adjacent to existing meetings to avoid friction time.
By measuring his team's time and sharing it transparently with them, everyone worked together to reach a substantially higher sustainable level of productivity.
As you would expect, not only did productivity go up, team happiness also increased. One of Tanooj's engineers shared their experience during a sprint retrospective:
I've had noticeably more maker time lately — thank you!! I was a lot happier last week because I got to just code a LOT!
The Brex Observability team now regularly achieves 70%+ Maker time.
Few engineering leaders systematically measure this critical input metric today and it's a large untapped opportunity for improving engineering productivity.
Peter Drucker put it well when he said:
What gets measured gets managed
Tanooj and his team have embraced Drucker's advice and demonstrated the value of leveraging calendar metrics to create high performing teams.
— Okay Founders Antoine Boulanger, Tomas Barreto