The Importance of Slow Rollouts in Product Development
13 April, 2022
Releasing Features Too Fast
Years ago, I was working on an incredibly fast-paced product. We were continuously launching new features, week after week. In software development, introducing a new feature to a set of users is called a "feature rollout." We introduced our new features to everyone at once— rolling out to 100% of the users. The major problem with this approach was getting a lot of feedback that we couldn't process and address.
We'd go over a piece of feedback, fix it, and iterate. But because of the sheer mass of all the new features, we had difficulty catching up. So we couldn't adequately assess the features. We couldn't identify all the bugs and our users' thoughts about the functionalities.
Introducing Features With a Slow Rollout
As someone working in tech, you will have assumptions about how your product should or shouldn’t work. It's wise to remember that sometimes you may be wrong (and at some point, this is very likely). So I can't emphasize the importance of testing and early feedback enough.
My advice for engineering managers is to release features slowly. Start by introducing new functionalities to a small percentage of users. My go-to is between 1 to 5% of users initially, then increase when you have confidence in your feature. That is what we call a "slow rollout." Do this for every feature that you launch. It enables you to get a workable amount of feedback while not disrupting your users too much.
Additionally, before defining a new functionality, do some user research with specifically targeted users. Take the time and opportunity to learn from your responses without impacting your entire user base.
By adopting this phased approach, you reduce the risk of failure drastically. As an engineering leader, you can take in the user feedback and manage your product on a more consistent basis with the help of your partners. Rather than overworking on shaky foundations, your developers can build on tested, approved, and needed features. Overall, a slow rollout will enable your team to execute smoother product launches with less effort and more confidence.
User Feedback Is Gold
- Don't assume that you know what your users want. You may get it right a tiny percentage of the time, but usually, it doesn't work. Be aware of your own biases.
- Conduct thorough testing and research to better understand your product performance and adoption.
- Have a slow rollout for every functionality you plan to launch to reduce the risk of error and wrong assumptions.
Scale your coaching effort for your engineering and product teams
Develop yourself to become a stronger engineering / product leader
Viswa Mani Kiran Peddinti, Sr Engineering Manager at Instacart, walks through his experience scaling a team, product and his skills as a leader.
Viswa Mani Kiran Peddinti
Sr Engineering Manager at Instacart
Vineet Puranik, Senior Engineering Manager at DocuSign, discusses the impact of roadmaps, organization, and proper management for your teams to procure growth.
Senior Engineering Manager at DocuSign
Lucjan Suski, CEO & Co-founder of Surfer, relates how he started a company as a side project and shares his insights on bootstrapping tech startups.
Co-founder, formerly CTO and CEO at Surfer
My accidental journey into product management
Sr. Manager, Product Management at Capital One
Pavel Safarik, Head of Product at ROI Hunter, discusses the frequently overlooked role of product marketing in getting high user adoption rates for your product.
Head of Product at ROI Hunter