Back to resources

Turning Product Usage Data Into User Features

Product
Users

9 March, 2021

Nicolas Bonnet
Nicolas Bonnet

Sr Director Product Management & Data Science at Autodesk

Nicolas Bonnet, Sr Director of Product Analytics at Autodesk, explains how to build a platform to master the power of product usage data to improve your products

Problem

Gaining a precise understanding of how users interact with product features is key for product managers to build products, users will engage with and love to use. But doing so at scale and taking action on what can be learned from analyzing product usage data whereas in B2B or B2C environments can be extremely challenging.

As the Sr Director of the Product Analytics for Autodesk, my team of product analysts helped me realize that many product managers across product lines were struggling to get a holistic understanding of product usage data despite having on-demand access to well-structured user-level data describing the sequence of commands and operations end-users are going through.

Actions taken

We soon realized that the best way to tackle this analytics gap was to bring a user-centric perspective to it and handle this project as a customer-facing service. We then assembled a small product growth-led team and kicked-off a project focused on turning product usage data into valuable and personalized insights for end-users, aimed at improving user proficiency with our products.

Over the course of one year, we created an insight platform and business processes to ingest product usage data, run signal detection algorithms and ML models to identify out-of-norm usage patterns and deliver insights matching those situations. The system is now in production and processes billions of user transactions weekly to ultimately deliver millions of personalized insights to end-users.

Lessons learned

  • Delivering insights that are truly insightful requires to put the end-user front and center. They are the ultimate judge of how insightful your advice is and as such: time, rapid iterations and the ability to process closed-loop data are key criteria for success. Trust can only be established over time and insightfulness is not a single event.
  • Product usage data is both very powerful and very sensitive. Even in the context of the very complex CAD products of Autodesk, our performance metrics indicate that the vast majority of our users find our insights to be relevant to their product usage and accurate based on their proficiency levels. However, this alone won’t be enough, and you will also have to get your message delivery right because being right on the insights but wrong on how you deliver them would be such a waste of user attention.
  • Putting together a platform for delivering insights at scale is not for the faint of heart. It takes quite a few technology wizards to get things right and a solid technology infrastructure. But quality instrumentation is the prerequisite to the whole journey, or you will ultimately prove on your boss’s budget that the garbage in – garbage out adage is indeed true.

Discover Plato

Scale your coaching effort for your engineering and product teams
Develop yourself to become a stronger engineering / product leader


Related stories

The Art of Asking Why: Narrowing the Gap Between Customers and Users

24 May

Jord Sips, Senior Product Manager at Mews, shares his expertise on a common challenge for product managers – finding root causes and solutions.

Customers
Innovation / Experiment
Product
Personal Growth
Leadership
Stakeholders
Users
Jord Sips

Jord Sips

Senior Product Manager at Mews

Streamlining Product Processes After a Reorganization

16 May

Snehal Shaha, Lead Technical Program Manager at Momentive (fka SurveyMonkey), details her short-term technical strategy to unify processes among teams following an acquisition.

Acquisition / Integration
Product Team
Product
Building A Team
Leadership
Internal Communication
Collaboration
Reorganization
Strategy
Team Processes
Cross-Functional Collaboration
Snehal Shaha

Snehal Shaha

Senior EPM/TPM at Apple Inc.

Navigating Disagreements When It Comes to Priorities

9 May

Pavel Safarik, Head of Product at ROI Hunter, shares his insights on how to deal with disagreements about prioritization when building a product.

Innovation / Experiment
Product Team
Product
Dev Processes
Conflict Solving
Internal Communication
Collaboration
Convincing
Strategy
Prioritization
Pavel Safarik

Pavel Safarik

Head of Product at ROI Hunter

Why You Should Take Technology Risks in Product Development

25 April

Matias Pizarro, CTO and VP of Residents at ComunidadFeliz, recalls a time in his early career when he took a technology risk that had wide-ranging benefits to his product's user experience.

Innovation / Experiment
Product
Scaling Team
Dev Processes
Matias Pizarro

Matias Pizarro

CTO and VP of Residents at ComunidadFeliz

Combining User Research with Testing to Build a Successful Product

20 April

Waldo Vanderhaeghen, VP of Product at 3YOURMIND, details an experience in product discovery, analyzing user research, and testing.

Innovation / Experiment
Product
Conflict Solving
Feedback
Users
Waldo Vanderhaeghen

Waldo Vanderhaeghen

VP Product at 3YOURMIND

You're a great engineer.
Become a great engineering leader.

Plato (platohq.com) is the world's biggest mentorship platform for engineering managers & product managers. We've curated a community of mentors who are the tech industry's best engineering & product leaders from companies like Facebook, Lyft, Slack, Airbnb, Gusto, and more.