Back to resources

How to Increase Engagement Using the Right Metrics

Alignment
Mission / Vision / Charter
Conflict Solving
Convincing
Team Processes
Data Team

11 November, 2021

Richard Maraschi
Richard Maraschi

VP Data Product Management at WarnerMedia

Richard Maraschi, VP of Data Products and Insights at WarnerMedia, speaks on how he increased user engagement using measurements and experimentation.

Problem

When I began working at one of the world’s largest multinational TV news channels, it was going through a digital transformation to become a direct-to-consumer streaming media service . At that time, the key measure of performance was based on multi-platform audience reach, a measure of how many reached globally. However, this measure was flawed in that we were unable to measure whether our audience was actually engaged with our content. Furthermore we were unaware how frequently or for how long any one audience member would read, watch, or listen to different types of content. This focus on audience reach hindered our ability to pursue our mission statement: "to inform and empower the world." Not only that but, our journalists were incentivized to write stories that would get 'clicks,' or views, rather than those that would inform and empower. My team and I implemented a system of measurements that would improve our product while shifting the mindset of those opposed to metrics.

Actions taken

The first step taken in this process was to implement active and engaged user metrics our website. I created a plan that defined different user events and measurements that we were looking to track content consumptions, such as how far scrolled on a piece of media, how long spent consuming content within a session, , how fast an article was read, and how often users frequented the site. I shared this plan with my analytics and engineering teams, and it was added as a capability to our site. This information was applied across all of our media platforms, incorporating videos, articles, and audio clips. We transferred this information into a data warehouse where our analytics and product teams analyzed the data to understand our consumers' behavior patterns.

From here, we established a term called 'active users.' An active user was a consumer that viewed or interacted with a piece of content each day and frequented our site. The idea of active users became our North Star metric, and our goal was to time and frequency of active user sessions across all of our platforms (web, mobile and TV apps). To do this, we looked into the type of content our active users were viewing. We tried to determine if this was diversified content or traffic-heavy, click-based articles. We understood that for consumers to become active users, they needed to view and interact with evergreen content or something that would inform and empower them.

We ran experiments to identify product ideas that moved the needle for active users. We were watching for steps that would increase consumption, engagement, and attention for our active users. One of the steps taken in this process was creating a tab in our app that recommended personalized content. This was an area in our app dedicated to the individual. It specialized in suggesting reading choices related to users' behaviors and media that would diversify their everyday choices. This alone increased our user engagement by 27%.

We used this success as a proof point to evangelize the measures taken with our organization. There was some doubt from executives and product leaders that active users would improve our product more than traffic volume. We began shifting the minds of our organization, and it allowed us to make significant breakthroughs for our product.

Lessons learned

  • The biggest lesson is that you can not improve a product without measurement. Creating measurements provides a metric to focus on and streamlines your organization around processes that matter. As Peter Drucker said, "If you can't measure it, you can't manage it."
  • Some people think metrics inhibit creativity and in reverse how metrics benefit creativity or intuition. As long as there are different measures and frameworks, there should be thousands of ways to drive that metric.

Discover Plato

Scale your coaching effort for your engineering and product teams
Develop yourself to become a stronger engineering / product leader


Related stories

Building and Maintaining Company Culture: How to Scale Teams Accordingly

26 May

Elwin Lau, Director of Software at Jana, advocates the importance of maintaining culture within a company when scaling teams.

Mission / Vision / Charter
Scaling Team
Building A Team
Company Culture
Collaboration
Onboarding
Sharing The Vision
Elwin Lau

Elwin Lau

Director of Software at JANA Corporation

Building and Maintaining Company Culture: How to Scale Teams Accordingly

26 May

Elwin Lau, Director of Software at Jana, advocates the importance of maintaining culture within a company when scaling teams.

Mission / Vision / Charter
Scaling Team
Building A Team
Company Culture
Collaboration
Onboarding
Sharing The Vision
Elwin Lau

Elwin Lau

Director of Software at JANA Corporation

Hiring a Data Team With a Stubborn Manager

24 May

Liz Henderson, an Executive consultant at Capgemini, shares her experience hiring a data team with a manager who was difficult to work with.

Managing Up
Building A Team
Conflict Solving
Hiring
Data Team
Liz Henderson

Liz Henderson

Executive consultant at Capgemini

Creating a Company Culture That Balances Helpfulness and Productivity

16 May

Alexis Philippe, Vice President, Product & Engineering at Amilla, describes his one simple rule for creating a culture of helpfulness that doesn't disrupt productivity.

Mission / Vision / Charter
Company Culture
Collaboration
Cross-Functional Collaboration
Alexis Philippe

Alexis Philippe

Vice President, Product & Engineering at Amilla

Streamlining Product Processes After a Reorganization

16 May

Snehal Shaha, Lead Technical Program Manager at Momentive (fka SurveyMonkey), details her short-term technical strategy to unify processes among teams following an acquisition.

Acquisition / Integration
Product Team
Product
Building A Team
Leadership
Internal Communication
Collaboration
Reorganization
Strategy
Team Processes
Cross-Functional Collaboration
Snehal Shaha

Snehal Shaha

Senior EPM/TPM at Apple Inc.

You're a great engineer.
Become a great engineering leader.

Plato (platohq.com) is the world's biggest mentorship platform for engineering managers & product managers. We've curated a community of mentors who are the tech industry's best engineering & product leaders from companies like Facebook, Lyft, Slack, Airbnb, Gusto, and more.