SlideShare a Scribd company logo
How to identify key opportunities to
grow using product metrics pyramid:
f2p guide
Oleg Lapin
Head of Analytics, AppQuantum
SPEAKER
Oleg Lapin
analyst, team lead, father
PROF EXP
- more than 10 years in analytics
- building analytical department in AppQuantum
- built Product Analytics in Nexters
- before it, participated in Avito’s success
- before it worked in FMCG, science and consulting
team AppQuantum
WHO WE ARE
A free-to-play mobile game publisher
based in Moscow, Russia
WHAT WE DO
We assist developers with many
aspects of their apps, helping them
stay focused on making games and
delivering high quality content to users
Metrics pyramid
What is it “metrics pyramid”
● it is framework of using metrics
● my favourite author is Elena Seregina /
DataLatte “Иерархия метрик vs
пирамида метрик”
● an older article from Google “How to
choose the right UX metrics for your
product”
● or you could just Google))
* Cool viz from the Elena’s article mentioned
Simple metrics hierarchy
* ROI - return of investment, LTV - lifetime value, ARPU - average revenue per user, ARPPU - average revenue
per paying users, AOV - average order value, OPP - orders per payer, rv_per_user - rewarded videos per user
ROI = LTV / CPI
LTV = ARPU_inapp + ARPU_AdsMon
ARPU_inapp = ARPPU * %payers
ARPPU = AOV * OPP
ARPU_AdsMon = rv_per_user * ecpm
LTV
ROI
CPI
CPM CTR
ARPU_inapp ARPU_AdsMon
ARPPU %payers rv_per_user ecpm
ROI = LTV / CPI
LTV = ARPU_inapp + ARPU_AdsMon
ARPU_inapp = ARPPU * %payers
ARPPU = AOV * OPP
ARPU_AdsMon = rv_per_user * ecpm
Simple metrics hierarchy
* ROI - return of investment, LTV - lifetime value, ARPU - average revenue per user, ARPPU - average revenue
per paying users, AOV - average order value, OPP - orders per payer, rv_per_user - rewarded videos per user
LTV
ROI
CPI
CPM CTR
ARPU_inapp ARPU_adsmon
ARPPU %payers %payers ecpm
SO
WHAT???
We need to learn how
to use this tool!
First Story
Version N1 - classic
Event analysis / liveops:
- launch event
- LVL_1 uplift Revenue, ARPDAU
- LVL_2 - ARPDAU by cohorts
- LVL_3 - ARPDAU, currency balance,
AOV, %PU, %new payers, bundles,
completion funnels
- LVL_4 - LVL_3 + planning what
metric should we uplift, estimate
were we true
- LVL_5 - your variant))
* You could have an operational dashboard for this
purpose with all metrics calculated
We already have some metrics pyramide!
Your KPI
Revenue, ARPU, ARPPU, …
Spending Structure, баланс харды,
payers_ret
Bundle conversion
What for is metrics pyramid
● searching for right reasons
● analyzing small changes
● differentiating effects
Do you need smth
more interesting?
OK, let’s do it for the
whole project!)
Second Story
ARPU curve. Is it ok?
here we see that lifetime is more than 30 days
(users are still paying) and LTV is more than
$1,4 and in-app share is around 60%
- is this LTV is OK for this market /
optimization / genre?
- is this lifetime is OK for this genre?
- is this ARPU_inapp is OK for this type of
game?
- do we have a problem in early/mid/end
game in ARPU dynamics?
* just for an example
** some project, some cohort, some geography
*** lifetime 0, 1, 3, 14, 30,...
Retention by LT
here we see that Retention at first day is 28%
and retention_30 is 6%.
- is it OK?
- do we have any gaps at tutor / early
game?
- why relative retention (2nd graph) stop
increasing after 2 weeks? do we have any
lack of gameplay after 2 weeks?
* just for an example
ARPDAU by LT. Are they still paying in midgame?
here we see that ARPDAU is around $0.4 and
falling over time! (both in-app and ads, very
bad).
- why it’s falling?
- let’s decompose, is it falling because of
%payers or payers_churn or AOV?
- do we have any economic restrictions?
probably we don’t have enough content or
enough offers
* just for an example
** some project, some cohort, some geography
** lifetime 0, 1, 3, 14, 30,...
Daily payers by LT. Are they stop spending in game?
here we see that daily payers is around 5%
(seems it is purchase optimization traffic) but
falling over time!
- is there any problem with a first payment?
- do we have enough content in game to
spend much?
- do we have enough offers?
- do payers get an advantage in game, do
we have any VIP_lvl system??
- yeap, all questions are the same as for
ARPDAU in this game
* just for an example
** some project, some cohort, some geography
** lifetime 0, 1, 3, 14, 30,...
ARPPDAU by LT. Do they pay a lot?
here we see that is around $4
- is this ARPPDAU OK for this country /
optimization?
- why it’s not increases over time but
instead starting to decrease at second
week?
- do we have enough whales content? * just for an example
** some project, some cohort, some geography
** lifetime 0, 1, 3, 14, 30,...
Example of summary table
● We could summary all metrics in one table
and use weekly lifetime instead of daily
● it’s more useful when you do overall
conclusions
* just for an example
** some project, some cohort, some geography
** lifetime 1-2-3-4 weeks after registration
And then we go deeper and deeper
● Also we analyze time spending
● then we go deeper to economics, offers,
social interactions and so on
● At the end we’re trying to sum up all
problems we found and identify key
opportunities to grow (is it about mechanics
or economics or offers or smth else)
* the example of our report, the main part is
conclusions for sure))
FINAL Story
The main idea of this
presentation is not about
metrics itself
Expectations
● each feature should has its own expectations of outcomes in terms of metrics
and user segment
● yeap, we need data to calculate all metrics
● yes, we need some BI system to have useful dashboard
● for sure we need some work space to store all our expectations
● and finally we need some kind of analytical culture in company
Prioritization
we have a few instruments:
- our game design thinking or user voice ("it's good to have this feature/content
here")
- previous experience (smth like "this type of content is always increase this
metric)
- analysis of user behaviour / metrics that I described in presentation. So here
we could understand that based on metrics we see a growth opportunity in the
certain user segment
- the best thing when your team could use all these methods at once!
linkedin: https://www.linkedin.com/in/oleg-lapin-521891b5
tg me: Oleg_the_analyst
ping us at: hi@appquantum.com
Thanks!

More Related Content

PDF
10 ошибок в работе с аналитикой / Вера Карпова (devtodev)
PDF
Product analytics evolution: analytics approaches on different stages of the ...
PPT
Product manager and game analytics
PPT
Sergei Romanenko, PlayFlock
PPTX
How we make money?
PPTX
The Biggest Mistake You Can Make In Analytics of Game
PPTX
Quick Introduction to F2P Mobile Game Analytics
PDF
Mobile Product Analytics
10 ошибок в работе с аналитикой / Вера Карпова (devtodev)
Product analytics evolution: analytics approaches on different stages of the ...
Product manager and game analytics
Sergei Romanenko, PlayFlock
How we make money?
The Biggest Mistake You Can Make In Analytics of Game
Quick Introduction to F2P Mobile Game Analytics
Mobile Product Analytics

Similar to How to identify key opportunities to grow using product metrics pyramid: f2p guide / Oleg Lapin (AppQuantum) (20)

PPTX
Where is the money, Lebowski? How to identify and solve the problem in game ...
PDF
Using Data Science to grow games / Robert Magyar (SuperScale)
PDF
Taking Virtual Economies to the Next Level
PDF
Vasiliy Sabirov, devtodev
PPTX
Inner Workings of Virtual Goods Economies
PPTX
Big Data in Mobile Gaming - Eric Seufert presentation from IGExpo Feb 1 2013
PDF
Data Gone Wrong - GDCNext 2013
PPTX
How to Monetize your F2P Video Game
PPTX
Massively multiplayer data challenges in mobile game analytics
PPTX
Massively multiplayer data challenges in mobile game analytics
PPTX
The Developer Tour - Ho Chi Minh City
PPTX
What the best games know that the rest don't - Isaac Roseboom, deltaDNA
PPTX
GDC 2017 - What the best games know that the rest don’t
PPTX
UK GIAF: Winter 2015
PDF
App Marketing Tips Playbook
PDF
Whitepaper - App Metrics
PDF
Top Mobile App Monetization Tactics You Ought to Know
KEY
Would You Like Some Data With Your Coffee? aka The Key Analytics You Should S...
PPTX
Approaches to Modeling the Revenue Side of F2P Games | Maciej Mroz
PDF
Casual connect 2015 summary
Where is the money, Lebowski? How to identify and solve the problem in game ...
Using Data Science to grow games / Robert Magyar (SuperScale)
Taking Virtual Economies to the Next Level
Vasiliy Sabirov, devtodev
Inner Workings of Virtual Goods Economies
Big Data in Mobile Gaming - Eric Seufert presentation from IGExpo Feb 1 2013
Data Gone Wrong - GDCNext 2013
How to Monetize your F2P Video Game
Massively multiplayer data challenges in mobile game analytics
Massively multiplayer data challenges in mobile game analytics
The Developer Tour - Ho Chi Minh City
What the best games know that the rest don't - Isaac Roseboom, deltaDNA
GDC 2017 - What the best games know that the rest don’t
UK GIAF: Winter 2015
App Marketing Tips Playbook
Whitepaper - App Metrics
Top Mobile App Monetization Tactics You Ought to Know
Would You Like Some Data With Your Coffee? aka The Key Analytics You Should S...
Approaches to Modeling the Revenue Side of F2P Games | Maciej Mroz
Casual connect 2015 summary
Ad

More from DevGAMM Conference (20)

PPTX
The art of small steps, or how to make sound for games in conditions of war /...
PPTX
Breaking up with FMOD - Why we ended things and embraced Metasounds / Daniel ...
PPTX
How Audio Objects Improve Spatial Accuracy / Mads Maretty Sønderup (Audiokine...
PPTX
Why indie developers should consider hyper-casual right now / Igor Gurenyov (...
PPTX
AI / ML for Indies / Tyler Coleman (Retora Games)
PDF
Agility is the Key: Power Up Your GameDev Project Management with Agile Pract...
PPTX
New PR Tech and AI Tools for 2023: A Game Changer for Outreach / Kirill Perev...
PDF
Playable Ads - Revolutionizing mobile games advertising / Jakub Kukuryk (Popc...
PDF
Creative Collaboration: Managing an Art Team / Nastassia Radzivonava (Glera G...
PDF
From Local to Global: Unleashing the Power of Payments / Jan Kuhlmannn (Xsolla)
PDF
Strategies and case studies to grow LTV in 2023 / Julia Iljuk (Balancy)
PDF
Why is ASO not working in 2023 and how to change it? / Olena Vedmedenko (Keya...
PDF
How to increase wishlists & game sales from China? Growth marketing tactics &...
PDF
Turkish Gaming Industry and HR Insights / Mustafa Mert EFE (Zindhu)
PDF
Building an Awesome Creative Team from Scratch, Capable of Scaling Up / Sasha...
PPTX
Seven Reasons Why Your LiveOps Is Not Performing / Alexander Devyaterikov (Be...
PDF
The Power of Game and Music Collaborations: Reaching and Engaging the Masses ...
PPTX
Branded Content: How to overcome players' immunity to advertising / Alex Brod...
PPTX
Resurrecting Chasm: The Rift - A Source-less Remastering Journey / Gennadii P...
PPTX
How NOT to do showcase events: Behind the scenes of Midnight Show / Andrew Ko...
The art of small steps, or how to make sound for games in conditions of war /...
Breaking up with FMOD - Why we ended things and embraced Metasounds / Daniel ...
How Audio Objects Improve Spatial Accuracy / Mads Maretty Sønderup (Audiokine...
Why indie developers should consider hyper-casual right now / Igor Gurenyov (...
AI / ML for Indies / Tyler Coleman (Retora Games)
Agility is the Key: Power Up Your GameDev Project Management with Agile Pract...
New PR Tech and AI Tools for 2023: A Game Changer for Outreach / Kirill Perev...
Playable Ads - Revolutionizing mobile games advertising / Jakub Kukuryk (Popc...
Creative Collaboration: Managing an Art Team / Nastassia Radzivonava (Glera G...
From Local to Global: Unleashing the Power of Payments / Jan Kuhlmannn (Xsolla)
Strategies and case studies to grow LTV in 2023 / Julia Iljuk (Balancy)
Why is ASO not working in 2023 and how to change it? / Olena Vedmedenko (Keya...
How to increase wishlists & game sales from China? Growth marketing tactics &...
Turkish Gaming Industry and HR Insights / Mustafa Mert EFE (Zindhu)
Building an Awesome Creative Team from Scratch, Capable of Scaling Up / Sasha...
Seven Reasons Why Your LiveOps Is Not Performing / Alexander Devyaterikov (Be...
The Power of Game and Music Collaborations: Reaching and Engaging the Masses ...
Branded Content: How to overcome players' immunity to advertising / Alex Brod...
Resurrecting Chasm: The Rift - A Source-less Remastering Journey / Gennadii P...
How NOT to do showcase events: Behind the scenes of Midnight Show / Andrew Ko...
Ad

Recently uploaded (20)

PPTX
modul_python (1).pptx for professional and student
PDF
Data Engineering Interview Questions & Answers Batch Processing (Spark, Hadoo...
PPTX
CYBER SECURITY the Next Warefare Tactics
PPTX
New ISO 27001_2022 standard and the changes
PDF
Votre score augmente si vous choisissez une catégorie et que vous rédigez une...
PDF
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
DOCX
Factor Analysis Word Document Presentation
PPTX
sac 451hinhgsgshssjsjsjheegdggeegegdggddgeg.pptx
PDF
Transcultural that can help you someday.
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPT
ISS -ESG Data flows What is ESG and HowHow
PDF
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
PDF
annual-report-2024-2025 original latest.
PDF
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf
PPT
Predictive modeling basics in data cleaning process
PPTX
(Ali Hamza) Roll No: (F24-BSCS-1103).pptx
PPTX
importance of Data-Visualization-in-Data-Science. for mba studnts
PDF
Introduction to the R Programming Language
PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PPTX
Market Analysis -202507- Wind-Solar+Hybrid+Street+Lights+for+the+North+Amer...
modul_python (1).pptx for professional and student
Data Engineering Interview Questions & Answers Batch Processing (Spark, Hadoo...
CYBER SECURITY the Next Warefare Tactics
New ISO 27001_2022 standard and the changes
Votre score augmente si vous choisissez une catégorie et que vous rédigez une...
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
Factor Analysis Word Document Presentation
sac 451hinhgsgshssjsjsjheegdggeegegdggddgeg.pptx
Transcultural that can help you someday.
IBA_Chapter_11_Slides_Final_Accessible.pptx
ISS -ESG Data flows What is ESG and HowHow
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
annual-report-2024-2025 original latest.
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf
Predictive modeling basics in data cleaning process
(Ali Hamza) Roll No: (F24-BSCS-1103).pptx
importance of Data-Visualization-in-Data-Science. for mba studnts
Introduction to the R Programming Language
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
Market Analysis -202507- Wind-Solar+Hybrid+Street+Lights+for+the+North+Amer...

How to identify key opportunities to grow using product metrics pyramid: f2p guide / Oleg Lapin (AppQuantum)

  • 1. How to identify key opportunities to grow using product metrics pyramid: f2p guide Oleg Lapin Head of Analytics, AppQuantum
  • 2. SPEAKER Oleg Lapin analyst, team lead, father PROF EXP - more than 10 years in analytics - building analytical department in AppQuantum - built Product Analytics in Nexters - before it, participated in Avito’s success - before it worked in FMCG, science and consulting
  • 3. team AppQuantum WHO WE ARE A free-to-play mobile game publisher based in Moscow, Russia WHAT WE DO We assist developers with many aspects of their apps, helping them stay focused on making games and delivering high quality content to users
  • 5. What is it “metrics pyramid” ● it is framework of using metrics ● my favourite author is Elena Seregina / DataLatte “Иерархия метрик vs пирамида метрик” ● an older article from Google “How to choose the right UX metrics for your product” ● or you could just Google)) * Cool viz from the Elena’s article mentioned
  • 6. Simple metrics hierarchy * ROI - return of investment, LTV - lifetime value, ARPU - average revenue per user, ARPPU - average revenue per paying users, AOV - average order value, OPP - orders per payer, rv_per_user - rewarded videos per user ROI = LTV / CPI LTV = ARPU_inapp + ARPU_AdsMon ARPU_inapp = ARPPU * %payers ARPPU = AOV * OPP ARPU_AdsMon = rv_per_user * ecpm LTV ROI CPI CPM CTR ARPU_inapp ARPU_AdsMon ARPPU %payers rv_per_user ecpm
  • 7. ROI = LTV / CPI LTV = ARPU_inapp + ARPU_AdsMon ARPU_inapp = ARPPU * %payers ARPPU = AOV * OPP ARPU_AdsMon = rv_per_user * ecpm Simple metrics hierarchy * ROI - return of investment, LTV - lifetime value, ARPU - average revenue per user, ARPPU - average revenue per paying users, AOV - average order value, OPP - orders per payer, rv_per_user - rewarded videos per user LTV ROI CPI CPM CTR ARPU_inapp ARPU_adsmon ARPPU %payers %payers ecpm SO WHAT???
  • 8. We need to learn how to use this tool!
  • 10. Version N1 - classic Event analysis / liveops: - launch event - LVL_1 uplift Revenue, ARPDAU - LVL_2 - ARPDAU by cohorts - LVL_3 - ARPDAU, currency balance, AOV, %PU, %new payers, bundles, completion funnels - LVL_4 - LVL_3 + planning what metric should we uplift, estimate were we true - LVL_5 - your variant)) * You could have an operational dashboard for this purpose with all metrics calculated
  • 11. We already have some metrics pyramide! Your KPI Revenue, ARPU, ARPPU, … Spending Structure, баланс харды, payers_ret Bundle conversion
  • 12. What for is metrics pyramid ● searching for right reasons ● analyzing small changes ● differentiating effects
  • 13. Do you need smth more interesting?
  • 14. OK, let’s do it for the whole project!)
  • 16. ARPU curve. Is it ok? here we see that lifetime is more than 30 days (users are still paying) and LTV is more than $1,4 and in-app share is around 60% - is this LTV is OK for this market / optimization / genre? - is this lifetime is OK for this genre? - is this ARPU_inapp is OK for this type of game? - do we have a problem in early/mid/end game in ARPU dynamics? * just for an example ** some project, some cohort, some geography *** lifetime 0, 1, 3, 14, 30,...
  • 17. Retention by LT here we see that Retention at first day is 28% and retention_30 is 6%. - is it OK? - do we have any gaps at tutor / early game? - why relative retention (2nd graph) stop increasing after 2 weeks? do we have any lack of gameplay after 2 weeks? * just for an example
  • 18. ARPDAU by LT. Are they still paying in midgame? here we see that ARPDAU is around $0.4 and falling over time! (both in-app and ads, very bad). - why it’s falling? - let’s decompose, is it falling because of %payers or payers_churn or AOV? - do we have any economic restrictions? probably we don’t have enough content or enough offers * just for an example ** some project, some cohort, some geography ** lifetime 0, 1, 3, 14, 30,...
  • 19. Daily payers by LT. Are they stop spending in game? here we see that daily payers is around 5% (seems it is purchase optimization traffic) but falling over time! - is there any problem with a first payment? - do we have enough content in game to spend much? - do we have enough offers? - do payers get an advantage in game, do we have any VIP_lvl system?? - yeap, all questions are the same as for ARPDAU in this game * just for an example ** some project, some cohort, some geography ** lifetime 0, 1, 3, 14, 30,...
  • 20. ARPPDAU by LT. Do they pay a lot? here we see that is around $4 - is this ARPPDAU OK for this country / optimization? - why it’s not increases over time but instead starting to decrease at second week? - do we have enough whales content? * just for an example ** some project, some cohort, some geography ** lifetime 0, 1, 3, 14, 30,...
  • 21. Example of summary table ● We could summary all metrics in one table and use weekly lifetime instead of daily ● it’s more useful when you do overall conclusions * just for an example ** some project, some cohort, some geography ** lifetime 1-2-3-4 weeks after registration
  • 22. And then we go deeper and deeper ● Also we analyze time spending ● then we go deeper to economics, offers, social interactions and so on ● At the end we’re trying to sum up all problems we found and identify key opportunities to grow (is it about mechanics or economics or offers or smth else) * the example of our report, the main part is conclusions for sure))
  • 24. The main idea of this presentation is not about metrics itself
  • 25. Expectations ● each feature should has its own expectations of outcomes in terms of metrics and user segment ● yeap, we need data to calculate all metrics ● yes, we need some BI system to have useful dashboard ● for sure we need some work space to store all our expectations ● and finally we need some kind of analytical culture in company
  • 26. Prioritization we have a few instruments: - our game design thinking or user voice ("it's good to have this feature/content here") - previous experience (smth like "this type of content is always increase this metric) - analysis of user behaviour / metrics that I described in presentation. So here we could understand that based on metrics we see a growth opportunity in the certain user segment - the best thing when your team could use all these methods at once!
  • 27. linkedin: https://www.linkedin.com/in/oleg-lapin-521891b5 tg me: Oleg_the_analyst ping us at: hi@appquantum.com Thanks!