Data Driven Decisions at Scale
1 like355 views
The document outlines a decade-long journey focused on making data-driven decisions essential for creating excellent customer experiences while ensuring compliance with privacy laws. It identifies two major challenges: processing data at massive scale and fostering agile decision-making through democratized analytics. The document emphasizes the importance of leveraging data lakes, data engineering, and analytics to enhance customer value and drive innovation.
Data Driven Decisions at Scale
- 1. DATA DRIVEN DECISIONS AT SCALE Jim Forsythe
- 2. 2 OUR JOURNEY OVER THE LAST 10 YEARS 2009 2014 Today
- 3. DATA IS ESSENTIAL TO CREATING SIMPLE, EASY, AWESOME CUSTOMER EXPERIENCES We collect, store, and use all data in accordance with our privacy disclosures to users and applicable laws.
- 4. MAKING DATA DRIVEN DECISIONS AT SCALE IS CRITICAL We collect, store, and use all data in accordance with our privacy disclosures to users and applicable laws.
- 5. 2 MAJOR CHALLENGES: DATA PROCESSING AT SCALE + MAKING DATA ACTIONABLE We collect, store, and use all data in accordance with our privacy disclosures to users and applicable laws.
- 6. 6 CHALLENGE #1 NEED TO PROCESS DATA AT MASSIVE SCALE We collect, store, and use all data in accordance with our privacy disclosures to users and applicable laws. Raw Event Data Event Processing Data Lake Millions of Transactions per Second Hundreds of Jobs Processing TBs of data PBs of Data across hundreds of buckets
- 7. 7 SOURCE SYSTEMS PRODUCTS & SYSTEMS X1 & Flex Mobile & Web XFI Services
- 8. 8 EVENT COLLECTORS Streamin g Batch DATA COLLECTORS PRODUCTS & SYSTEMS X1 & Flex Mobile & Web XFI Services
- 9. 9 BUILD RICH DATA SETS Streaming Batch DATA COLLECTION PRODUCTS & SYSTEMS PROCESSING & ENRICHMENT X1 & Flex Mobile & Web XFI Services
- 10. 1 0 FOUNDATION OF DATA PLATFORM Streamin g Batch DATA COLLECTION PRODUCTS & SYSTEMS PROCESSING & ENRICHMENT DATA LAKE PARQUET X1 & Flex Mobile & Web XFI Services
- 11. 1 1 DELTA SESSIONIZATION Job 1 IngestData Optimize Streaming Join Optimize Job 2 Sessionize OptimizeJob 3 Enrich & Optimize Batch Join
- 12. 1 2 DATA LAKE IS THE FOUNDATION DATA LAKE PRODUCT S/ SERVICES DATA PLATFORM DATA ENGINEERING CUSTOMER
- 13. 1 3 CHALLENGE #2 GETTING TO AGILE DATA DRIVEN DECISIONS DATA LAKE DATA ENGINEERING PRODUCT S/ SERVICES DATA PLATFORM ANALYTICS DATA SCIENCE AB TESTING CUSTOMER
- 14. 1 4 DEMOCRATIZE ANALYTICS Analytics Enable Self Service Analytics/ Insights Requesting Reports Traditional Model Analytics/ Insights Requesting New Data Democratized Model
- 15. 1 5 SOLVING SOME OF OUR TOUGHEST PROBLEMS Data Science Focus on Customer Experience CUSTOMER PROBLEMS DATA LAKE DATA SCIENCE
- 16. 1 6 MOVE FAST & LEARN AB Testing Focus on what we launch, not what we build TREATMENTCONTROL USERS RESULTS EXP PLATFORM EVALUATION ON COMMON DATA 50% USERS 50% USERS
- 17. 1 7 INCREASE CUSTOMER VALUE PRODUCT S/ SERVICES MEASURE OUTCOMES MEASURE OUTCOMES DATA LAKE DATA ENGINEERING ANALYTICS DATA SCIENCE AB TESTING DATA PLATFORM VALUE CUSTOMER
- 18. 1 8 FROM DATA TO INSIGHTS AND ACTIONS Data to improve the product (A/B Testing) DATA SCIENCE & ENGINEERING Data Informed Big Bets PRODUCT ORGANIZATION Data for training decision models APPLIED AI
- 19. UNLEASH INNOVATION WITH DATA We collect, store, and use all data in accordance with our privacy disclosures to users and applicable laws.
- 20. Thank you!