AWS Summit Singapore 2019 | Driving Business Outcomes with Data Lake on AWS
0 likes445 views
The document discusses how companies can drive business outcomes through building a data lake on AWS. It provides examples of how media and banking companies have used data lakes on AWS to improve customer experiences, gain operational efficiencies, and derive business value. The speaker then discusses HDFC Life's data journey and architecture, and provides an overview of BlazeClan Technologies, the consulting company he represents.
AWS Summit Singapore 2019 | Driving Business Outcomes with Data Lake on AWS
- 1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Driving Business Outcomes with Data Lake on AWS Varoon Rajani Co-founder & CEO BlazeClan Technologies
- 2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T About The Speaker 3
- 3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T 3 How can you drive Business Outcomes with Data Lake on AWS ? Strategic Decision making Improve R&D Innovation Choices Optimize Revenue Streams Improved Customer Interactions Increase Operational Efficiencies
- 4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T 36% Big data adoption in enterprises soared from 17% in 2015 to 59% in 2018, reaching a Compound Annual Growth Rate (CAGR) of 36%. 49% of the world’s stored data will reside in public cloud environments by 2025 4 175 ZB Global Datasphere will grow from 33 Zettabytes in 2018 to 175 Zettabytes by 2025 75% Consumers’ interaction with data will increase from 5 billion currently to 6 billion - 75% of the world's population $27 Billion Revenues for big data and business analytics solutions to hit $27 billion in APAC by 2022 Asia Pacific Is expected to achieve the highest growth rate due to the significant increase in adoption of data analytics Oh, the Growing Data!
- 5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T • Design Thinking • UI/UX • Microservices • Containerization • High performance • High availability and scalability Our Viewpoint of ‘Cloud Enabled Transformation’ Customer Experience Applications Cloud Infrastructure Data Lake Agile / SAFe DevOps Automation Analytics Machine Learning Artificial Intelligence 5
- 6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Importance of Data Journey Operations Customers Infrastructure Risk & Fraud Product • User enrichment & segmentation • House-holding • Customer 360o • Sentiment analysis • Omni-channel experience • Loyalty program analysis • Recommendation engine • Personalized marketing • Gamification • Targeted marketing • Sales reporting • Inventory management & forecasting • SLA analytics • Store performance • Asset performance analytics • Network analytics • Log analytics • Predictive issue resolution • Governance reporting • Fraud detection • Risk modelling • Cyber security • Market analysis • Product tracking & analysis • Marketing and branding strategy • Sentiment analysis • Transaction analysis Industries 6
- 7. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Media Data Journey 8 Mobile Shared On Social Media Next Day Recommendation / Up Selling Jack Order Coffee Cross Sector Selling Omni-Channel Experience Today Unique User view Data Enrichment Segmentation House-Holding
- 9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Media Use Case 9 • User Data • Session Time • Demographics • Genre • Language • Schedule • Playlist • Account Type • Page Views • Devices • And many more About Client Leading media company in Malaysia Use Case: Utilize user, video assets and consumption data for ACTIONABLE INSIGHTS Solution: Data Lake at rescue! Identify and analyse anomalies for various consumption patterns Informed marketing efforts to targeted users for effective results Business Value Derived • Probable Fraud Detection • Marketing Optimization
- 10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Banking Data Journey After Before • Poor reports for Incident & Asset management • Application not working • System is down • Updated health status of infrastructure & assets • Interactive Reports • Analysis and quick resolution for incidents • Predictive analysis for blocking IP address having virus • Optimized utilization of servers as per usability
- 11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Banking Use Case 11 • Number of systems • Infrastructure details • Asset life cycle • Patching status • Incidents per system • Incident resolution time • Security vulnerabilities • Disaster recovery status • And many more About Client Use Case: Solution: Interactive report Visualization for different business users to view details of assets & incidents Predictive analysis to predict health of systems in next few years Business Value Derived • Operational Efficiency • Resource Optimization
- 12. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Abey Alex
- 13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T About HDFC Life Source – HDFC Life Annual Report 2017- 2018 11,200+ Partner Branches 17,600+ Employees 1.05mn Policies sold (Individual new business) 1,066 Billion of AUM HDFC Standard Life Insurance Company Limited (‘HDFC Life’ / ‘Company’) is a leading long-term life insurance solutions provider, offering a range of individual and group insurance solutions that meet various customer needs such as Protection, Pension, Savings, Investment, and Health. HDFC Life is a joint venture between Housing Development Finance Corporation Limited (HDFC Ltd.), India’s leading housing finance institution and Standard Life Aberdeen, a global investment company. 13
- 14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Ongoing Initiatives at HDFC Life 14 3 Explore Re-imagination Bring in new cutting edge technologies Digital Transformation Journey 1 2 3 Build to Destroy Innovate & Evolve faster, constantly Platform based Approach Cloud centric Server-less Lean Approach License-free Open-source Enhance Process optimization Upgrade existing process & technologies 1 2 Expand Collaborative Business partnerships Follow an Ecosystem Centric approach
- 15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T ? Business Outcomes From Data Lake Sales Head 15
- 16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Budge t Sales Targe t Task List DISCOVERY & FOUNDATION DESIGN BUILD & IMPLEMENT VALIDATION & VALUE USE CASE INSIGHTS Insuranc e Product • Sales Agent Data • Insurance Product • Budget • Task List • Performance • ---- • PERFORMANCE • SALES • FORECAST • TRACKING • … 16 Approach to Outcome
- 17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Data Journey - Persona Productivity 1.Personalized Sales Experience 2. Improve behavior 3. Improve business metrics • • • • 17
- 18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Derived Business Value 18 Accelerated business growth Winning sales insights Increased sales performance Real-time Data Insights Motivated sales people
- 19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T HDFC Life – Architecture
- 20. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T How? What? PROCESS Visually managed process to cleanse and enrich the data using the available function libraries Hadoop, SPARK and Phyton reusable code to perfom functions CONSUMPTION Transparency and secured insight for decision making using the preferred customer visualization Adoption of customer preferred toolset to build reports INGESTION Ability to Ingest multiple data sources using connectors and adaptors with Automation Serverless Approach DynamoDB with Lambda automation Proven Methodology Templates for Landing Zone Continuous Improvement Automation with Lambda Security & Compliance Data Governance Accelerate with Assurance 21 Our Solution Framework
- 22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Data Lake Implementation Framework Operating Model Analyse & plan Data Lake Setup Design & Architecture Current State Target State Ingestion Layer Agile Build & Validate Initialisation Analytics & Visualisation Acceptance Integration & De-commission Learn & Optimize ValidateInputs Mapping Security Licences & Tools Data ConsumptionData Storage and ProcessData Ingestion Discovery & Foundation Build and Implement Managed Services Data Governance Governance Platform Re-usable Component Store IaaS Factory PaaS Factory Data Migration Factory 1. Source Assessment 2. Mappings & Transformations 3. ETL Build and Test 4. Sprint Review 5. Validation pm am am 24*7 Help Desk. AU India Support On-call Support Support from Off-shore(India) and Onsite pm ETL Storage Analytics Batch, Change Data, Streaming ETL Factory Analytics Factory EMR, DMS, Kinesis S3, RDS, RedShift QuickSight , Tableau ValidationDesign MY India Support On Call Support 22 Our Implementation Framework Metadata Management Data Quality
- 23. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Revenue Growth at 80% CAGR Focus on Innovation 350+ Cloud Experts; 120 Certified End to End Cloud competencies Differentiated, Proprietary Frameworks Vast Experience, Across domains/industries 200+ Customers Engagements Culturally Aligned- One team 24 Company Overview
- 25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T 25 Competencies
- 26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T 26 Featured Clients & more..
- 27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Thank you! S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Varoon Rajani varoon@blazeclan.com