7 Steps Big Data Journey for Enterprises
4 likes1,795 views
The document outlines a 7-step journey for enterprises implementing big data, emphasizing the importance of understanding business needs and team adaptability. Key steps include defining objectives, building a capable team, considering cloud options, selecting appropriate technology, and conducting pilot tests. The process also highlights the significance of ongoing evaluation and integration of new technologies to drive business value.
7 Steps Big Data Journey for Enterprises
- 1. 7-Step Big Data Journey for Enterprises 1www.BigDataTrunk.com
- 2. www.BigDataTrunk.com Raju Shreewastava Engineer/Architect by Profession Teacher at Heart Artist in Soul 2 Working : Big Data Consulting and Training
- 5. www.BigDataTrunk.com 1. Ask Why? – Typical Reasons 5 C-staff Competition Big data Problem
- 7. 7
- 8. 8
- 9. www.BigDataTrunk.com Next Frontier Artificial Intelligence Internet of Things ( IOT) 9
- 10. www.BigDataTrunk.com STEP 1) Tips – Needs Commitment a) Marathon b) Business Driven c) Not Free or Cheap 10
- 12. www.BigDataTrunk.com 12 Blog Post : https://www.linkedin.com/pulse/open-source-different-beast-raju-shreewastava?trk=prof-post
- 15. 15 Vacancy -Super Hero Engineer Needed Hadoop, Hive ,Pig … Spark HBase, Cassandra, MongoDB, or other NoSQL Technology Java, Python, or Scala Kafka Apache Phoenix Cloud - AWS/Azure/Google Solr or Elastic Search
- 16. 16 Big Data Architect New Hires Engineers Existing Staff Engineers Scrum Master QA SME..
- 17. www.BigDataTrunk.com 17 STEP 2) Tips – Change is the only Constant a) Modular Design b) Learnability c) Hire Full team
- 19. 19
- 21. www.BigDataTrunk.com Public Cloud Private Cloud Hybrid 21
- 24. www.BigDataTrunk.com 24 STEP 3) Tips – Considerations to Cloud a) Industry/Compliance b) Company Strategy c) Project Needs
- 28. www.BigDataTrunk.com 4. Key Differentiators Cloudera Hortonworks MapR Amazon EMR Developing Tools • Cloudera Manager • Imapala Staying Open Source Developing Open Source tools • Ambari Proprietary route E.g. MapRFS High Avalability Cloud Offering Integration to other AWS Services 28
- 29. www.BigDataTrunk.com 29 STEP 4) Tips – Selection a) Apache Hadoop is Mother b) Align with Company Strategy Apache Hadoop
- 30. www.BigDataTrunk.com 30 STEP 5. Take Test Drive (Pilot , not just POC)
- 31. www.BigDataTrunk.com POC Vs Pilot POC Pilot • Will this technology meet our needs? • Will this product perform as advertised? • Will the prospective end user communities be productive with the new way of doing things? • Will the ultimate solution be feasible? • Detailed Architectural Design based on an assessment of business and technical requirements • Environment build and configuration • Infrastructure testing to validate failover, high availability, and possibly scalability • User testing and iterative feedback to optimize the user experience • Documentation or training for pilot users and the help desk 31
- 32. www.BigDataTrunk.com 32 STEP 5) Tips – Take the plunge a) First Use Case b) Trial and Error
- 34. www.BigDataTrunk.com Big data is here to Stay Focus on Business Value Don’t underestimate Data Integration Hiring is a Big Challenge Be ready to Re-invent yourself 34
- 35. www.BigDataTrunk.com 35 STEP 6) Tips – Adaptation a) R&D – New technology b) 6 months review
- 36. www.BigDataTrunk.com 36 Taking to the Enterprise Level
- 37. www.BigDataTrunk.com 7. Taking to the Enterprise (Tips) Governance Monitoring Usage Analysis Automation Enterprise Scale 37
- 38. www.BigDataTrunk.com 1. Ask Why? 2. Build Team 3. To cloud or Not? 4. Pick your distribution 5. Perform a pilot 6. Fail , Learn and Improve 7. Take it to the Enterprise 38
Editor's Notes
- #4: Slideshare, 7 steps , Break Myths , Tips Sharing