Lowering the entry point to getting going with Hadoop and obtaining business value
4 likes1,073 views
SAS is a leader in advanced analytics with over 40 years of experience. They provide tools to manage, explore, develop models, and deploy analytics from, with, and within Hadoop. This allows customers to realize value from Hadoop throughout the entire analytics lifecycle. SAS helps address challenges like Hadoop skills shortages and tools not being optimized for big data. They demonstrated identifying reasons for abandoned shopping carts using Hadoop and SAS analytics tools.
Lowering the entry point to getting going with Hadoop and obtaining business value
- 1. Copyright © 2015, SAS Institute Inc. All rights reserv ed. LOWERING THE ENTRY POINT TO GETTING GOING WITH HADOOP AND OBTAINING BUSINESS VALUE
- 2. Copyright © 2015, SAS Institute Inc. All rights reserv ed. SAS & HADOOP WHO IS SAS? • Almost 4 decades of Advanced Analytics & DM expertise. • Validated by Gartner and Forrester Analysts as Leaders in Advanced Analytics, BI and DM. • Leader in *17* Gartner’s Magic Quadrants from Data Management, BI to Advanced Analytics. • 400 offices, 70,000+ customers, 135 countries with largest ecosystem of users and partners. • 38% of Advanced Analytics Market Share (per IDC). • 25% reinvested into R&D.
- 3. Copyright © 2015, SAS Institute Inc. All rights reserv ed. GARTNER: MAGIC QUADRANT FOR ADVANCED ANALYTIC PLATFORMS This graphic was published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from SAS. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. Gartner Magic Quadrant for Advanced Analytics Platforms by Gareth Herschel, Alexander Linden, Lisa Kart, 19 February 2015. Gartner defines advanced analytics as, "the analysis of all kinds of data using sophisticated quantitative methods (for example, statistics, descriptive and predictive data mining, simulation and optimization) to produce insights that traditional approaches to business intelligence (BI) — such as query and reporting — are unlikely to discover."
- 4. Copyright © 2015, SAS Institute Inc. All rights reserv ed. SAS & INTEL STUDY HADOOP ADOPTION & CHALLENGES Research summary: SAS and Intel asked more than 300 IT-managers from the largest companies in Denmark, Finland, Norway and Sweden about the adoption of Big Data analytics and Hadoop. http://nordichadoopsurvey.com 60% - cited advanced analytics, data discovery, or as an analytical lab 22% - would like to speed up processing Primary reason for considering Hadoop Adoption / Obstacles 35% - cited “Resources and Competencies” Results & Key Findings
- 5. Copyright © 2015, SAS Institute Inc. All rights reserv ed. CHALLENGE HADOOP SKILLS SHORTAGE Performing even the simplest tasks in Hadoop typically requires mastering disparate tools and writing hundreds of lines of code. Fact: There are a limited # of users with the necessary Hadoop skills • MapReduce • Pig Latin • HiveQL • HDFS • Sqoop and Oozie
- 6. Copyright © 2015, SAS Institute Inc. All rights reserv ed. CHALLENGE USER TOOLS ARE NOT BIG DATA ENABLED Big data brings new requirements: • Access to HDFS • Parallel Loads • New Native file types • Knowledge of file structures • New languages & code • Need to transform data In-cluster User tools are not engineered to process data inside Hadoop. • Tools are not optimized for Hadoop • Users move data out of Hadoop to do data management and data quality • This requires more processing time • Data is duplicated and more storage is required • Users do not use the Hadoop platform as it was designed
- 7. Copyright © 2015, SAS Institute Inc. All rights reserv ed. BIG DATA MANAGEMENT ANALYSTS TAKE Recommendation “Use self-service interactive data preparation tools to enhance analyst productivity.” and “improve the quality of data” – Gartner, “Data Preparation Is Not an Afterthought”
- 8. Copyright © 2015, SAS Institute Inc. All rights reserv ed. SAS & HADOOP HOW? SAS & Hadoop intersect in many ways: SAS can treat Hadoop just as any other data source, pulling data FROM Hadoop, when it is most convenient; SAS can work WITH Hadoop, lifting data in a purpose-built advanced analytics in-memory environment; SAS can work directly IN Hadoop, leveraging the distributed processing capabilities of Hadoop.
- 9. Copyright © 2015, SAS Institute Inc. All rights reserv ed. SAS & HADOOP THE PRAGMATIC APPROACH Prepare data IN Hadoop for analytics Move data FROM Hadoop into a SAS environment Deploy and manage model score code IN Hadoop Lift data IN to memory for analytics Model data in-memory WITH advanced modeling tools Use the right approach for what needs to be done! Explore data in-memory WITH data visualization and approachable modelling MANAGE DATA EXPLORE DATA DEVELOP MODELS DEPLOY& MONITOR
- 10. Copyright © 2015, SAS Institute Inc. All rights reserv ed. DEMO • Sector: Online e-commerce shop • Business Problem: Having difficulty to keep profitable customers returning to the web site • Specific aim: Identify the reasons for clients to abandon their shopping cart and predict those visitors with a high probability to abandon • Challenge: Getting big data stored into Hadoop and accessing it is difficult for analysts to access from their traditional systems without specific expertise
- 11. Copyright © 2015, SAS Institute Inc. All rights reserv ed. ENABLING ENTIRE ANALYTICS LIFECYCLE AROUND HADOOP TEXT MANAGE DATA EXPLORE DATA DEVELOP MODELS DEPLOY& MONITOR • SAS/ACCESS to Hadoop • SAS Data Loader for Hadoop • SAS Data Management • SAS Federation Server • SAS Event Stream Processing • SAS Visual Analytics • SAS In-memory Statistics • SAS Visual Statistics • SAS High-Performance Analytics Products • SAS Scoring Accelerator for Hadoop
- 12. Copyright © 2015, SAS Institute Inc. All rights reserv ed. WHY SAS? SUPPORTING THE ENTIRE ANALYTICS JOURNEY! SAS® Visual Analytics SAS® Visual Statistics SAS® In-Memory Statistics SAS® Enterprise Miner / SAS® Forecast Server SAS® Decision Manager / SAS® Scoring Accelerator Data exploration, analysis, visualization and approachable analytics for the masses In-depth GUI driven approachable modelling State-of-the-art interactive analytics driven through a programmatic interface Robust production modelling tools that provide for repeatability and easy operationalization Capabilities to deploy, monitor and automate analytics with appropriate business rules into operational business processes Visualize, explore, interact, explain, understand, democratize Finalize, Deploy, integrate, execute, operationalize, industrialize SAS® Data Loader for Hadoop
- 13. Copyright © 2015, SAS Institute Inc. All rights reserv ed. SAS AND HADOOP SUMMARY SAS is the only vendor to work FROM + WITH + IN Hadoop throughout the analytics lifecycle. All three approaches can be combined and coordinated, complementing each other for each situation. Each approach can evolve, mature and/or morph into the other. SAS can help realize the value of Hadoop; bring production-analytics to the platform.
- 14. Copyright © 2015, SAS Institute Inc. All rights reserv ed. THANK YOU MARK.TORR@SAS.COM Lets connect on LinkedIn: http://de.linkedin.com/in/marktorr/en Follow my interests on Twitter: https://twitter.com/mark_torr