WhereScape, the pioneer in data warehouse automation software
3 likes4,099 views
This document summarizes WhereScape as the pioneer in data warehouse automation software. It discusses WhereScape's background, customers in various industries and regions, and value proposition of providing an integrated development environment that manages the entire data warehouse lifecycle in an automated, simplified, and faster manner compared to traditional approaches. The document also outlines the challenges of managing an EDW/BI environment with multiple tools and skills, and how WhereScape addresses this with a single tool, skillset, and lower cost of change.
WhereScape, the pioneer in data warehouse automation software
- 1. THE PIONEER IN DATA WAREHOUSE AUTOMATION SOFTWARE
- 2. Data vault automation conference – Utrecht – 6 October 2011 Why this presentation?
- 3. COMPANY BACKGROUND • Founded in 2000 in Auckland, New Zealand by data warehouse experts • 120+ Employees • US – Global Head Office, Portland • UK – European Head Office, Reading • NZ – Development, Auckland Supported Targets:
- 4. USA: Wells Fargo Bank NIKE GE Aviation IPC Subway Juniper Networks Nordstrom Delta Credit Union Med Assets Europe Tesco Vodafone AON Xerox HSBC MAN Investments Network Rail Sainsbury’s Zurich Insurance Volkswagen Asia Pacific MGM Macau Abano International Singtel Optus Ericsson Vietnam Telstra AU Reserve Bank of Australia Ministry of Defence Westfield QBE Insurance Energy Australia AstraZeneca Air New Zealand Telecom Vodafone Xero Vodafone Qatar ABSA Barclays Bank GLOBAL CUSTOMER BASE 700+ WORLDWIDE
- 5. SOME OF OUR CUSTOMERS
- 6. WHAT WE DO Profiles, Plans, Designs Right. Builds, Documents, Automates Now.
- 7. VALUE PROPOSITION • 1st integrated development environment (IDE) that manages the entire data warehouse lifecycle (Plan & Build) • Builds data warehouses 10-100 times faster than a traditional approaches • Data driven approach de-risks projects and automatically applies best practice whilst auto documenting… DATA WAREHOUSE AUTOMATION
- 8. REQUIREMENTS DW framework Profile Logical Model Physical Model DB Architecture Storage Mgmt Index Mgmt OLAP Design ETL Mapping ETL Dev Version Control Workflow Deployment Maintenance Word/Excel Mainly in-house solutions Informatica Microstrategy IBM Clear Case Trillium AbInitio DataStage TOAD PowerDesigner Enterprise Architect Cognos JIRA SSMS SSIS SSAS SVN IBM Clear Quest Change tool Change tool Change tool Change tool Change tool Change tool Informatica ERwin DB Management Tools DataStage Documentation TRADITIONAL APPROACH Over complicated Inefficient
- 9. DW Framework Profile Physical Model DB Architecture Storage Mgmt Index Mgmt OLAP Design ETL Mapping ETL Dev Version Control Workflow Deployment Maintenance Logical Model Documentation METADATA WhereScape RED WhereScape 3D THE WHERESCAPE WAY Simplification Automation
- 10. MANAGING AN EDW/BI ENVIRONMENT IS CHALLENGING • Too many development tools & skills • Siloed with a high cost of change
- 11. MANAGING AN EDW/BI ENVIRONMENT JUST GOT EASIER • One tool, one skillset, low cost of change • Non-proprietary & Non-disruptive
- 12. SQL • I set-based SQL • Scale with your RDBMS or Big Data platform • Easy migration path to other technologies • You’re in control, no black boxes • Don’t we all talk SQL? DATA WAREHOUSE AUTOMATION 😀
- 13. PROCESS • Different activities warrant different approaches • Model-driven development vs. • Data-driven development • Bring the agile back in our profession • Break down the barriers between profiles • Don’t limit yourself to “coding only” activities DATA WAREHOUSE AUTOMATION
- 14. “A 3 year project has now been completed in 6 months thanks to WhereScape and agile development.”
- 17. THE DATA QUADRANT MODEL RONALD D. DAMHOF Development Style Systematic Opportunistic I II III IV Research, Innovation & Design “Shadow IT, Incubation, Ad-hoc, Once off” Push/Supply/Source driven Pull/Demand/Product driven Data Push/Pull Point ContextFacts
- 18. SCOPE • End-to-end • Full life cycle -> identify your bottlenecks • Analysis: source profiling • DevOps / CI • Test Automation • Documentation • Any modeling style? DATA WAREHOUSE AUTOMATION
- 22. HISTORICAL ODS + CLASSIC KIMBALL Data Store Star Schema
- 23. NORMALIZED EDW 3NF Star Schema
- 24. RAW + BUSINESS DATAVAULT Data Vault Data Vault
- 25. RAW DATAVAULT + STAR SCHEMA Data Vault Star Schema
- 26. DATA LAKE + STAR SCHEMA Star Schema
- 27. COMPETITION • Very few automation software packages • Traditional ETL suites • Set of templates • But typical: PPP DATA WAREHOUSE AUTOMATION
- 28. • Teradata is an important platform