Mastering in data warehousing & BusinessIintelligence
Download as PPTX, PDF4 likes1,509 views
This document provides an overview of data warehousing and business intelligence. It begins with defining key concepts like data warehousing, its properties including being subject-oriented, integrated, time-variant and non-volatile. It then discusses data warehouse architecture and components. The document also introduces data modeling tools like ERwin and open source ETL tools like Talend. Finally, it discusses business intelligence and visualization tools like Tableau. The overall objective is to help understand concepts in data warehousing and business intelligence.
Mastering in data warehousing & BusinessIintelligence
- 1. www.edureka.co/data-warehousing-and-bi Mastering In DataWarehousing & Business Intelligence
- 2. Slide 2 www.edureka.co/data-warehousing-and-bi At the end of this module, you will be able to Know : Objective What is Data Warehousing & Business Intelligence ? What is Data Warehousing Architecture ? What is Data Modelling / Introduction to ER Win r9 Tool ? What is ETL / An Open Source ETL Tool – Talend 5.x ? What is Business Intelligence / An Open Source Tableau Public 9.x ?
- 3. Slide 3Slide 3Slide 3 www.edureka.co/data-warehousing-and-bi What is Data Warehouse A data warehouse refers to a database that is maintained separately from an organization’s operational database “A data warehouse is a subject-oriented, integrated, time- variant, and nonvolatile collection of data in support of management’s decision-making process.” Loosely Speaking Officially Speaking W.H. Inmon
- 4. Slide 4Slide 4Slide 4 www.edureka.co/data-warehousing-and-bi Subject Oriented Data Warehouse Properties Non Volatile Integrated Time Variant Data Warehousing
- 5. Slide 5Slide 5Slide 5 www.edureka.co/data-warehousing-and-bi Subject-Oriented Data is categorized and stored by business subject rather than by application Equity Plans Shares Customer financial information Savings Insurance Loans OLTP Applications Data Warehouse Subject
- 6. Slide 6Slide 6Slide 6 www.edureka.co/data-warehousing-and-bi Integrated OLTP Applications Savings Current accounts Loans Data Warehouse Data on a given subject is defined and stored once. Customer
- 7. Slide 7Slide 7Slide 7 www.edureka.co/data-warehousing-and-bi Time-Variant Data is stored as a series of snapshots, each representing a period of time… TIME DATA Jan-97 January Feb-97 February Mar-97 March Jan-97 January
- 8. Slide 8Slide 8Slide 8 www.edureka.co/data-warehousing-and-bi Non-Volatile Typically data in the data warehouse is not updated or deleted. Insert Update Delete Read Read Operational Warehouse Load
- 9. Slide 9Slide 9Slide 9 www.edureka.co/data-warehousing-and-bi Changing Data Warehouse Database First time load Refresh Refresh Operational Database
- 10. Slide 10Slide 10Slide 10 www.edureka.co/data-warehousing-and-bi What is Data Warehouse “Data warehouse is the conglomerate of all data marts within the enterprise. Information is always stored in the dimensional model.” Officially Speaking Ralph Kimball
- 11. Slide 11Slide 11Slide 11 www.edureka.co/data-warehousing-and-bi InmonVsRalphKimball Characteristics Inmon Kimball Business Decision Support Requirements Strategic Tactical Data Integration Requirement Enterprise Wise Integrator Individual Business Requirement Data Structure Requirement Data that meet multiple and varied information needs and non-metric data KPI, Business Performance Measure & Scorecards Requirements Persistency of Data in Source System Source Systems have high rate of change Source Systems are quite stable Skill Sets Bigger Team of Specialists Small Team of Generalists Time Constraint Longer Time Required Urgent delivery as this is subjective Cost to Build High Start-up Costs Low Start-Up Costs
- 12. Slide 12Slide 12Slide 12 www.edureka.co/data-warehousing-and-bi Data Ware Housing Products Entity Relationship / Schema Modeling Data Integration / ETL
- 13. Slide 13Slide 13Slide 13 www.edureka.co/data-warehousing-and-bi What is Business Intelligence? Business intelligence (BI) is the set of techniques and tools for the transformation of raw / production and operational data into meaningful and useful information for business analysis purposes for various level. Business intelligence (BI) talks about how traditional data which transform into the BI which have multiple initiatives to measure, manage, and improve on the performance of individuals, processes, teams, and business units for the specific business area. During the operation of business, the following questions must be asked. The functions of monitoring, analyzing, and planning delve into these questions as follows : • What has happened? • What is happening? • Why? • What will happen? • What do we want to have happen?
- 14. Slide 14Slide 14Slide 14 www.edureka.co/data-warehousing-and-bi What is Business Intelligence Categories? Strategic Business Intelligence: Management collaborates and agrees on a strategy and a method in which they would like to see information presented, for example, in maps, scorecards, reports, or dashboards. Now that you have your strategy defined, it is imperative that you do something with the data that you have collected Analytical Business Intelligence: Once Strategic BI sets the foundation in the form of key performance metrics, then Analytical BI is employed to identify the source of an issue once it has been uncovered. Tools like analytic dashboards, OLAP, predictive analytics, and ad hoc queries are utilized to determine the location or the cause of a major problem.
- 15. Slide 15 www.edureka.co/data-warehousing-and-bi Data Ware House Architecture
- 16. Slide 16Slide 16Slide 16 www.edureka.co/data-warehousing-and-bi - CA ERwin Introduction • ERwin is a popular data modeling tool used by a number of major companies throughout the world. The product is currently owned, developed, and marketed by Computer Associates, a leading software company. • The product supports a variety of aspects of database design, including data modeling, forward engineering (the creation of a database schema and physical database on the basis of a data model), and reverse engineering (the creation of a data model on the basis of an existing database) for a wide variety of relational DBMS, including Microsoft Access, Oracle, DB2, Sybase, and others.
- 17. Slide 17Slide 17Slide 17 www.edureka.co/data-warehousing-and-bi Physical ER Diagram
- 18. Slide 18Slide 18Slide 18 www.edureka.co/data-warehousing-and-bi Open Source VS Commercial ETL Tools Open Source ETL Commercial ETL License Details Licensing Model Open-Core Model. No charges for extra CPU cycles Core Model. Extra usage charges can be applied for over-the-limit CPU cycles Licensing Channel via GNU public license/Apache license Vendor specific Cost Differentiation License Costs 30-60% < 1X times Commercial license (Mostly) 1X times Support and Maintenance Costs Close to Commercial vendor costs (Mostly) Close to Open-Source Advanced Features Offered through "Commercial" Open- Source Add-ons Type of Support and Maintenance Tiered pricing model. E.g. Community(Free, Forums), Silver, Gold and Platinum Editions Not offered in tiers (Mostly). Add-on to licensing costs
- 19. Slide 19Slide 19Slide 19 www.edureka.co/data-warehousing-and-bi Talend Open DI Studio 5.x - Overview • Talend Open Studio for Data Integration operates as a code generator, producing data-transformation scripts and underlying programs in Java. Its GUI gives access to a metadata repository and to a graphical designer. The metadata repository contains the definitions and configuration for each job - but not the actual data being transformed or moved. All of the components of Talend Open Studio for Data Integration use the information in the metadata repository. • The product is based on Eclipse. • Talend Open DI Studio typically use for: • synchronization or replication of databases • right-time or batch exchanges of data • ETL (Extract/Transform/Load) for analytics • data migration • complex data transformation and loading • data quality exercises • big data • Talend Open Studio for Data Integration primarily differs from Talend Enterprise Data Integration in that the Enterprise version has a Subversion plug-in built in, as well as support for joblets. Using Talend Enterprise Data Integration, ETL and ELT jobs can have a dynamic schema.
- 20. Slide 20Slide 20Slide 20 www.edureka.co/data-warehousing-and-bi Talend - History
- 21. Slide 21Slide 21Slide 21 www.edureka.co/data-warehousing-and-bi Talend - Partners
- 22. Slide 22Slide 22Slide 22 www.edureka.co/data-warehousing-and-bi Talend - Customers
- 23. Slide 23Slide 23Slide 23 www.edureka.co/data-warehousing-and-bi Talend - Market Position
- 24. Slide 24Slide 24Slide 24 www.edureka.co/data-warehousing-and-bi Talend - Product Offering
- 25. Slide 25Slide 25Slide 25 www.edureka.co/data-warehousing-and-bi Talend DI Studio - Welcome Page
- 26. Slide 26Slide 26Slide 26 www.edureka.co/data-warehousing-and-bi Data visualization With Tableau • Data visualization tools allow anyone to organize and present information intuitively. This is becoming more vital as data proliferates in every field from bar codes in retail stores to player behavior in online games. • All of this data is meaningless without a way to organize and present important findings within it. People comprehend data better through pictures than by reading numbers in rows and columns. • So by visualizing data, you are able to more effectively ask and answer important questions such as “Where are sales growing,” “What is driving growth” and “What are the characteristics of my customers using different services?” By using Tableau visualizations, you gain the ability to quickly answer questions; your data becomes a competitive advantage instead of an underutilized asset.
- 27. Slide 27Slide 27Slide 27 www.edureka.co/data-warehousing-and-bi Tableau Software, Inc. Company and Leadership • The company was founded in Mountain View, California in January, 2003 by Chris Stolte, Christian Chabot and Pat Hanrahan. • Based on a breakthrough from Stanford University, Tableau makes visual analytics and business intelligence software that delivers: • 10-100X productivity improvements • amazing multi-dimensional discoveries • web analytics at 1/10th the cost of a “BI Platform” The company is headquartered in Seattle, WA. Customers + Google + Allstate + Cornell + Harvard + Apple + NSA + Microsoft + 1,000’s more Key Partners + Oracle OEM + Microsoft Gold Certified + Teradata Partner
- 28. Slide 28Slide 28Slide 28 www.edureka.co/data-warehousing-and-bi Customers: 4,000 Strong Companies Advertising and Marketing Avenue A | Razorfish DoubleClick Draft FCB Olgilvy Predicta Brazil The Martin Agency Banking and Finance Bank of America Barclays Global Citigroup Draft FCB Group EverBank Direct Fifth Third Bank Greater Iowa Credit Union Wells Fargo Charities British Red Cross Christian Relief Services Charities DC Children & Youth Inv. Trust Corp. Goodwill Industries United Way of Rock River Valley World Vision Communications Bell Canada Bell South FiberTower Lucent Mitel Networks Corporation Motorola Sprint T-Mobile Telstra Verizon Communications Consulting and Legal Baker & McKenzie Booz Allen Hamilton Clorox Company Cornerstone Research Deloitte & Touche LLP Electronic Data Systems Corporation Ernst & Young McKinsey & Company Mercer Norbridge Energy & Utilities Atomic Energy of Canada Duke Energy Corporation Louisville Water Company Omaha Public Power District Saudi Aramco TXU Williams Midstream WindLogics Engineering and Construction Bechtel Corporation Beezer Homes Kiewit Corporation McGraw-Hill Construction St. Onge Company Financial Information Dunn & Bradstreet Equifax Fannie Mae HTM Corporation Moodys Investors Service Scottish Re Standard and Poor's Food and Beverage Chicken of the Sea Nestlé Prairie Berry Winery Sierra Nevada Brewing Company Starbucks Coffee The Coca-Cola Company Turkey Hill Dairy Healthcare Barnes Jewish Hospital Blue Cross Blue Shield of Alabama Caremark Good Shepherd Medical Center Harvard Medical School Johnson & Johnson Kaleida Health LSU Health Sciences Roche Diagnostics St. Jude Children's Research University of Miami Medical Center Wake Forest Health Sciences Insurance AAA Allied Group Amica Esurance Marsh & McLennan Mutual of Omaha Nationwide Insurance Progressive The Regence Group Investment and Brokerage Bridgewater Associates Charles Schwab Dundee Securities Merrill Lynch National Financial Partners New Enterprise Associates RBC Dain Rauscher Rosenblatt Securities Stone Castle Partners Manufacturing Air Products Alcoa Boeing Dow Chemical Hitachi Honda Jabil Circuit KLA Tencor Lockheed Martin Pratt & Whitney Ricoh Sony Steelcase Toyota Media and Entertainment CNET Networks Discovery Communications Dow Jones and Company Epic Games Microsoft Xbox New York Times O'Reilly Media Sony TiVo Univision Pharamceutical Alza Pharmaceutical Cephalon Eli Lilly Johnson & Johnson McKesson Merck Novo Nordisk Pfizer Sanofi Aventis Government and Public Sector Australia Attorney General DC Government Federal Aviation Administration (FAA) Government of Canada National Science Foundation NSA - National Security Agency NYC Department of Education Pacific Northwest National Lab (PNNL) SOCOM - US Special Ops Command US Air Force US Army US Bureau of Land Management US Department of Agriculture (USDA) US Department of Justice US Department of the Navy Veteran's Benefit Association (VBA) Research & Development Bayer CropScience Boeing Phantomworks General Electric Global Research Lawrence Livermore Labs MITRE National Institute of Health National Reconnaissance Office National Visualization Analytics Center Pacific Northwest National Labs Quest Diagnostics Retail Amazon.com Barnes & Noble Borders Caremark CVS Lowe's MAPCO Pilot Travel LLC Safeway Walmart Wet Seal Service and Outsourcing ADP Computer Information Concepts EDS Hmetrix Madrona Solutions Group Oco StrategicOne Wolters Kluwer Technology Adobe AOL BEA Systems CNET Networks eBay Electronic Arts ESRI Google HP IBM Microsoft MySQL Novell Pay Pal VMWare TechNexxus Travel & Leisure Alaska Airlines Bourne Leisure Celebrity Cruise Lines Expedia Royal Caribbean Cruise Lines Sandiego.com Universities and Colleges Appalachian State University Chemetka Community College Cornell University DePaul University Duke University Georgetown University Johns Hopkins University London School of Economics Ohio State University Pitzer College Providence College San Diego State University University College- Dublin University of North Carolina – Chapel Hill
- 29. Slide 29Slide 29Slide 29 www.edureka.co/data-warehousing-and-bi Tableau Products Tableau Desktop Create Tableau Server Share - Web Tableau Reader Share - Local + business intelligence solution scales to organizations of all sizes + share visual analytics with anyone with a web browser + publish interactive analytics or dashboards + secure information and manage metadata + collaborate with others + share visualizations & dashboards on the desktop + filter, sort, and page through the views + “Acrobat for Data” + free download + ad hoc analytics, dashboards, reports, graphs + explore, visualize, and analyze your data + create dashboards to consolidate multiple views + deliver interactive data experiences Tableau Public Share - Everyone + create and publish interactive visualizations and dashboards + embed in websites and blogs + free download and free hosting service
- 30. Slide 30Slide 30Slide 30 www.edureka.co/data-warehousing-and-bi How Do People Work With Tableau
- 31. Slide 31 www.edureka.co/data-warehousing-and-bi Tableau Public - Start Page