![Thank
You
Krish
Krishnan
rkrish1124@yahoo.com
Twi]er
Handle:
@datagenius
@2012
Copyright
Sixth
Sense
Advisors](https://image.slidesharecdn.com/br12-12-03-teradata-121204162743-phpapp02/85/Unity-Because-the-Sum-is-Greater-than-the-Parts-57-320.jpg)
Unity: Because the Sum is Greater than the Parts
- 2. Welcome Host: Eric Kavanagh eric.kavanagh@bloorgroup.com Twitter Tag: #briefr The Briefing Room
- 3. Mission ! Reveal the essential characteristics of enterprise software, good and bad ! Provide a forum for detailed analysis of today s innovative technologies ! Give vendors a chance to explain their product to savvy analysts ! Allow audience members to pose serious questions... and get answers! Twitter Tag: #briefr The Briefing Room
- 4. December: Innovators January: Big Data February: Analytics March: Data in Motion Twitter Tag: #briefr The Briefing Room
- 5. Innovators ! Necessity is the mother of invention, and the need for unified access is driving innovation ! Big Data, Cloud and Photo by George P. Landow (www.victorianweb.org) Social Media are the horses in front of the carriage ! Users want easier, faster and better system management This image may be used without prior permission for any scholarly or educational purpose Twitter Tag: #briefr The Briefing Room
- 6. Analyst: Krish Krishnan Mr. Krishnan is a recognized expert in the strategy, architecture and implementation of high performance data warehousing solutions and unstructured data. He co-authored “Building the Unstructured Data Warehouse” along with Bill Inmon. He also has written eBooks, over 150 articles, viewpoints and case studies in Big Data, Business Intelligence, Data Warehousing, Data Warehouse Appliances and High Performance Architectures. Mr. Krishnan currently is promoting the next generation of data warehousing, focusing on Big Data, Semantic Technologies, Crowdsourcing, Analytics, and Platform Engineering. He leads the Data Warehouse Appliance and Architectures Expert Channel at BEyeNetwork.com and publishes with www.beyenetwork.comkkrishnan. Twitter Tag: #briefr The Briefing Room
- 7. Teradata ! Teradata is known for its analytic data solutions with a focus on integrated data warehousing, big data analytics and business applications. ! It offers a broad suite of technology platforms and solutions, and a wide range of data management applications and data mining capabilities. ! Teradata is now offering an integrated portfolio that turns a multi-system environment into an Analytical Ecosystem. Twitter Tag: #briefr The Briefing Room
- 8. Imad Birouty Imad Birouty is the Program Marketing Manager for the Teradata Analytical Ecosystem, which includes features such as Teradata Unity and Teradata’s Dual Active Solution. Imad is also responsible for Teradata’s Data Mart Consolidation program, the Value of Integrated Data, and Total Cost of Ownership. Prior to this, Imad led the Product Management team responsible for the NCR Platform including the processing nodes, BYNET Interconnect, Server Management, and Operating Systems. He set product strategy and direction and was responsible for seven major platform releases spanning 8 years. Twitter Tag: #briefr The Briefing Room
- 9. TERADATA UNITY AND THE UNIFIED DATA ARCHITECTURE Imad Birouty Program Marketing Manager
- 10. TERADATA UNITY
- 11. Teradata Unified Data Architecture Teradata Analytical Ecosystem INTEGRATED DATA WAREHOUSE AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 11 12/4/12
- 12. Teradata Unified Data Architecture Teradata Analytical Ecosystem INTEGRATED DATA WAREHOUSE DATA LAB AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 12 12/4/12
- 13. Teradata Unified Data Architecture Teradata Analytical Ecosystem INTEGRATED DATA WAREHOUSE DATA DATA LAB MARTS ANALYTICAL TEST/ ARCHIVE DEV AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 13 12/4/12
- 14. Teradata Unified Data Architecture Teradata Analytical Ecosystem INTEGRATED DATA WAREHOUSE DATA DATA LAB MARTS INDEPENDENT ANALYTICAL DATA MART TEST/ ARCHIVE DEV AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 14 12/4/12
- 15. Teradata Unified Data Architecture Teradata Analytical Ecosystem DUAL INTEGRATED SYSTEMS DATA WAREHOUSE DATA DATA LAB MARTS INDEPENDENT ANALYTICAL DATA MART TEST/ ARCHIVE DEV AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 15 12/4/12
- 16. Teradata Unified Data Architecture VIEWPOINT UNITY SUPPORT Teradata Analytical Ecosystem DUAL INTEGRATED SYSTEMS DATA WAREHOUSE DATA DATA LAB MARTS INDEPENDENT ANALYTICAL DATA MART TEST/ ARCHIVE DEV AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 16 12/4/12
- 17. Teradata Unified Data Architecture Business Analysts Marketing Front-Line Workers Customers / Partners Executives Operational Systems VIEWPOINT DATA MINING BUSINESS INTELLIGENCE APPLICATIONS SUPPORT Teradata Analytical Ecosystem DUAL INTEGRATED SYSTEMS DATA WAREHOUSE DATA DATA LAB MARTS INDEPENDENT ANALYTICAL DATA MART TEST/ ARCHIVE DEV AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 17 12/4/12
- 18. Teradata’s Analytical Ecosystem Benefits • Meet service level goals > The right data, in the right place, at the right time, for the right users > Track application readiness • Resource optimization > Match application profiles to the right Teradata platform > Availability, performance, cost • Investment protection > Seamless application portability between Teradata platforms > Platform repurposing • One source support for Teradata products and services 18 12/4/12
- 19. Teradata Unity Integrated portfolio that turns a multi-system environment into an orchestrated Analytical Ecosystem Teradata Unity Unity Director Unity Loader Unity Data Unity Ecosystem Mover Manager Query routing and High volume, Data End-to-end monitoring database intelligent data movement across data warehouse synchronization loading to between components between Teradata multiple Teradata Teradata Systems systems systems 19 12/4/12
- 20. Unity Director Provides Query Management Reads • Two methods for Read queries > User session routing > Individual query routing 20 12/4/12
- 21. Unity Director Provides Query Management Reads • Two methods for Read queries > User session routing > Individual query routing Controlled Routing (Named, Preferred) Great for session and workload control across systems, especially when high availability failover is required 21 12/4/12
- 22. Unity Director Provides Query Management Reads • Two methods for Read queries > User session routing > Individual query routing Controlled Routing Automatic Routing (Named, Preferred) (Automatic) Great for session and workload Great when systems contain control across systems, especially different data and/or for fast setup when high availability failover is where session control isn’t required required 22 12/4/12
- 23. Unity Director Provides Query Management Writes • Three methods for Write operations > Default, Create Preferred, Create Balanced > Can be used in combination Default (writes) • Writes to all systems where objects reside • Great for keeping systems in sync 23 12/4/12
- 24. Unity Director Provides Query Management Writes • Three methods for Write operations > Default, Create Preferred, Create Balanced > Can be used in combination Default Create Preferred (writes) (writes) • Writes to all systems • Creates to only one system where objects reside • Subsequent writes to created • Great for keeping objects on just one system, systems in sync such as temporary tables • Prevents wasted resources on other systems 24 12/4/12
- 25. Unity Director Provides Query Management Writes • Three methods for Write operations > Default, Create Preferred, Create Balanced > Can be used in combination Default Create Preferred Create Balanced (writes) (writes) (writes) • Writes to all systems • Creates to only one system • Creates to only one system where objects reside • Subsequent writes to created • Designated system for • Great for keeping objects on just one system, creates alternates among systems in sync such as temporary tables systems for different • Prevents wasted resources on sessions based on a round- other systems robin algorithm 25 12/4/12
- 26. Unity Loader • Bulk loads sent to all participating systems; updates are asynchronous • More than two sites are supported with additional Unity Loader and Director servers Site 1 Unity Loader 26 12/4/12
- 27. Unity Loader • Bulk loads sent to all participating systems; updates are asynchronous • More than two sites are supported with additional Unity Loader and Director servers Site 1 Unity Loader Unity Loader Unity Loader 27 12/4/12
- 28. Unity Loader • Bulk loads sent to all participating systems; updates are asynchronous • More than two sites are supported with additional Unity Loader and Director servers Site 1 ü ü Unity Loader Unity Loader Unity Loader ü 28 12/4/12
- 29. Unity Loader • Bulk loads sent to all participating systems; updates are asynchronous • More than two sites are supported with additional Unity Loader and Director servers Site 1 ü ü Unity Loader Unity Loader Unity Loader ü Site 2 Unity Loader 29 12/4/12
- 30. Unity Loader • Bulk loads sent to all participating systems; updates are asynchronous • More than two sites are supported with additional Unity Loader and Director servers Site 1 ü ü Unity Loader Unity Loader Unity Loader ü Site 2 Unity Loader Unity Loader Unity Loader 30 12/4/12
- 31. Unity Loader • Bulk loads sent to all participating systems; updates are asynchronous • More than two sites are supported with additional Unity Loader and Director servers Site 1 ü ü Unity Loader Unity Loader Unity Loader ü Site 2 Unity Loader Unity Loader Unity Loader 31 12/4/12
- 33. UNIFIED DATA ARCHITECTURE Big Data Analytics DISCOVERY INTEGRATED PLATFORM DATA WAREHOUSE Big Data Management CAPTURE | STORE | REFINE AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 33 Copyright © 2011 Teradata Corporation.
- 34. Discovery Platform Data Sources Discovery Discovery Tools Users Non SQL relational Discovery Data Scientist Data Platform MapReduce Multi- Structured • Structured and Business multi-structured Statistical Analyst Data Functions data • Doesn’t require extensive data Structured • Fraud patterns modeling Data • Customer behavior • Doesn’t balance the books • Digital marketing optimization • Data completeness can be good • Machine data/process OLTP enough optimization DBMS’s • No stringent SLA’s 34 Copyright © 2011 Teradata Corporation.
- 35. Hadoop Use Cases Validated with Customers • Land/source operational data - Only one extract from source system • History or long term storage - Low cost storage • Preprocess data - Sessionize data, remove XML tags • Transformations - Structured and semi-structured • Exploration - Investigate value of new data sources Many define as • Batch scoring Analytics • Single subject reporting 35 Copyright © 2011 Teradata Corporation.
- 36. Teradata Unified Data Architecture Data Scientists Business Analysts Marketing Front-Line Workers Engineers Customers / Partners Executives Operational Systems LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS DISCOVERY INTEGRATED PLATFORM DATA WAREHOUSE CAPTURE | STORE | REFINE AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 36 12/4/12
- 37. Teradata Unified Data Architecture Data Scientists Business Analysts Marketing Front-Line Workers Engineers Customers / Partners Executives Operational Systems LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS DISCOVERY INTEGRATED PLATFORM DATA WAREHOUSE AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 37 12/4/12
- 38. Teradata Unified Data Architecture Data Scientists Business Analysts Marketing Front-Line Workers Engineers Customers / Partners Executives Operational Systems LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS DISCOVERY INTEGRATED PLATFORM DATA WAREHOUSE AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 38 12/4/12
- 39. INTRODUCING TERADATA ASTER BIG ANALYTICS APPLIANCE 3H Industry’s First Big Analytics Appliance with Aster and Hadoop in the same cabinet Unified System Management and Analytics Unified Solution for Big Data Storage, Management, and Analytics Available NOW 39 12/4/12
- 40. Aster SQL-H™ A Business User’s Bridge to Analyze Hadoop Data NEW Aster SQL-H Gives Analysts and Data Scientists a Better Way to Aster: SQL-H Analyze Data Stored in Hadoop • Allow standard ANSI SQL access to Hadoop Hadoop data MR • Leverage existing BI tool and enable Data Filtering self service Data Hive HCatalog • Enable 50+ prebuilt SQL-MapReduce Apps and IDE Pig Hadoop Layer: HDFS 40 Copyright © 2011 Teradata Corporation.
- 41. Teradata Unified Data Architecture Data Scientists Business Analysts Marketing Front-Line Workers Engineers Customers / Partners Executives Operational Systems VIEWPOINT LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS SUPPORT DISCOVERY INTEGRATED PLATFORM DATA WAREHOUSE CAPTURE | STORE | REFINE AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 41 12/4/12
- 42. Teradata Viewpoint Integration Easier, Faster, and Better System Management Common Management Console for Aster, Teradata and Apache Hadoop Aster Specific Query Portlets Portlets • Query Monitor • Aster Node Monitoring Admin Portlets • Aster Completed • Teradata System Processes • Roles Manager Trend/ Other Portlets • System Health Visualization • Canary queries Portlets • Aster Data • Capacity Alerting Heat Map • Metrics Graph • Metrics Analysis Available now with Teradata and Aster. Hadoop availability early 2013 42 12/4/12
- 43. Improve Supportability with Teradata Vital Infrastructure • Customers that want to improve supportability Regularly Collects Asset Data ensure that Teradata Constantly Monitors Events Vital Infrastructure is activated in their Identifies Risk Data Patterns/Trends production environment Detects Fault Alerts • Teradata Vital Infrastructure is Records Fault Events embedded proactive support software Automatic Incident Reports Are Created available on each Teradata platform Alert Notifications Are Sent and Tracked 62–70% of Incidents Discovered Through TVI 43 12/4/12
- 44. Teradata Unified Data Architecture Business Analysts Marketing Front-Line Workers Customers / Partners Executives Operational Systems VIEWPOINT DATA MINING BUSINESS INTELLIGENCE APPLICATIONS SUPPORT Teradata Analytical Ecosystem DUAL INTEGRATED SYSTEMS DATA WAREHOUSE DATA DATA LAB MARTS INDEPENDENT ANALYTICAL DATA MART TEST/ ARCHIVE DEV AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 44 12/4/12
- 45. Teradata Unified Data Architecture Data Scientists Business Analysts Marketing Front-Line Workers Engineers Customers / Partners Executives Operational Systems VIEWPOINT LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS SUPPORT DISCOVERY DUAL INTEGRATED PLATFORM SYSTEMS DATA WAREHOUSE DATA DATA LAB MARTS INDEPENDENT ANALYTICAL DATA MART TEST/ ARCHIVE DEV CAPTURE | STORE | REFINE AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP 45 12/4/12
- 46. Thank You! Questions and Answers 46 12/4/12
- 47. Perceptions & Questions Analyst: Krish Krishnan Twitter Tag: #briefr The Briefing Room
- 48. Next Generation Data Warehouse Designing & Building Scalable Data Warehouse Infrastructures BriefR December 4th 2012 S
- 49. State of Data Today @2012 Copyright Sixth Sense Advisors
- 50. Corporate Decision Support Data Semi-‐ Structured Data @2012 Copyright Sixth Sense Advisors
- 51. Data Distribution Today @2012 Copyright Sixth Sense Advisors
- 52. Data Workloads & Processing Datamarts & Transac1onal Reports ODS Analy1cal Systems Databases Dashboards Enterprise Transac1onal Datamarts & ODS Datawarehouse Systems Analy1cal Databases Analy1c Models Other Transac1onal Datamarts & Applica1ons ODS Systems Analy1cal Databases Data Transforma1on @2012 Copyright Sixth Sense Advisors
- 53. Workload Challenge S Issues S Requirements S Long running jobs S Assigning the appropriate systems S Missed SLA’s and processes to manage workloads S Creates an interchangeable S Performance & Response Issues infrastructure S Scalability S Support Homogenous / S Fault Tolerance Heterogeneous plaIorms S Need to process data in a S Unknowns reasonable 1me S Do not know what data we are S Need a fault tolerant architecture as geCng large chunks of data cannot be reprocessed if and when a failure S Do not know formats or occurs volumes of data S Need automa1c resource management @2012 Copyright Sixth Sense Advisors
- 54. Workload Isolation Semi-‐ Structured Data @2012 Copyright Sixth Sense Advisors
- 55. BeneGits S Requirements S Assigning the appropriate systems and processes to manage workloads S Creates an interchangeable infrastructure S Support Homogenous / Heterogeneous plaIorms S Need to process data in a reasonable 1me S Need a fault tolerant architecture as large chunks of data cannot be reprocessed if and when a failure occurs S Need automa1c resource management @2012 Copyright Sixth Sense Advisors
- 56. Questions S What are the key drivers behind the “unity” architecture? S What is the biggest benefit of this applica1on? S Will Teradata evolve this fabric in the next genera1ons? S What releases of the ecosystem are supported? S Will this include integra1on of other Teradata management tools in the future? S How can Systems Administrators learn this architecture? What addi1onal skills are needed? @2012 Copyright Sixth Sense Advisors
- 57. Thank You Krish Krishnan rkrish1124@yahoo.com Twi]er Handle: @datagenius @2012 Copyright Sixth Sense Advisors
- 58. Twitter Tag: #briefr The Briefing Room
- 59. Upcoming Topics This month: Innovators January: Big Data February: Analytics 2013 Editorial Calendar www.insideanalysis.com Twitter Tag: #briefr The Briefing Room
- 60. Thank You for Your Attention Twitter Tag: #briefr The Briefing Room