What the Enterprise Requires - Usability
2 likes1,056 views
The document outlines the features and capabilities of Cloudera Manager 4.5, released in March 2013, focusing on enhancing Hadoop management for enterprises. Key highlights include improved system visibility, ease of integration, rolling upgrades, and advanced monitoring features that cater to data management needs. The document also emphasizes the importance of readiness for enterprise applications, regulatory compliance, and seamless integration with existing IT infrastructure.
What the Enterprise Requires - Usability
- 1. Cloudera Manager 4.5 Bala Venkatrao Director, Products March 2013 1 CONFIDENTIAL - RESTRICTED
- 2. Agenda • Brief overview of new product releases • Cloudera Manager deep dive • Key features • Demo • Q&A 2 ©2013Cloudera, Inc. All Rights Reserved.
- 3. Delivering What the Enterprise Requires Cloudera’s Primary Focus Areas Business IT Build a Solution For New & Deliver a Production-Ready System Better Data Management Build a system that is easy-to-use and integrates with Enterprise IT Revolutionize how enterprises manage and use their data Use Familiar Tools Access More Data Reduced Risk Price-Performance Get Faster Results Ask New Questions Robust Management Seamless Integration 3 ©2013Cloudera, Inc. All Rights Reserved.
- 4. Building a Production-Ready System Continual Focus & Execution Over 4 Years… Business GET FASTER RESULTS ENTERPRISE READINESS Business USE FAMILIAR TOOLS IT Business REDUCED RISK IT PRICE-PERFORMANCE ACCESS MORE DATA ASK NEW QUESTIONS REDUCED RISK IT SEAMLESS INTEGRATION HIGH AVAILABILITY PRICE-PERFORMANCE REAL-TIME QUERY IT REDUCED RISK SECURITY PRICE-PERFORMANCE TECHNOLOGY CERT. REDUCED RISK SYSTEM MANAGEMENT IMPROVED STABILITY HADOOP DISTRIBUTION 2009 2010 2011 2013 4 ©2013Cloudera, Inc. All Rights Reserved.
- 5. New Capabilities Cloudera Navigator, Cloudera Enterprise BDR, Cloudera Manager 4.5 ENTERPRISE READINESS REGULATORY COMPLIANCE FOR SENSITIVE DATA ••• BUSINESS CONTINUITY ••• ENTERPRISE INTEGRATION & EASIER UPGRADES 2009 2010 2011 2013 2013 5 ©2013Cloudera, Inc. All Rights Reserved.
- 6. What We Announced in Feb 2013 • Cloudera Navigator 1.0 Auditing & Access Control • Cloudera Enterprise BDR Backup and Disaster Recovery • Cloudera Manager 4.5 Interoperability, Monitoring & Integration 6 ©2013Cloudera, Inc. All Rights Reserved.
- 7. Cloudera Manager End-to-End Administration for CDH 1 Manage Easily deploy, configure & optimize clusters 2 Monitor Maintain a central view of all activity 3 Diagnose Easily identify and resolve issues 4 Integrate Use Cloudera Manager with existing tools 7 ©2013Cloudera, Inc. All Rights Reserved.
- 8. Cloudera Manager Key Features Installs the complete Hadoop stack in minutes via a wizard-based interface Gives you complete, end-to-end visibility and control over your Hadoop cluster from a single interface Allows you to manage multiple clusters from a single instance of Cloudera Manager Integrate Cloudera Manager with Active Directory Establishes the time context globally for almost all views Correlates jobs, activities, logs, system changes, configuration changes and service metrics along a single timeline to simplify diagnosis Set server roles, configure services and manage security across the cluster Gracefully start, stop and restart of services as needed Supports Administrator and Read-Only users Maintains a complete record of configuration changes with the ability to roll back to previous states Monitors dozens of service performance metrics and alerts you when you approach critical thresholds 8 ©2013 Cloudera, Inc. All Rights Reserved.
- 9. Cloudera Manager Key Features Gather, view and search Hadoop logs collected from across the cluster Scans Hadoop logs for irregularities and warns you before they impact the cluster Creates and aggregates relevant Hadoop events pertaining to system health, log messages, user services and activities and make them available for alerting and searching Generates email alerts when certain events occur Consolidates all cluster activity into a single, real-time view View information pertaining to hosts in your cluster including status, resident memory, virtual memory and roles Visualize health status and metrics across the cluster to quickly identify problem nodes and take action Visualize current and historical disk usage by user, group and directory Track MapReduce activity on the cluster by job or user Takes a snapshot of the cluster state and automatically sends it to Cloudera support to assist with resolution Easily integrate Cloudera Manager with your existing enterprise-wide management and monitoring tools 9 ©2013 Cloudera, Inc. All Rights Reserved.
- 10. Cloudera Manager 4.5 Continuing to Deliver Critical Hadoop Management Capabilities Value Proposition Making Cloudera Enterprise easier to integrate with existing systems and processes as part of a mission-critical, production-level data management infrastructure New Capabilities Rolling Advanced SNMP Node Configurable Restarts/Updates Monitoring Support Templating “Phone Home” Perform updates and Create and save Integrate with Easily deploy & expand Proactively send service restarts custom dashboards enterprise monitoring heterogeneous clusters cluster stats to without downtime tools Cloudera Support 10 ©2013Cloudera, Inc. All Rights Reserved.
- 11. Cloudera Manager 4.5 – Rolling Upgrades/Restarts • Rolling upgrades • Manage and upgrade the CDH binaries on the cluster with minimal downtime • Supports a new packaging format called “Parcels" to facilitate the upgrade mechanism • Download, distribute, and activate a new CDH version parcel all from within Cloudera Manager • Rolling restarts • Restart services with zero/minimal downtime as related to upgrades (new versions of parcels) or configuration changes. • Workflow is available at individual service level or instance level or at the entire cluster level (if HA is enabled) 11 ©2013Cloudera, Inc. All Rights Reserved.
- 12. Cloudera Manager 4.5 – Node Templating • Improved configuration management for role instances • Group an arbitrary set of roles instances (of the same type, for example, DataNodes) together and manage their configuration as a unit. Example – DN-Large, DN-Medium, DN-Small etc. • Simplifies configuring groups of roles that need to be managed differently, for example when running on nodes with heterogeneous hardware • Improved role to host assignment with Host Templates • Host Templates let you designate a set of role configuration groups that can be applied in a single operation to a host or a set of hosts. • Simplifies the process of adding hosts and instantiating the roles that should run on those hosts 12 ©2013Cloudera, Inc. All Rights Reserved.
- 13. Cloudera Manager 4.5 – Charts & SNMP • Advanced charting • Provides intuitive and customizable charts to display relevant time- series metrics across the board (services, role instances, hosts) • Helps better correlate metrics from services to roles to hosts • Includes a new "Charts" tab to create (and save) dashboards of metrics to enable quick diagnostics/trouble shooting • SNMP Support • Makes alerts available as SNMP traps which enables easier integration with IT management tools such as IBM Tivoli, HP Openview, and others • Automated cluster statistics • Scheduled, periodic diagnostics gathering enable Cloudera Support to proactively address customer issues 13 ©2013Cloudera, Inc. All Rights Reserved.
- 14. Cloudera Manager 4.5 – Other Features • Resource Management • Enables partitioning of cluster resources (CPU, memory) across different services (MapReduce, Impala etc.) in use. • Broader service management (Hive, Impala) support • Manage a CDH POC clusters on Amazon (AWS) • Event search usability • Improved Error handling • Support for HBase REST and Thrift servers • HBase monitoring improvements: • New health checks, metrics (Region Server etc.), events (track compactions, splits), periodic 'hbck' (HBase canary) etc. • Automatic creation of Oozie ShareLib when adding an Oozie service 14 ©2013Cloudera, Inc. All Rights Reserved.
- 15. Demo 15 ©2013Cloudera, Inc. All Rights Reserved.
- 16. Why Cloudera Manager Simple End-to-End Hadoop administration in a single tool Intelligent Manages Hadoop at a system level – Cloudera’s experience realized in software Efficient Simplifies complex workflows & makes administrators more productive Best-in-Class The only enterprise-grade Hadoop management application available 16 ©2013Cloudera, Inc. All Rights Reserved.
- 17. Q&A • Type it in the “Q&A” panel Download cloudera.com/downloads • Recording will be available on demand at cloudera.com Learn more about Cloudera Manager • After webinar, inquire at http://bit.ly/ZMx4Mf info@cloudera.com Part 1: What the Enterprise Requires – Business Continuity and Visibility http://www.cloudera.com/content/cloude Thank you for attending! ra/en/resources.html 17 ©2013Cloudera, Inc. All Rights Reserved.
- 18. Key Features Cloudera Manager 18
- 19. Install A Cluster In 3 Simple Steps Cloudera Manager Key Features 1 Find Nodes 2 Install Components 3 Assign Roles Enter the names of the hosts which will be Cloudera Manager automatically installs the CDH Verify the roles of the nodes within your cluster. included in the Hadoop cluster. Click Continue. components on the hosts you specified. Make changes as necessary. 19
- 20. View Service Health & Performance Cloudera Manager Key Features 20
- 21. Get Host-Level Snapshots Cloudera Manager Key Features 21
- 22. Monitor & Diagnose Cluster Workloads Cloudera Manager Key Features 22
- 23. Gather, View & Search Hadoop Logs Cloudera Manager Key Features 23
- 24. Track Events From Across The Cluster Cloudera Manager Key Features 24
- 25. Report On System Performance & Usage Cloudera Manager Key Features 25
- 26. Visualize Health Status With Heatmaps Cloudera Manager Key Features 26
- 27. Manage Multiple CDH Clusters Cloudera Manager Key Features 27
- 28. Easily Configure High Availability Cloudera Manager Key Features 28
- 29. Set The Time Context Globally Cloudera Manager Key Features 29
- 30. Manage Backup & DR Cloudera Manager Key Features 30
- 31. Create Customized Reports Cloudera Manager Key Features 31
- 32. Create Node Role Templates Cloudera Manager Key Features 32
- 33. Rolling Upgrades Cloudera Manager Key Features 33