Manage Hadoop Cluster with Ambari
0 likes553 views
Apache Ambari is a 100% open source platform for provisioning, managing, and monitoring Apache Hadoop clusters. It provides installation and configuration of Hadoop services across a cluster, as well as monitoring of cluster health and performance through a centralized dashboard. Key features of Ambari include installing and configuring Hadoop services on Linux hosts via agents, managing service tasks like reassigning the namenode, centralized cluster configuration, and monitoring the cluster through an overall dashboard and views by host and service. Ambari helps simplify Hadoop cluster management and operations.
Manage Hadoop Cluster with Ambari
- 1. Mr. Charnsilp Chinprasert Email: charnsilp.chin@gmail.com Apache Ambari A Hadoop management simpler
- 2. Apache Hadoop The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models.
- 5. แก้ไข Config ทั้ง Cluster ยังไง?
- 7. Install แต่ละ Service ยังไง?
- 8. Config ยังไง แต่ละ Service ไม่เหมือนกัน?
- 12. What is Apache Ambari? The Apache Ambari a 100% open source platform provisioning, managing and monitoring Apache Hadoop Cluster
- 13. Hadoop Ecosystem
- 15. Apache Ambari • Agent Installation • Service Installation • Service Management • Cluster Configuration • OverAll Dashboard • By Host • By Service • Alert Trigger Provisioning Monitoring Management
- 16. Welcome Ambari!
- 18. System Architecture Ambari Server Linux Server Linux Server Ambari Agent Linux Server Ambari Agent Linux Server Ambari Agent Ambari Agent Port: 8440/8441(SSL) Ambari Web Ambari Api
- 19. Installation Agent ❖ Provisioning by remote Secure Shell (SSH) ❖ OS Support ❖ RHEL (Redhat Enterprise Linux) ❖ SLES (SuSE Linux Enterprise Server) ❖ Ubuntu ❖ Debian Ambari Server Linux Server Ambari Server Linux Server Ambari Agent SSH SSH ambari-server start
- 20. Setup Cluster
- 21. Installation Agent • Cluster name • Stacks version • Remote Repos • Local Repos
- 22. Installation Agent • Target Hosts • FQDN • SSH private key
- 23. Installation Agent Host Checks • มีกระบวนการตรวจสอบและconfig OS ให้พร้อมกัน Environment ของHadoop • ทำให้ Linux ที่นำมาติดตั้งไม่จำเป็นต้อง ลงApplication ใดๆเลย • ถ้ายังไม่ได้ Install หรือ Config Ambari จะจัดการให้ • ใช้ Puppet
- 24. Install & Configure Services Select Services Assign Masters Assign Slaves & Clients Customize Services Review & Confirm
- 25. Install & Configure Services Select Services Assign Masters Assign Slaves & Clients Customize Services Review & Confirm
- 26. Install & Configure Services Select Services Assign Masters Assign Slaves & Clients Customize Services Review & Confirm
- 27. Install & Configure Services Select Services Assign Masters Assign Slaves & Clients Customize Services Review & Confirm
- 28. Install & Configure Services Select Services Assign Masters Assign Slaves & Clients Customize Services Review & Confirm
- 29. Installing
- 30. Installing
- 31. Installing
- 32. Welcome Ambari!
- 40. แก้ไขConfig ทั้ง Cluster ยังไง?
- 41. Cluster Configuration Config ที่เดียว มีผลทั้งCluster Basic View สำหรับ Configส่วนที่จำเป็นและสำคัญ!! Service Management Cluster Configuration
- 43. Cluster Configuration Compare Code ระหว่าง version ได้!!! Service Management Cluster Configuration
- 47. Monitoring
- 48. Dashboard Dashboard By Service By Host Alert Trigger
- 49. By Service Dashboard By Service By Host Alert Trigger
- 50. By Host Dashboard By Service By Host Alert Trigger
- 51. Alert Trigger Dashboard By Service By Host Alert Trigger
- 52. Apache Ambari • Agent Installation • Service Installation • Service Management • Cluster Configuration • OverAll Dashboard • By Host • By Service • Alert Trigger Provisioning Monitoring Management
- 53. Q&A • https://ambari.apache.org • https://issues.apache.org/jira/secure/attachment/12559939/Ambari_Architecture.pdf • http://www.slideshare.net/hortonworks/ambari-agentregistrationflow-17041261 • https://cwiki.apache.org/confluence/display/AMBARI/Technology+Stack • http://www.throughwave.co.th/2011/11/10/enterprise-apache-hadoop/ • http://www.slideshare.net/hortonworks/apache-ambari-whats-new-in-200
- 54. Thank you