Confluent Operations Training for Apache Kafka
1 like763 views
This three-day hands-on course teaches students how to build, manage, and monitor Apache Kafka clusters using industry best practices. Students will learn how Kafka works, how to set up and manage a cluster, monitor performance, recover from failures, and secure the cluster. The course includes exercises on installing, operating, and tuning a Kafka cluster. It is designed for engineers and operations staff responsible for Kafka clusters.
Confluent Operations Training for Apache Kafka
- 1. © 2015-2017 Confluent, Inc D1_705www.confluent.io/contact OPERATIONS TRAINING Confluent Operations Training for Apache Kafka Course Objectives In this three-day hands-on course you will learn how to build, manage, and monitor clusters using industry best-practices developed by the world’s foremost Apache KafkaTM experts. You will learn how Kafka and the Confluent Platform work, their main subsystems, how they interact, and how to set up, manage, monitor, and tune your cluster. Hands-On Training Throughout the course, hands-on exercises reinforce the topics being discussed. Exercises include: »» Cluster installation »» Basic cluster operations »» Viewing and interpreting cluster metrics »» Recovering from a Broker failure »» Performance-tuning the cluster »» Securing the cluster Who Should Attend? This course is designed for engineers, system administrators, and operations staff responsible for building, managing, monitoring, and tuning Kafka clusters. Course Duration This is a three-day training course. Course Prerequisites Attendees should have a strong knowledge of Linux/Unix, and understand basic TCP/IP networking concepts. Familiarity with the Java Virtual Machine (JVM) is helpful. Prior knowledge of Kafka is helpful, but is not required. Confluent offers public training courses and private, onsite events. Please visit http://confluent.io/training for the public course schedule. For inquiries about onsite events, email training-admin@confluent.io Introduction The Motivation for Apache Kafka • Systems Complexity • Real-Time Processing is Becoming Prevalent • Kafka: A Stream Data Platform Kafka Fundamentals • An Overview of Kafka • Kafka Producers • Kafka Brokers • Kafka Consumers • Kafka’s Use of ZooKeeper • Comparisons with Traditional Message Queues Providing Durability • Basic Replication Concepts • Durability Through Intra-Cluster Replication • Writing Data to Kafka Reliably • Broker Shutdown and Failures • Controllers in the Cluster • The Kafka Log Files • Offset Management Designing for High Availability • Kafka Reference Architecture • Brokers • ZooKeeper • Connect • Schema Registry • REST Proxy • Multiple Data Centers Managing a Kafka Cluster • Installing and Running Kafka • Monitoring Kafka • Basic Cluster Management • Log Retention and Compaction • An Elastic Cluster Optimizing Kafka Performance • Producer Performance • Broker Performance • Broker Failures and Recovery Time • Load Balancing Consumption • Consumption Performance • Performance Testing Kafka Security • SSL for Encryption and Authentication • SASL for Authentication • Data at Rest Encryption • Securing ZooKeeper and the REST Proxy • Migration to a Secure Cluster Integrating Systems with Kafka Connect • The Motivation for Kafka Connect • Types of Connectors • Kafka Connect Implementation • Standalone and Distributed Modes • Configuring the Connectors • Deployment Considerations • Comparison with Other Systems Conclusion