Kapacitor Stream Processing
1 like559 views
The document provides an overview of Kapacitor, a data processing tool, detailing its installation process and various use cases like ETL preprocessing, alerting on changes, and autoscaling services. It includes installation commands and links to additional resources for learning TickScript. Use cases are emphasized, showcasing how multiple features can be combined for enhanced data processing capabilities.
Kapacitor Stream Processing
- 1. Nathaniel Cook, Software Developer - Team Lead Feb 13 2018 Kapacitor
- 2. © 2018 InfluxData. All rights reserved.2 Overview • Introduction to Kapacitor • Installation Process • Explore some use cases
- 3. © 2018 InfluxData. All rights reserved.3 Introduction to Kapacitor Take action on your data Runs as separate process
- 4. © 2018 InfluxData. All rights reserved.4 Installation
- 5. © 2018 InfluxData. All rights reserved.5 Installation Steps $ wget https://dl.influxdata.com/kapacitor/releases/kapacitor_1.4.0_amd64.deb $ sudo dpkg -i kapacitor_1.4.0_amd64.deb $ kapacitord $ kapacitor define mytask -tick path/to/script.tick https://docs.influxdata.com/kapacitor/latest/introduction/getting_started/
- 6. © 2018 InfluxData. All rights reserved.6 Use Cases
- 7. © 2018 InfluxData. All rights reserved.7 Use Cases • Preprocess ETL • Postprocess ETL • Alert on Relative Change • Hot Cache • Autoscale Services • Forecast Time Series Follow along with TICKscript using: https://github.com/nathanielc/influxdaysnyc
- 8. © 2018 InfluxData. All rights reserved.8 Preprocess ETL
- 9. © 2018 InfluxData. All rights reserved.9 Preprocess ETL InfluxDBKapacitorTelegraf
- 10. © 2018 InfluxData. All rights reserved.10 Postprocess ETL
- 11. © 2018 InfluxData. All rights reserved.11 Postprocess ETL InfluxDB KapacitorTelegraf
- 12. © 2018 InfluxData. All rights reserved.12 Alert on Relative Change
- 13. © 2018 InfluxData. All rights reserved.13 Alert on Relative Change Previous Current Relative Change Difference Trigger Alert
- 14. © 2018 InfluxData. All rights reserved.14 Hot Cache
- 15. © 2018 InfluxData. All rights reserved.15 Hot Cache Kapacitor Client
- 16. © 2018 InfluxData. All rights reserved.16 Autoscale Services
- 17. © 2018 InfluxData. All rights reserved.17 Autoscaling Kapacitor Nodes Cluster Manager
- 18. © 2018 InfluxData. All rights reserved.18 Forecast
- 19. © 2018 InfluxData. All rights reserved.19 Forecast Historical Predicted Forecast Trigger Alert Current
- 20. © 2018 InfluxData. All rights reserved.20 Bring it All Together
- 21. © 2018 InfluxData. All rights reserved.21 Bring it All Together Pick Any Combination of the use cases: • Predictive Autoscaling • Preprocess to clean data before forecasting • Alert on relative change from predicted values • Alert on autoscale events • Hot cache autoscale metrics
- 22. © 2018 InfluxData. All rights reserved.22 Questions? Twitter: @nathanielvcook Github: nathanielc
- 23. Thank You