Project using kafka spark mongo db project
0 likes47 views
This document outlines the need for a low-cost, open source, and highly customizable real-time monitoring solution across data centers. It lists the key components as Kafka, Spark, MongoDB, and optional Spring and R Studio/Runtime along with their versions and links. It also includes a section on the overall technology stack and project architecture for an end-to-end monitoring flow.
Project using kafka spark mongo db project
- 1. Project Details – Business Stories • Need to implement end to end real time monitoring solutions across data centers. • Low Cost integrated solution. (Preferably open source stack) • Highly customizable and scalable. • Reports. • Performance Efficient.
- 2. Components Version Links Kafka 1.1.x https://kafka.apache.org/downloads Spark 2.2.x https://spark.apache.org/ MongoDB 3.0.x https://www.mongodb.com/ Spring (Optional) 3.x https://spring.io/ R Studio 1.x https://www.rstudio.com/products/rstudio/download/#download R Runtime 3.0.x https://cran.r-project.org/bin/windows/base/ Google Graphs latest https://developers.google.com/chart/interactive/docs/quick_start Technology Stack
- 3. Project Architecture – End to End flow