Berlin Apache Flink Meetup May 2015, Community Update
Download as PPTX, PDF0 likes467 views
This document summarizes the May 2015 community update for Apache Flink. Key updates include a pull request to integrate Flink with Zeppelin, plans to fix issues for the upcoming 0.9 release, and work on the Gelly graph processing API. The document also mentions new meetup groups in Stockholm and Bay Area, frontpage redesign of the Flink website, and that Flink now supports exactly-once streaming processing with Kafka sources in the 0.9 snapshot release.
![Articles and Meetups
• Juggling with Bits and Bytes [1]
• Apache Flink@ Strata & Hadoop World London (Slides) [2]
• Real-time stream processing: The next step for Apache Flink [3]
flink.apache.org 7
Meetup in BudapestMeetup in Stockholm
[1] http://flink.apache.org/news/2015/05/11/Juggling-with-Bits-and-Bytes.html
[2] http://www.slideshare.net/stephanewen1/apache-flink-strata-hadoop-world-london
[3] http://data-artisans.com/stream-processing-with-flink.html also posted on:
http://blog.confluent.io/2015/05/06/real-time-stream-processing-the-next-step-for-apache-flink/](https://image.slidesharecdn.com/flinkcommunityupdate-150528081920-lva1-app6891/85/Berlin-Apache-Flink-Meetup-May-2015-Community-Update-8-320.jpg)
Berlin Apache Flink Meetup May 2015, Community Update
- 1. Berlin Apache Flink Meetup #7 Community Update May 2015 Robert Metzger Committer and PMC Member rmetzger@apache.org @rmetzger_
- 2. Apache Flink is an open source platform for scalable batch and stream data processing. Apache Flink is … flink.apache.org 1 • The core of Flink is a distributed streaming dataflow engine. • Executing dataflows in parallel on clusters • Providing a reliable foundation for various workloads • DataSet and DataStream programming abstractions are the foundation for user programs and higher layers
- 3. One engine for many use cases flink.apache.org 2 Real time streaming topologies Machine Learning at scale Graph Analysis Long batch pipelines
- 4. What happened? • Zeppelin on Flink pull request at Zeppelin project opened • Community agreed on a list of issues to fix for 0.9 (its coming closer) • Static Code Analysis pull request opened • Gelly roadmap + upcoming blog post • Gelly Scala API is in progress … • Stockholm and Bay Area Meetup groups started flink.apache.org 3
- 7. Now in master (0.9-SNAPSHOT) flink.apache.org 6 • Reworked streaming fault tolerance with KafkaSources (allowing exactly-once- processing in Flink). New state backend (file system) • Pipelines in Flink ML (similar to scikit- learn) + a lot of activity in ML • Batch / Streaming mode switch • Stability improvements
- 8. Articles and Meetups • Juggling with Bits and Bytes [1] • Apache Flink@ Strata & Hadoop World London (Slides) [2] • Real-time stream processing: The next step for Apache Flink [3] flink.apache.org 7 Meetup in BudapestMeetup in Stockholm [1] http://flink.apache.org/news/2015/05/11/Juggling-with-Bits-and-Bytes.html [2] http://www.slideshare.net/stephanewen1/apache-flink-strata-hadoop-world-london [3] http://data-artisans.com/stream-processing-with-flink.html also posted on: http://blog.confluent.io/2015/05/06/real-time-stream-processing-the-next-step-for-apache-flink/
- 9. GitHub stats flink.apache.org 8 +134 +108 In 3 months:
- 10. We are going to offer a second Flink Workshop in Berlin flink.apache.org 9
- 11. Flink Forward registration & call for abstracts is open now flink.apache.org 10 • 12/13 October 2015 • Kulturbrauerei Berlin • With Flink Workshops / Trainings!
Editor's Notes
- #10: in 3 month