SlideShare a Scribd company logo
Berlin Apache Flink Meetup #9
Community Update
July 2015
Robert Metzger
Committer and PMC Member
rmetzger@apache.org
@rmetzger_
Apache Flink is an open source platform for
scalable batch and stream data processing.
Apache Flink is …
flink.apache.org 1
• The core of Flink is a distributed
streaming dataflow engine.
• Executing dataflows in
parallel on clusters
• Providing a reliable
foundation for various
workloads
• DataSet and DataStream
programming abstractions are
the foundation for user programs
and higher layers
One engine for many use cases
flink.apache.org 2
Real time streaming
topologies
Machine Learning at scale
Graph Analysis
Long batch
pipelines
What happened?
• Flink on Wikipedia:
https://en.wikipedia.org/wiki/Apache_Flink
• New JobManager Dashboard
• Apache SAMOA 0.3.0-incubating with
Flink integration
• New “Features” page
• Contributors list (can you spot your
name?)
https://cwiki.apache.org/confluence/display/
FLINK/List+of+contributors
flink.apache.org 3
New JobManager Dashboard
flink.apache.org 4
New JobManager Dashboard
flink.apache.org 5
New Features page
flink.apache.org 6
New Architecture diagram in 0.10
documentation
flink.apache.org 7
Now in master (0.10-SNAPSHOT)
flink.apache.org 8
• Low watermarks / Event time
• New JM Dashboard
• Akka messages are now aware of leader
IDs (for HA)
• Zookeeper integration (for HA)
• Live accumulators (runtime only)
• Stability improvements
Articles and Meetups
flink.apache.org 9
1. Meetup in Chicago
(Slides [2])
Meetup in Hamburg [3]
[1] http://www.diva-portal.org/smash/get/diva2:843219/FULLTEXT01.pdf
[2] http://www.slideshare.net/sbaltagi/overview-of-apacheflinkbyslimbaltagi
[3] https://www.smaato.com/big-data-nosql-meetup-hamburg-with-apache-flink-at-smaato/
• Master Thesis: Streaming Predictive Analytics on Apache Flink [1]
Happy users on Twitter
flink.apache.org 10
GitHub stats
flink.apache.org 11
520+ Stars
Upcoming
• Chicago: Flink Training @ Capital One
• Bay Area: Stream & Graph Processing @
MapR
flink.apache.org 12
Flink Forward registration & call for
abstracts is open now
flink.apache.org 13
• 12/13 October 2015
• Kulturbrauerei Berlin
• With Flink Workshops / Trainings!

More Related Content

PPTX
August Flink Community Update
PPTX
Berlin Apache Flink Meetup May 2015, Community Update
PPTX
Flink September 2015 Community Update
PPTX
Flink Community Update December 2015: Year in Review
PPTX
Apache Flink Community Updates November 2016 @ Berlin Meetup
PPTX
Riding the Streaming Wave DIY style
PPTX
Apache flink
PPTX
Apache Flink Online Training
August Flink Community Update
Berlin Apache Flink Meetup May 2015, Community Update
Flink September 2015 Community Update
Flink Community Update December 2015: Year in Review
Apache Flink Community Updates November 2016 @ Berlin Meetup
Riding the Streaming Wave DIY style
Apache flink
Apache Flink Online Training

What's hot (20)

PDF
Apache flink
PPTX
Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...
PPTX
Kostas Tzoumas_Stephan Ewen - Keynote -The maturing data streaming ecosystem ...
PPTX
Taking a look under the hood of Apache Flink's relational APIs.
PPTX
Flink Forward Berlin 2017: Till Rohrmann - From Apache Flink 1.3 to 1.4
PDF
Apache Kafka & Kafka Connectを に使ったデータ連携パターン(改めETLの実装)
PPTX
The Past, Present, and Future of Apache Flink®
PDF
Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...
PPTX
Robust Stream Processing with Apache Flink
PPTX
Flink 1.0-slides
PPTX
Introduction to Apache Flink at Vienna Meet Up
PPTX
Flink Forward Berlin 2017: Hao Wu - Large Scale User Behavior Analytics by Flink
PPTX
From Apache Flink® 1.3 to 1.4
PPTX
Apache Flink and what it is used for
PDF
Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...
PDF
Social connections14: Super charge your API’s with Reactive streams
PPTX
Sitecore Data Exchange Framework
PDF
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
PPTX
Deploying and Operating KSQL
PPTX
Counting Elements in Streams
Apache flink
Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...
Kostas Tzoumas_Stephan Ewen - Keynote -The maturing data streaming ecosystem ...
Taking a look under the hood of Apache Flink's relational APIs.
Flink Forward Berlin 2017: Till Rohrmann - From Apache Flink 1.3 to 1.4
Apache Kafka & Kafka Connectを に使ったデータ連携パターン(改めETLの実装)
The Past, Present, and Future of Apache Flink®
Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...
Robust Stream Processing with Apache Flink
Flink 1.0-slides
Introduction to Apache Flink at Vienna Meet Up
Flink Forward Berlin 2017: Hao Wu - Large Scale User Behavior Analytics by Flink
From Apache Flink® 1.3 to 1.4
Apache Flink and what it is used for
Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...
Social connections14: Super charge your API’s with Reactive streams
Sitecore Data Exchange Framework
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Deploying and Operating KSQL
Counting Elements in Streams
Ad

Viewers also liked (14)

PPTX
Apache Flink Community Update March 2015
PPTX
GOTO Night Amsterdam - Stream processing with Apache Flink
PPTX
Apache Flink Deep-Dive @ Hadoop Summit 2015 in San Jose, CA
PPTX
Flink Community Update April 2015
PPTX
Unified batch and stream processing with Flink @ Big Data Beers Berlin May 2015
PPTX
Community Update May 2016 (January - May) | Berlin Apache Flink Meetup
PPTX
January 2016 Flink Community Update & Roadmap 2016
PPTX
Flink Streaming
PPTX
QCon London - Stream Processing with Apache Flink
PPTX
Apache Flink Hands On
PPTX
Architecture of Flink's Streaming Runtime @ ApacheCon EU 2015
PPTX
A Data Streaming Architecture with Apache Flink (berlin Buzzwords 2016)
PPTX
Click-Through Example for Flink’s KafkaConsumer Checkpointing
PPT
Step-by-Step Introduction to Apache Flink
Apache Flink Community Update March 2015
GOTO Night Amsterdam - Stream processing with Apache Flink
Apache Flink Deep-Dive @ Hadoop Summit 2015 in San Jose, CA
Flink Community Update April 2015
Unified batch and stream processing with Flink @ Big Data Beers Berlin May 2015
Community Update May 2016 (January - May) | Berlin Apache Flink Meetup
January 2016 Flink Community Update & Roadmap 2016
Flink Streaming
QCon London - Stream Processing with Apache Flink
Apache Flink Hands On
Architecture of Flink's Streaming Runtime @ ApacheCon EU 2015
A Data Streaming Architecture with Apache Flink (berlin Buzzwords 2016)
Click-Through Example for Flink’s KafkaConsumer Checkpointing
Step-by-Step Introduction to Apache Flink
Ad

Similar to Flink Cummunity Update July (Berlin Meetup) (20)

PDF
Bay Area Apache Flink Meetup Community Update August 2015
PDF
Flink Community Update 2015 June
PPTX
Overview of Apache Flink: Next-Gen Big Data Analytics Framework
PDF
Apache flink
PPTX
Apache Fink 1.0: A New Era for Real-World Streaming Analytics
PPTX
Overview of Apache Fink: the 4 G of Big Data Analytics Frameworks
PPTX
Overview of Apache Flink: the 4G of Big Data Analytics Frameworks
PPTX
Overview of Apache Fink: The 4G of Big Data Analytics Frameworks
PPTX
Apache Flink First Half of 2015 Community Update
PPTX
Robust stream processing with Apache Flink
PDF
DBCC 2021 - FLiP Stack for Cloud Data Lakes
PPTX
Flink in action
PPTX
Apache Flink: Past, Present and Future
PPTX
Unified Batch and Real-Time Stream Processing Using Apache Flink
PDF
Cloud lunch and learn real-time streaming in azure
PDF
Real time cloud native open source streaming of any data to apache solr
PPTX
Why apache Flink is the 4G of Big Data Analytics Frameworks
PDF
E2E Data Pipeline - Apache Spark/Airflow/Livy
PPTX
Apache-Flink-What-How-Why-Who-Where-by-Slim-Baltagi
PDF
Real time stock processing with apache nifi, apache flink and apache kafka
Bay Area Apache Flink Meetup Community Update August 2015
Flink Community Update 2015 June
Overview of Apache Flink: Next-Gen Big Data Analytics Framework
Apache flink
Apache Fink 1.0: A New Era for Real-World Streaming Analytics
Overview of Apache Fink: the 4 G of Big Data Analytics Frameworks
Overview of Apache Flink: the 4G of Big Data Analytics Frameworks
Overview of Apache Fink: The 4G of Big Data Analytics Frameworks
Apache Flink First Half of 2015 Community Update
Robust stream processing with Apache Flink
DBCC 2021 - FLiP Stack for Cloud Data Lakes
Flink in action
Apache Flink: Past, Present and Future
Unified Batch and Real-Time Stream Processing Using Apache Flink
Cloud lunch and learn real-time streaming in azure
Real time cloud native open source streaming of any data to apache solr
Why apache Flink is the 4G of Big Data Analytics Frameworks
E2E Data Pipeline - Apache Spark/Airflow/Livy
Apache-Flink-What-How-Why-Who-Where-by-Slim-Baltagi
Real time stock processing with apache nifi, apache flink and apache kafka

More from Robert Metzger (8)

PDF
How to Contribute to Apache Flink (and Flink at the Apache Software Foundation)
PDF
dA Platform Overview
PDF
Apache Flink @ Tel Aviv / Herzliya Meetup
PPTX
Chicago Flink Meetup: Flink's streaming architecture
PPTX
Flink Community Update February 2015
PDF
Compute "Closeness" in Graphs using Apache Giraph.
PDF
Stratosphere System Overview Big Data Beers Berlin. 20.11.2013
ODP
Stratosphere Intro (Java and Scala Interface)
How to Contribute to Apache Flink (and Flink at the Apache Software Foundation)
dA Platform Overview
Apache Flink @ Tel Aviv / Herzliya Meetup
Chicago Flink Meetup: Flink's streaming architecture
Flink Community Update February 2015
Compute "Closeness" in Graphs using Apache Giraph.
Stratosphere System Overview Big Data Beers Berlin. 20.11.2013
Stratosphere Intro (Java and Scala Interface)

Recently uploaded (20)

PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Electronic commerce courselecture one. Pdf
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
GDG Cloud Iasi [PUBLIC] Florian Blaga - Unveiling the Evolution of Cybersecur...
PDF
cuic standard and advanced reporting.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Empathic Computing: Creating Shared Understanding
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
breach-and-attack-simulation-cybersecurity-india-chennai-defenderrabbit-2025....
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Approach and Philosophy of On baking technology
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
KodekX | Application Modernization Development
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Electronic commerce courselecture one. Pdf
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
GDG Cloud Iasi [PUBLIC] Florian Blaga - Unveiling the Evolution of Cybersecur...
cuic standard and advanced reporting.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Reach Out and Touch Someone: Haptics and Empathic Computing
Empathic Computing: Creating Shared Understanding
Network Security Unit 5.pdf for BCA BBA.
Diabetes mellitus diagnosis method based random forest with bat algorithm
breach-and-attack-simulation-cybersecurity-india-chennai-defenderrabbit-2025....
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Approach and Philosophy of On baking technology
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
“AI and Expert System Decision Support & Business Intelligence Systems”
Unlocking AI with Model Context Protocol (MCP)
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
KodekX | Application Modernization Development
The AUB Centre for AI in Media Proposal.docx
Dropbox Q2 2025 Financial Results & Investor Presentation

Flink Cummunity Update July (Berlin Meetup)

  • 1. Berlin Apache Flink Meetup #9 Community Update July 2015 Robert Metzger Committer and PMC Member rmetzger@apache.org @rmetzger_
  • 2. Apache Flink is an open source platform for scalable batch and stream data processing. Apache Flink is … flink.apache.org 1 • The core of Flink is a distributed streaming dataflow engine. • Executing dataflows in parallel on clusters • Providing a reliable foundation for various workloads • DataSet and DataStream programming abstractions are the foundation for user programs and higher layers
  • 3. One engine for many use cases flink.apache.org 2 Real time streaming topologies Machine Learning at scale Graph Analysis Long batch pipelines
  • 4. What happened? • Flink on Wikipedia: https://en.wikipedia.org/wiki/Apache_Flink • New JobManager Dashboard • Apache SAMOA 0.3.0-incubating with Flink integration • New “Features” page • Contributors list (can you spot your name?) https://cwiki.apache.org/confluence/display/ FLINK/List+of+contributors flink.apache.org 3
  • 8. New Architecture diagram in 0.10 documentation flink.apache.org 7
  • 9. Now in master (0.10-SNAPSHOT) flink.apache.org 8 • Low watermarks / Event time • New JM Dashboard • Akka messages are now aware of leader IDs (for HA) • Zookeeper integration (for HA) • Live accumulators (runtime only) • Stability improvements
  • 10. Articles and Meetups flink.apache.org 9 1. Meetup in Chicago (Slides [2]) Meetup in Hamburg [3] [1] http://www.diva-portal.org/smash/get/diva2:843219/FULLTEXT01.pdf [2] http://www.slideshare.net/sbaltagi/overview-of-apacheflinkbyslimbaltagi [3] https://www.smaato.com/big-data-nosql-meetup-hamburg-with-apache-flink-at-smaato/ • Master Thesis: Streaming Predictive Analytics on Apache Flink [1]
  • 11. Happy users on Twitter flink.apache.org 10
  • 13. Upcoming • Chicago: Flink Training @ Capital One • Bay Area: Stream & Graph Processing @ MapR flink.apache.org 12
  • 14. Flink Forward registration & call for abstracts is open now flink.apache.org 13 • 12/13 October 2015 • Kulturbrauerei Berlin • With Flink Workshops / Trainings!

Editor's Notes