SlideShare a Scribd company logo
Jan 27, 2018
IPT – Intellectual
Products & Technologies
Reactive
Microservices
with Spring 5
WebFlux
Trayan Iliev
tiliev@iproduct.org
http://iproduct.org
Copyright © 2003-2018 IPT - Intellectual
Products & Technologies
2
Reactive Microservices with Spring 5 WebFlux
 Introduction to FRP, Reactive Streams spec
 Project Reactor
 REST services with Spring 5: WebFlux
 Router, handler and filter functions
 Reactive repositories and reactive database access
with Spring Data. Building
 End-to-end non-blocking reactive SOA with Netty
 Reactive WebClients and integration testing
 Realtime event streaming to JS clients using SSE
3
Reactive Microservices with Spring 5 WebFlux
 Introduction to FRP, Reactive Streams spec
 Project Reactor
 REST services with Spring 5: WebFlux
 Router, handler and filter functions
 Reactive repositories and reactive database access
with Spring Data. Building
 End-to-end non-blocking reactive SOA with Netty
 Reactive WebClients and integration testing
 Realtime event streaming to JS clients using SSEBest Explained in Code
About me
4
Trayan Iliev
– CEO of IPT – Intellectual Products &
Technologies
– Oracle®
certified programmer 15+ Y
– end-to-end reactive fullstack apps with Java,
ES6/7, TypeScript, Angular, React and Vue.js
– 12+ years IT trainer
– Voxxed Days, jPrime, jProfessionals,
BGOUG, BGJUG, DEV.BG speaker
– Organizer RoboLearn hackathons and IoT
enthusiast (http://robolearn.org)
5
Since 2003: IT Education Evolved
 Spring, Java SE/Web/EE 7/8/9, JSF
 Reactive IoT with Reactor / RxJava / RxJS
 Node.js + Express + React + Redux + GraphQL
 Angular + TypeScript + Redux (ngrx)
 SOA & REST HATEOAS
 DDD & Reactive Microservices
IPT - Intellectual Products & Technologies
http://www.iproduct.org
Where to Find the Demo Code?
6
Spring 5 WebFlux demos available @ GitHub:
https://github.com/iproduct/spring-5-webflux
Data / Event / Message Streams
7
“Conceptually, a stream is a (potentially never-ending)
flow of data records, and a transformation is an
operation that takes one or more streams as input,
and produces one or more output streams as a
result.”
Apache Flink: Dataflow Programming Model
Data Stream Programming
8
The idea of abstracting logic from execution is hardly
new -- it was the dream of SOA. And the recent
emergence of microservices and containers shows that
the dream still lives on.
For developers, the question is whether they want to
learn yet one more layer of abstraction to their coding.
On one hand, there's the elusive promise of a common
API to streaming engines that in theory should let you
mix and match, or swap in and swap out.
Tony Baer (Ovum) @ ZDNet - Apache Beam and Spark:
New coopetition for squashing the Lambda Architecture?
Lambda Architecture - I
9
https://commons.wikimedia.org/w/index.php?curid=34963986, By Textractor - Own work, CC BY-SA 4
Lambda Architecture - II
10
https://commons.wikimedia.org/w/index.php?curid=34963987, By Textractor - Own work, CC BY-SA 4
Lambda Architecture - III
11
 Data-processing architecture designed to handle
massive quantities of data by using both batch- and
stream-processing methods
 Balances latency, throughput, fault-tolerance, big
data, real-time analytics, mitigates the latencies of
map-reduce
 Data model with an append-only, immutable data
source that serves as a system of record
 Ingesting and processing timestamped events that are
appended to existing events. State is determined from
the natural time-based ordering of the data.
Druid Distributed Data Store (Java)
12
https://commons.wikimedia.org/w/index.php?curid=33899448 By Fangjin Yang - sent to me personally, GFDL
Apache
ZooKeeper
MySQL /
PostgreSQL
HDFS /
Amazon S3
Lambda Architecture: Projects - I
13
 Apache Spark is an open-source
cluster-computing framework. Spark
Streaming, Spark Mllib
 Apache Storm is a distributed
stream processing – streams DAG
 Apache Apex™ unified stream and
batch processing engine.
Lambda Architecture: Projects - II
 Apache Flink - open source stream
processing framework – Java, Scala
 Apache Kafka - open-source stream
processing (Kafka Streams), real-
time, low-latency, high-throughput,
massively scalable pub/sub
 Apache Beam – unified batch and
streaming, portable, extensible
Direct Acyclic Graphs - DAG
15
Synchronous vs. Asynchronous IO
16
DB
Synchronous
A
A
B
B
DB
Asynchronous
A
B
C
D
A
B
C
D
Example: Internet of Things (IoT)
17
CC BY 2.0, Source:
https://www.flickr.com/photos/wilgengebroed/8249565455/
Radar, GPS, lidar for navigation and obstacle
avoidance ( 2007 DARPA Urban Challenge )
IoT Services Architecture
18
Devices: Hardware + Embedded Software + Firmware
UART/ I2C/ 2G/ 3G/ LTE/ ZigBee/ 6LowPan/ BLE
Aggregation/ Bus: ESB, Message Broker
Device Gateway: Local Coordination and Event Aggregation
M2M: HTTP(/2) / WS / MQTT / CoAP
Management: TR-069 / OMA-DM / OMA LWM2M
HTTP, AMQP
Cloud (Micro)Service Mng.
Docker, Kubernetes/
Apache Brooklyn
Web/ Mobile
Portal
PaaSDashboard
PaaS API: Event Processing Services, Analytics
19
 Performance is about 2 things (Martin Thompson –
http://www.infoq.com/articles/low-latency-vp ):
– Throughput – units per second, and
– Latency – response time
 Real-time – time constraint from input to response
regardless of system load.
 Hard real-time system if this constraint is not honored then
a total system failure can occur.
 Soft real-time system – low latency response with little
deviation in response time
 100 nano-seconds to 100 milli-seconds. [Peter Lawrey]
What's High Performance?
Imperative and Reactive
20
We live in a Connected Universe
... there is hypothesis that all
the things in the Universe are
intimately connected, and you
can not change a bit without
changing all.
Action – Reaction principle is
the essence of how Universe
behaves.
Imperative and Reactive
 Reactive Programming: using static or dynamic data
flows and propagation of change
Example: a := b + c
 Functional Programming: evaluation of mathematical
functions,
➢ Avoids changing-state and mutable data, declarative
programming
➢ Side effects free => much easier to understand and
predict the program behavior.
Example: books.stream().filter(book -> book.getYear() > 2010)
.forEach( System.out::println )
Functional Reactive (FRP)
22
According to Connal Elliot's (ground-breaking paper @
Conference on Functional Programming, 1997), FRP is:
(a) Denotative
(b) Temporally continuous
Reactive Manifesto
23
[http://www.reactivemanifesto.org]
24
 Message Driven – asynchronous message-passing allows
to establish a boundary between components that ensures
loose coupling, isolation, location transparency, and
provides the means to delegate errors as messages
[Reactive Manifesto].
 The main idea is to separate concurrent producer and
consumer workers by using message queues.
 Message queues can be unbounded or bounded (limited
max number of messages)
 Unbounded message queues can present memory
allocation problem in case the producers outrun the
consumers for a long period → OutOfMemoryError
Scalable, Massively Concurrent
Reactive Programming
25
 Microsoft®
opens source polyglot project ReactiveX
(Reactive Extensions) [http://reactivex.io]:
Rx = Observables + LINQ + Schedulers :)
Java: RxJava, JavaScript: RxJS, C#: Rx.NET, Scala: RxScala,
Clojure: RxClojure, C++: RxCpp, Ruby: Rx.rb, Python: RxPY,
Groovy: RxGroovy, JRuby: RxJRuby, Kotlin: RxKotlin ...
 Reactive Streams Specification
[http://www.reactive-streams.org/] used by:
 (Spring) Project Reactor [http://projectreactor.io/]
 Actor Model – Akka (Java, Scala) [http://akka.io/]
Reactive Streams Spec.
26
 Reactive Streams – provides standard for
asynchronous stream processing with non-blocking
back pressure.
 Minimal set of interfaces, methods and protocols for
asynchronous data streams
 April 30, 2015: has been released version 1.0.0 of
Reactive Streams for the JVM (Java API,
Specification, TCK and implementation examples)
 Java 9: java.util.concurrent.Flow
Reactive Streams Spec.
27
 Publisher – provider of potentially unbounded number
of sequenced elements, according to Subscriber(s)
demand.
Publisher.subscribe(Subscriber) => onSubscribe onNext*
(onError | onComplete)?
 Subscriber – calls Subscription.request(long) to
receive notifications
 Subscription – one-to-one Subscriber ↔ Publisher,
request data and cancel demand (allow cleanup).
 Processor = Subscriber + Publisher
FRP = Async Data Streams
28
 FRP is asynchronous data-flow programming using the
building blocks of functional programming (e.g. map,
reduce, filter) and explicitly modeling time
 Used for GUIs, robotics, and music. Example (RxJava):
Observable.from(
new String[]{"Reactive", "Extensions", "Java"})
.take(2).map(s -> s + " : on " + new Date())
.subscribe(s -> System.out.println(s));
Result:
Reactive : on Wed Jun 17 21:54:02 GMT+02:00 2015
Extensions : on Wed Jun 17 21:54:02 GMT+02:00 2015
Project Reactor
29
 Reactor project allows building high-performance (low
latency high throughput) non-blocking asynchronous
applications on JVM.
 Reactor is designed to be extraordinarily fast and can
sustain throughput rates on order of 10's of millions of
operations per second.
 Reactor has powerful API for declaring data
transformations and functional composition.
 Makes use of the concept of Mechanical Sympathy
built on top of Disruptor / RingBuffer.
Reactor Projects
30
https://github.com/reactor/reactor, Apache Software License 2.0
IPC – Netty, Kafka, Aeron
Reactor Flux
31
https://github.com/reactor/reactor-core, Apache Software License 2.0
Example: Flux.combineLatest()
32
https://projectreactor.io/core/docs/api/, Apache Software License 2.0
Flux & Redux Design Patterns
Source: Flux in GitHub, https://github.com/facebook/flux, License: BSD 3-clause "New" License
Source: RxJava 2 API documentation, http://reactivex.io/RxJava/2.x/javadoc/
Redux == Rx Scan Opearator
Hot and Cold Event Streams
35
 PULL-based (Cold Event Streams) – Cold streams (e.g.
RxJava Observable / Flowable or Reactor Flow / Mono)
are streams that run their sequence when and if they
are subscribed to. They present the sequence from the
start to each subscriber.
 PUSH-based (Hot Event Streams) – emit values
independent of individual subscriptions. They have their
own timeline and events occur whether someone is
listening or not. When subscription is made observer
receives current events as they happen.
Example: mouse events
Converting Cold to Hot Stream
36
Hot Stream Example - Reactor
37
EmitterProcessor<String> emitter =
EmitterProcessor.create();
FluxSink<String> sink = emitter.sink();
emitter.publishOn(Schedulers.single())
.map(String::toUpperCase)
.filter(s -> s.startsWith("HELLO"))
.delayElements(Duration.of(1000, MILLIS))
.subscribe(System.out::println);
sink.next("Hello World!"); // emit - non blocking
sink.next("Goodbye World!");
sink.next("Hello Trayan!");
Thread.sleep(3000);
Top New Features in Spring 5
38
 Reactive Programming Model
 Spring Web Flux
 Reactive DB repositories & integrations + hot event
streaming: MongoDB, CouchDB, Redis, Cassandra,
Kafka
 JDK 8+ and Java EE 7+ baseline
 Testing improvements – WebTestClient (based on
reactive WebFlux WebClient)
 Kotlin functional DSL
Project Reactor
Spring 5 Main Building Blocks
39Source: https://spring.io
Spring Boot 2.0
Reactive Stack
(async IO)
Servlet Stack
(one request per thread)
Spring Security Reactive
Every JEE Servlet Container
(tomact, jetty, undertow, ...)
Nonblocking NIO Runtimes
(Netty, Servlet 3.1 Containers)
Spring Security
Spring MVC Spring WebFlux
Spring Data Repositories
JDBC, JPA, NoSQL
Spring Data Reactive Repositories
Mongo, Cassandra, Redis, Couchbase
WebFlux: Best Expalined in Code
40
Lets see REST service Spring 5 WebFlux demos.
Available @GitHub:
https://github.com/iproduct/spring-5-webflux
Thank’s for Your Attention!
41
Trayan Iliev
CEO of IPT – Intellectual Products
& Technologies
http://iproduct.org/
http://robolearn.org/
https://github.com/iproduct
https://twitter.com/trayaniliev
https://www.facebook.com/IPT.EACAD
https://plus.google.com/+IproductOrg

More Related Content

PDF
Reactive Programming in Java and Spring Framework 5
PDF
GraphQL
PDF
Angular Observables & RxJS Introduction
PPTX
Reactive programming by spring webflux - DN Scrum Breakfast - Nov 2018
PPTX
Reactive programming intro
PPSX
Spring - Part 1 - IoC, Di and Beans
PDF
Introduction to Spring WebFlux #jsug #sf_a1
PDF
Introduction to RxJS
Reactive Programming in Java and Spring Framework 5
GraphQL
Angular Observables & RxJS Introduction
Reactive programming by spring webflux - DN Scrum Breakfast - Nov 2018
Reactive programming intro
Spring - Part 1 - IoC, Di and Beans
Introduction to Spring WebFlux #jsug #sf_a1
Introduction to RxJS

What's hot (20)

PPTX
Express js
PPTX
An Introduction To REST API
PPTX
Event-driven microservices
PDF
Rest web services
PPTX
Reactive Programming In Java Using: Project Reactor
PPTX
PDF
Node.js Express Tutorial | Node.js Tutorial For Beginners | Node.js + Expres...
PPTX
MVC Framework
PPTX
Introduction to Microservices
PPT
Advanced Jasper Reports
PPTX
Data models in NoSQL
PDF
RxJS Evolved
PPTX
Project Reactor By Example
PPTX
REST API
PDF
Introduction to Spring webflux
PPTX
Introduction to Spring Boot
PPTX
Top 10 RxJs Operators in Angular
PPTX
Spring Webflux
PDF
Spring integration을 통해_살펴본_메시징_세계
PDF
Spring boot introduction
Express js
An Introduction To REST API
Event-driven microservices
Rest web services
Reactive Programming In Java Using: Project Reactor
Node.js Express Tutorial | Node.js Tutorial For Beginners | Node.js + Expres...
MVC Framework
Introduction to Microservices
Advanced Jasper Reports
Data models in NoSQL
RxJS Evolved
Project Reactor By Example
REST API
Introduction to Spring webflux
Introduction to Spring Boot
Top 10 RxJs Operators in Angular
Spring Webflux
Spring integration을 통해_살펴본_메시징_세계
Spring boot introduction
Ad

Similar to Microservices with Spring 5 Webflux - jProfessionals (20)

PDF
Reactive Microservices with Spring 5: WebFlux
PDF
NGRX Apps in Depth
PDF
IPT Reactive Java IoT Demo - BGOUG 2018
PDF
Reactive Java Robotics and IoT - IPT Presentation @ Voxxed Days 2016
PDF
IPT High Performance Reactive Java BGOUG 2016
PDF
Making Machine Learning Easy with H2O and WebFlux
PDF
Reactive Java Robotics IoT - jPrime 2016
PDF
Reactive Java Robotics and IoT 2016
PDF
Reactive Java Robotics & IoT with Spring Reactor
PDF
Reactive robotics io_t_2017
PDF
Stream Processing with CompletableFuture and Flow in Java 9
PPTX
Microservices Part 4: Functional Reactive Programming
PDF
Java & JavaScipt Reactive Robotics and IoT 2016 @ jProfessionals
PPTX
Functional reactive programming
PDF
Reactive in Android and Beyond Rx
PPTX
Reactive Programming on Android - RxAndroid - RxJava
PDF
exploring-spring-boot-clients.pdf Spring Boot
PDF
Strata Singapore: Gearpump Real time DAG-Processing with Akka at Scale
PPTX
StrongLoop Overview
PDF
Pulsar summit asia 2021 apache pulsar with mqtt for edge computing
Reactive Microservices with Spring 5: WebFlux
NGRX Apps in Depth
IPT Reactive Java IoT Demo - BGOUG 2018
Reactive Java Robotics and IoT - IPT Presentation @ Voxxed Days 2016
IPT High Performance Reactive Java BGOUG 2016
Making Machine Learning Easy with H2O and WebFlux
Reactive Java Robotics IoT - jPrime 2016
Reactive Java Robotics and IoT 2016
Reactive Java Robotics & IoT with Spring Reactor
Reactive robotics io_t_2017
Stream Processing with CompletableFuture and Flow in Java 9
Microservices Part 4: Functional Reactive Programming
Java & JavaScipt Reactive Robotics and IoT 2016 @ jProfessionals
Functional reactive programming
Reactive in Android and Beyond Rx
Reactive Programming on Android - RxAndroid - RxJava
exploring-spring-boot-clients.pdf Spring Boot
Strata Singapore: Gearpump Real time DAG-Processing with Akka at Scale
StrongLoop Overview
Pulsar summit asia 2021 apache pulsar with mqtt for edge computing
Ad

More from Trayan Iliev (14)

PDF
Rapid Web API development with Kotlin and Ktor
PDF
Learning Programming Using Robots - Sofia University Conference 2018
PDF
Active Learning Using Connected Things - 2018 (in Bulgarian)
PDF
Spring 5 Webflux - Advances in Java 2018
PDF
Fog Computing - DEV.BG 2018
PDF
What's new in java 9?
PDF
React HOCs, Context and Observables
ODP
Hackathon: “IPTPI and LeJaRo Meet The Real World”
PDF
IPT angular2 typescript SPA 2016
PDF
New MVC 1.0 JavaEE 8 API
PDF
IPT High Performance Reactive Programming with JAVA 8 and JavaScript
PDF
IPT Workshops on Java Robotics and IoT
PDF
IPT – Java Robotics and IoT
PDF
Novelties in Java EE 7: JAX-RS 2.0 + IPT REST HATEOAS Polling Demo @ BGOUG Co...
Rapid Web API development with Kotlin and Ktor
Learning Programming Using Robots - Sofia University Conference 2018
Active Learning Using Connected Things - 2018 (in Bulgarian)
Spring 5 Webflux - Advances in Java 2018
Fog Computing - DEV.BG 2018
What's new in java 9?
React HOCs, Context and Observables
Hackathon: “IPTPI and LeJaRo Meet The Real World”
IPT angular2 typescript SPA 2016
New MVC 1.0 JavaEE 8 API
IPT High Performance Reactive Programming with JAVA 8 and JavaScript
IPT Workshops on Java Robotics and IoT
IPT – Java Robotics and IoT
Novelties in Java EE 7: JAX-RS 2.0 + IPT REST HATEOAS Polling Demo @ BGOUG Co...

Recently uploaded (20)

PPTX
Online Work Permit System for Fast Permit Processing
PDF
medical staffing services at VALiNTRY
PPTX
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
PDF
2025 Textile ERP Trends: SAP, Odoo & Oracle
PDF
Digital Strategies for Manufacturing Companies
PDF
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
PDF
How to Migrate SBCGlobal Email to Yahoo Easily
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
PPTX
Introduction to Artificial Intelligence
PPT
JAVA ppt tutorial basics to learn java programming
PDF
PTS Company Brochure 2025 (1).pdf.......
PPTX
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
PDF
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
PDF
Wondershare Filmora 15 Crack With Activation Key [2025
PDF
System and Network Administration Chapter 2
PPTX
ai tools demonstartion for schools and inter college
PDF
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
PPTX
ManageIQ - Sprint 268 Review - Slide Deck
PDF
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
Online Work Permit System for Fast Permit Processing
medical staffing services at VALiNTRY
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
2025 Textile ERP Trends: SAP, Odoo & Oracle
Digital Strategies for Manufacturing Companies
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
How to Migrate SBCGlobal Email to Yahoo Easily
Adobe Illustrator 28.6 Crack My Vision of Vector Design
Introduction to Artificial Intelligence
JAVA ppt tutorial basics to learn java programming
PTS Company Brochure 2025 (1).pdf.......
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
Wondershare Filmora 15 Crack With Activation Key [2025
System and Network Administration Chapter 2
ai tools demonstartion for schools and inter college
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
ManageIQ - Sprint 268 Review - Slide Deck
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...

Microservices with Spring 5 Webflux - jProfessionals

  • 1. Jan 27, 2018 IPT – Intellectual Products & Technologies Reactive Microservices with Spring 5 WebFlux Trayan Iliev tiliev@iproduct.org http://iproduct.org Copyright © 2003-2018 IPT - Intellectual Products & Technologies
  • 2. 2 Reactive Microservices with Spring 5 WebFlux  Introduction to FRP, Reactive Streams spec  Project Reactor  REST services with Spring 5: WebFlux  Router, handler and filter functions  Reactive repositories and reactive database access with Spring Data. Building  End-to-end non-blocking reactive SOA with Netty  Reactive WebClients and integration testing  Realtime event streaming to JS clients using SSE
  • 3. 3 Reactive Microservices with Spring 5 WebFlux  Introduction to FRP, Reactive Streams spec  Project Reactor  REST services with Spring 5: WebFlux  Router, handler and filter functions  Reactive repositories and reactive database access with Spring Data. Building  End-to-end non-blocking reactive SOA with Netty  Reactive WebClients and integration testing  Realtime event streaming to JS clients using SSEBest Explained in Code
  • 4. About me 4 Trayan Iliev – CEO of IPT – Intellectual Products & Technologies – Oracle® certified programmer 15+ Y – end-to-end reactive fullstack apps with Java, ES6/7, TypeScript, Angular, React and Vue.js – 12+ years IT trainer – Voxxed Days, jPrime, jProfessionals, BGOUG, BGJUG, DEV.BG speaker – Organizer RoboLearn hackathons and IoT enthusiast (http://robolearn.org)
  • 5. 5 Since 2003: IT Education Evolved  Spring, Java SE/Web/EE 7/8/9, JSF  Reactive IoT with Reactor / RxJava / RxJS  Node.js + Express + React + Redux + GraphQL  Angular + TypeScript + Redux (ngrx)  SOA & REST HATEOAS  DDD & Reactive Microservices IPT - Intellectual Products & Technologies http://www.iproduct.org
  • 6. Where to Find the Demo Code? 6 Spring 5 WebFlux demos available @ GitHub: https://github.com/iproduct/spring-5-webflux
  • 7. Data / Event / Message Streams 7 “Conceptually, a stream is a (potentially never-ending) flow of data records, and a transformation is an operation that takes one or more streams as input, and produces one or more output streams as a result.” Apache Flink: Dataflow Programming Model
  • 8. Data Stream Programming 8 The idea of abstracting logic from execution is hardly new -- it was the dream of SOA. And the recent emergence of microservices and containers shows that the dream still lives on. For developers, the question is whether they want to learn yet one more layer of abstraction to their coding. On one hand, there's the elusive promise of a common API to streaming engines that in theory should let you mix and match, or swap in and swap out. Tony Baer (Ovum) @ ZDNet - Apache Beam and Spark: New coopetition for squashing the Lambda Architecture?
  • 9. Lambda Architecture - I 9 https://commons.wikimedia.org/w/index.php?curid=34963986, By Textractor - Own work, CC BY-SA 4
  • 10. Lambda Architecture - II 10 https://commons.wikimedia.org/w/index.php?curid=34963987, By Textractor - Own work, CC BY-SA 4
  • 11. Lambda Architecture - III 11  Data-processing architecture designed to handle massive quantities of data by using both batch- and stream-processing methods  Balances latency, throughput, fault-tolerance, big data, real-time analytics, mitigates the latencies of map-reduce  Data model with an append-only, immutable data source that serves as a system of record  Ingesting and processing timestamped events that are appended to existing events. State is determined from the natural time-based ordering of the data.
  • 12. Druid Distributed Data Store (Java) 12 https://commons.wikimedia.org/w/index.php?curid=33899448 By Fangjin Yang - sent to me personally, GFDL Apache ZooKeeper MySQL / PostgreSQL HDFS / Amazon S3
  • 13. Lambda Architecture: Projects - I 13  Apache Spark is an open-source cluster-computing framework. Spark Streaming, Spark Mllib  Apache Storm is a distributed stream processing – streams DAG  Apache Apex™ unified stream and batch processing engine.
  • 14. Lambda Architecture: Projects - II  Apache Flink - open source stream processing framework – Java, Scala  Apache Kafka - open-source stream processing (Kafka Streams), real- time, low-latency, high-throughput, massively scalable pub/sub  Apache Beam – unified batch and streaming, portable, extensible
  • 16. Synchronous vs. Asynchronous IO 16 DB Synchronous A A B B DB Asynchronous A B C D A B C D
  • 17. Example: Internet of Things (IoT) 17 CC BY 2.0, Source: https://www.flickr.com/photos/wilgengebroed/8249565455/ Radar, GPS, lidar for navigation and obstacle avoidance ( 2007 DARPA Urban Challenge )
  • 18. IoT Services Architecture 18 Devices: Hardware + Embedded Software + Firmware UART/ I2C/ 2G/ 3G/ LTE/ ZigBee/ 6LowPan/ BLE Aggregation/ Bus: ESB, Message Broker Device Gateway: Local Coordination and Event Aggregation M2M: HTTP(/2) / WS / MQTT / CoAP Management: TR-069 / OMA-DM / OMA LWM2M HTTP, AMQP Cloud (Micro)Service Mng. Docker, Kubernetes/ Apache Brooklyn Web/ Mobile Portal PaaSDashboard PaaS API: Event Processing Services, Analytics
  • 19. 19  Performance is about 2 things (Martin Thompson – http://www.infoq.com/articles/low-latency-vp ): – Throughput – units per second, and – Latency – response time  Real-time – time constraint from input to response regardless of system load.  Hard real-time system if this constraint is not honored then a total system failure can occur.  Soft real-time system – low latency response with little deviation in response time  100 nano-seconds to 100 milli-seconds. [Peter Lawrey] What's High Performance?
  • 20. Imperative and Reactive 20 We live in a Connected Universe ... there is hypothesis that all the things in the Universe are intimately connected, and you can not change a bit without changing all. Action – Reaction principle is the essence of how Universe behaves.
  • 21. Imperative and Reactive  Reactive Programming: using static or dynamic data flows and propagation of change Example: a := b + c  Functional Programming: evaluation of mathematical functions, ➢ Avoids changing-state and mutable data, declarative programming ➢ Side effects free => much easier to understand and predict the program behavior. Example: books.stream().filter(book -> book.getYear() > 2010) .forEach( System.out::println )
  • 22. Functional Reactive (FRP) 22 According to Connal Elliot's (ground-breaking paper @ Conference on Functional Programming, 1997), FRP is: (a) Denotative (b) Temporally continuous
  • 24. 24  Message Driven – asynchronous message-passing allows to establish a boundary between components that ensures loose coupling, isolation, location transparency, and provides the means to delegate errors as messages [Reactive Manifesto].  The main idea is to separate concurrent producer and consumer workers by using message queues.  Message queues can be unbounded or bounded (limited max number of messages)  Unbounded message queues can present memory allocation problem in case the producers outrun the consumers for a long period → OutOfMemoryError Scalable, Massively Concurrent
  • 25. Reactive Programming 25  Microsoft® opens source polyglot project ReactiveX (Reactive Extensions) [http://reactivex.io]: Rx = Observables + LINQ + Schedulers :) Java: RxJava, JavaScript: RxJS, C#: Rx.NET, Scala: RxScala, Clojure: RxClojure, C++: RxCpp, Ruby: Rx.rb, Python: RxPY, Groovy: RxGroovy, JRuby: RxJRuby, Kotlin: RxKotlin ...  Reactive Streams Specification [http://www.reactive-streams.org/] used by:  (Spring) Project Reactor [http://projectreactor.io/]  Actor Model – Akka (Java, Scala) [http://akka.io/]
  • 26. Reactive Streams Spec. 26  Reactive Streams – provides standard for asynchronous stream processing with non-blocking back pressure.  Minimal set of interfaces, methods and protocols for asynchronous data streams  April 30, 2015: has been released version 1.0.0 of Reactive Streams for the JVM (Java API, Specification, TCK and implementation examples)  Java 9: java.util.concurrent.Flow
  • 27. Reactive Streams Spec. 27  Publisher – provider of potentially unbounded number of sequenced elements, according to Subscriber(s) demand. Publisher.subscribe(Subscriber) => onSubscribe onNext* (onError | onComplete)?  Subscriber – calls Subscription.request(long) to receive notifications  Subscription – one-to-one Subscriber ↔ Publisher, request data and cancel demand (allow cleanup).  Processor = Subscriber + Publisher
  • 28. FRP = Async Data Streams 28  FRP is asynchronous data-flow programming using the building blocks of functional programming (e.g. map, reduce, filter) and explicitly modeling time  Used for GUIs, robotics, and music. Example (RxJava): Observable.from( new String[]{"Reactive", "Extensions", "Java"}) .take(2).map(s -> s + " : on " + new Date()) .subscribe(s -> System.out.println(s)); Result: Reactive : on Wed Jun 17 21:54:02 GMT+02:00 2015 Extensions : on Wed Jun 17 21:54:02 GMT+02:00 2015
  • 29. Project Reactor 29  Reactor project allows building high-performance (low latency high throughput) non-blocking asynchronous applications on JVM.  Reactor is designed to be extraordinarily fast and can sustain throughput rates on order of 10's of millions of operations per second.  Reactor has powerful API for declaring data transformations and functional composition.  Makes use of the concept of Mechanical Sympathy built on top of Disruptor / RingBuffer.
  • 30. Reactor Projects 30 https://github.com/reactor/reactor, Apache Software License 2.0 IPC – Netty, Kafka, Aeron
  • 33. Flux & Redux Design Patterns Source: Flux in GitHub, https://github.com/facebook/flux, License: BSD 3-clause "New" License
  • 34. Source: RxJava 2 API documentation, http://reactivex.io/RxJava/2.x/javadoc/ Redux == Rx Scan Opearator
  • 35. Hot and Cold Event Streams 35  PULL-based (Cold Event Streams) – Cold streams (e.g. RxJava Observable / Flowable or Reactor Flow / Mono) are streams that run their sequence when and if they are subscribed to. They present the sequence from the start to each subscriber.  PUSH-based (Hot Event Streams) – emit values independent of individual subscriptions. They have their own timeline and events occur whether someone is listening or not. When subscription is made observer receives current events as they happen. Example: mouse events
  • 36. Converting Cold to Hot Stream 36
  • 37. Hot Stream Example - Reactor 37 EmitterProcessor<String> emitter = EmitterProcessor.create(); FluxSink<String> sink = emitter.sink(); emitter.publishOn(Schedulers.single()) .map(String::toUpperCase) .filter(s -> s.startsWith("HELLO")) .delayElements(Duration.of(1000, MILLIS)) .subscribe(System.out::println); sink.next("Hello World!"); // emit - non blocking sink.next("Goodbye World!"); sink.next("Hello Trayan!"); Thread.sleep(3000);
  • 38. Top New Features in Spring 5 38  Reactive Programming Model  Spring Web Flux  Reactive DB repositories & integrations + hot event streaming: MongoDB, CouchDB, Redis, Cassandra, Kafka  JDK 8+ and Java EE 7+ baseline  Testing improvements – WebTestClient (based on reactive WebFlux WebClient)  Kotlin functional DSL
  • 39. Project Reactor Spring 5 Main Building Blocks 39Source: https://spring.io Spring Boot 2.0 Reactive Stack (async IO) Servlet Stack (one request per thread) Spring Security Reactive Every JEE Servlet Container (tomact, jetty, undertow, ...) Nonblocking NIO Runtimes (Netty, Servlet 3.1 Containers) Spring Security Spring MVC Spring WebFlux Spring Data Repositories JDBC, JPA, NoSQL Spring Data Reactive Repositories Mongo, Cassandra, Redis, Couchbase
  • 40. WebFlux: Best Expalined in Code 40 Lets see REST service Spring 5 WebFlux demos. Available @GitHub: https://github.com/iproduct/spring-5-webflux
  • 41. Thank’s for Your Attention! 41 Trayan Iliev CEO of IPT – Intellectual Products & Technologies http://iproduct.org/ http://robolearn.org/ https://github.com/iproduct https://twitter.com/trayaniliev https://www.facebook.com/IPT.EACAD https://plus.google.com/+IproductOrg