Serverless London 2019 - Coordination of Serverless Functions
0 likes658 views
The document discusses the coordination of serverless functions, focusing on approaches to orchestrate and manage functions for booking trips, including cars, hotels, and flights. It highlights the importance of idempotency, compensation strategies like sagas, and the challenges of orchestration versus choreography in distributed systems. Additionally, it emphasizes potential weaknesses such as latency and availability while advocating for workflow engines as effective solutions for handling complex scenarios.
Serverless London 2019 - Coordination of Serverless Functions
- 2. An example for today – the classical one λ Book Car λ Book Hotel λ Book Flight @berndruecker
- 3. Function collaboration λ Book Car λ Book Hotel λ Book Flight Book a trip? @berndruecker
- 4. Merged function λ (Trip) // book har $.post(carHireUrl, ... // book hotel $.post(carHireUrl, ... Car.js Hotel.js Easy to do No overhead Big functions Hard to maintain No independent scaling @berndruecker
- 5. Choreography λ (Car) $.post(carHireUrl, ... invokeHotel() λ (Hotel) $.post(carHireUrl, ... Chaining λ (Car) $.post(carHireUrl, ... carBookedEvent() λ (Hotel) $.post(carHireUrl, ... Event-Chain No extra framework needed Hard to understand the flow Changing the sequence is hard
- 6. Orchestration / coordinator function λ (Trip) λ (Car) $.post(carHireUrl, ... λ (Hotel) $.post(carHireUrl, ... // book har invokeCar() // book hotel invokeHotel() @berndruecker
- 9. Orchestration / coordinator function λ (Trip) λ (Car) $.post(carHireUrl, ... λ (Hotel) $.post(carHireUrl, ... // book har invokeCar() // book hotel invokeHotel() @berndruecker
- 10. Orchestration / coordinator function λ (Trip) λ (Car) $.post(carHireUrl, ... λ (Hotel) $.post(carHireUrl, ... // book har invokeCar() // book hotel invokeHotel() @berndruecker
- 11. Orchestration / coordinator function λ (Trip) λ (Car) $.post(carHireUrl, ... λ (Hotel) $.post(carHireUrl, ... // book har invokeCar() // book hotel invokeHotel() Not idempotent Idempotent bookHotel(hotel, duration) bookHotel(tripId, hotel, duration) @berndruecker
- 12. Photo by pixabay, available under Creative Commons CC0 1.0 license. @berndruecker
- 13. Requirement: Idempotency of services! Photo by pixabay, available under Creative Commons CC0 1.0 license. @berndruecker
- 14. Requirement: Idempotency of services! Photo by Chr.Späth, available under Public Domain. @berndruecker
- 16. It is impossible to differentiate certain failure scenarios: Independant of communication style! @berndruecker
- 17. Orchestration / coordinator function λ (Trip) λ (Car) $.post(carHireUrl, ... λ (Hotel) $.post(carHireUrl, ... // book har invokeCar() // book hotel invokeHotel() @berndruecker
- 18. // book hotel try { bookHotel() } catch (err) { cancelHotel() } Cleanup! λ (Trip) λ (Car) $.post(carHireUrl, ... λ (Hotel) $.post(carHireUrl, ... PUT& DELETE // book har invokeCar() @berndruecker
- 20. Weaknesses: Latency creep Car HotelTrip Flight REST 300 ms 1150 + x ms 600 ms 250 ms @berndruecker $$$
- 21. Weaknesses: Availabiliy erosion Car HotelTrip Flight REST 99 % uptime 99 % uptime 99 % uptime 96 % uptime @berndruecker
- 22. Orchestration with workflow λ (Trip) // book har startTripWorkflow() λ (Car) $.post(carHireUrl, ... λ (Hotel) $.post(carHireUrl, ... Workflow Engine Car -> Hotel -> ... @berndruecker
- 24. Berlin, Germany bernd.ruecker@camunda.com @berndruecker Bernd Ruecker Co-founder and Chief Technologist of Camunda
- 27. Leverage stateful retrying λ (Car) λ (Hotel) Workflow Engine λ (Flight)λ (Trip)
- 28. Let‘s talk about ACID All or nothing Atomicity Consistency Isolation Durability
- 29. Pat Helland “ Distributed Systems Guru Worked at Amazon, Microsoft & Salesforce @berndruecker
- 30. Pat Helland Grown-Ups Don’t Use Distributed Transactions “ Distributed Systems Guru Worked at Amazon, Microsoft & Salesforce @berndruecker
- 32. That means Temporarily inconsistent Eventually consistent againt Consistent Local ACID Local ACID Violates „I“ of ACID @berndruecker λ Book Car λ Book Hotel
- 33. @berndruecker
- 34. @berndruecker
- 35. Compensation – the classical example Saga book hotel book car book flight cancel hotel cancel car 1. 2. 3. 5.6. In case of failure trigger compensations book trip
- 36. 2 alterntive approaches: choreography & orchestration @berndruecker
- 38. Event-driven choreography Hotel Flight Car Trip Trip failed Trip requested Hotel booked Car booked Request trip Flight failed Car canceled Hotel canceled Perform undo (cancel car booking) Perform undo (cancel hotel) @berndruecker
- 39. The danger is that it's very easy to make nicely decoupled systems with event notification, without realizing that you're losing sight of that larger-scale flow, and thus set yourself up for trouble in future years. https://martinfowler.com/articles/201701-event-driven.html @berndruecker
- 40. The danger is that it's very easy to make nicely decoupled systems with event notification, without realizing that you're losing sight of that larger-scale flow, and thus set yourself up for trouble in future years. https://martinfowler.com/articles/201701-event-driven.html @berndruecker
- 41. The danger is that it's very easy to make nicely decoupled systems with event notification, without realizing that you're losing sight of that larger-scale flow, and thus set yourself up for trouble in future years. https://martinfowler.com/articles/201701-event-driven.html @berndruecker
- 42. Implementing changes in the process Hotel Flight Car Trip Trip failed Trip requested Hotel booked Car booked Request trip Flight failed Car canceled Hotel canceled We have a new basic agreement with the car rental agency and can cancel for free within 1 hour – do that first! @berndruecker
- 43. Implementing changes in the process Hotel Flight Car Trip Trip failed Trip requested Hotel booked Car booked Request trip Flight failed Car canceled Hotel canceled You have to adjust all services and redeploy at the same time! We have a new basic agreement with the car rental agency and can cancel for free within 1 hour – do that first! @berndruecker
- 44. What we wanted Photo by Lijian Zhang, available under Creative Commons SA 2.0 License and CC BY-SA 4.0 @berndruecker
- 46. Orchestration Hotel Flight Car Trip Trip booked Request trip Book hotel Hotel booked Car booked Flight booked Book car Book flight We have a new basic agreement with the car rental agency and can cancel for free within 1 hour – do that first! You have to adjust one service and redeploy only this one! @berndruecker
- 47. Compensation with workflow Workflow Engine λ (Trip) Saga Pattern (implemented by BPMN compensation)
- 48. Live hacking https://github.com/berndruecker/trip-booking-saga-serverless Workflow engine based on BPMN Cloud-native Source-available Available as managed service
- 49. Demo architecture with Zeebe & Camunda Cloud Camunda Cloud Your cloud account Zeebe Client BPMN Workflow Definition Trip Booking Function Hotel Booking Function … Zeebe API Gateway start Invoke function via HTTP Deployed onto Zeebe
- 51. Clemens Vasters Architect at Microsoft http://vasters.com/archive/Sagas.html @berndruecker
- 52. Clemens Vasters Architect at Microsoft http://vasters.com/archive/Sagas.html @berndruecker
- 53. Clemens Vasters Architect at Microsoft http://vasters.com/archive/Sagas.html @berndruecker
- 54. Living documentation for long-running behaviour @berndruecker
- 57. Think of more complicated scenarios…
- 58. Recap • Function coordination might include orchestration and workflow • Carefully decide about choreography vs. orchestration • Grown ups don‘t use distributed transactions but eventual consistency • Idempotency is super important! • Know Saga / Compensation as strategy