Building Microservices with gRPC and NATS
21 likes10,548 views
This document discusses building microservices with gRPC and NATS. It begins with an introduction to microservices architecture and challenges in communication between microservices. It then covers using gRPC and Protocol Buffers to build high performance APIs, as well as using NATS for an event-driven architecture with publish-subscribe messaging. Code demos are provided for gRPC and NATS. The document concludes with a discussion of event sourcing and various messaging patterns when using NATS.
Building Microservices with gRPC and NATS
- 1. Building Microservices with gRPC and NATS Shiju Varghese Consulting Solutions Architect April 28, 2017
- 2. About Me • Consulting Solutions Architect and Trainer • Focused on Golang, Microservices and Cloud-Native distributed systems architectures • Published Author: “Web Development with Go” and “Go Recipes” • Honoured with Microsoft MVP award seven times • Blog: https://medium.com/@shijuvar
- 3. Agenda • Inter-Process communications in Microservices architecture • Building high performance APIs with gRPC and Protocol Buffers • Building Microservices with event-driven architectures using NATS
- 5. Monolithic Architecture Catalog Management Customer Accounts Orders Management Payment Monolithic Database Monolithic E-Commerce App eCom Store Web Shipment
- 6. Moving to Microservices Catalog Management Customer Accounts Orders Management Payment eCom Store Web Shipment Catalog DB Accounts DB Orders DB Payment DB Store DB Shipment DB
- 7. Microservices • Software broken up into functional components • Componentization via Services in which each service is packaged as one unit of execution • Independent, autonomous process with no dependency on other Microservices • Autonomous services around Bounded Context • Decentralization of data management • Independently replaceable and upgradeable
- 8. Challenges • A business transaction may span into multiple services • Decentralization of data management • Communications between Microservices without having any performance bottleneck
- 9. Inter-Process Communications between Microservices • Communications over high performance APIs • Event-Driven architecture using messaging systems
- 10. Design Considerations for Building APIs • Scaling APIs into millions (even billions) of APIs calls • Wire format; Serialisation and deserialisation of messages • Building streaming APIs • RESTful Vs RPC? • Text encoding Vs binary encoding?
- 11. Why not REST • Uses HTTP/1.x; Separate TCP Connection per request • Text on the wire; Not performance efficient • Harder API evolution • Not Domain-Specific • Not strongly-typed • Lack of streaming capabilities
- 13. What is gRPC • High performance, open-source universal RPC framework • A Cloud Native Computing Foundation(CNCF) project • Open source version of Google’s internal framework Stubby • Uses Protocol Buffers as the IDL • HTTP/2 for transport • Bi-Directional streaming • RPC is efficient, domain-specific and strongly-typed • Works across languages and platforms
- 14. Protocol Buffers • Google's language-neutral, platform-neutral, extensible mechanism for serialising structured data • IDL - Describe once and generate interfaces for multiple languages • Structure of the Request and Response • Binary format for network transmission • Supports multiple languages
- 15. Communication between gRPC Server and Client app
- 16. Types of RPC Methods • Simple RPC • Server-side streaming RPC • Client-side streaming RPC • Bi-directional streaming RPC
- 17. gRPC Workflow ProtoBuf Definitions protoc Compiler Go Ruby Java gRPC Server gRPC Client Define1 Compile2 Implement3Generate Code protoc --go_out=plugins=grpc
- 18. DEMO
- 19. grpc-gateway - gRPC to JSON Proxy Generator
- 20. BUILDING MICROSERVICES WITH EVENT-DRIVEN ARCHITECTURE USING NATS
- 21. Inter-Process Communication Using an Event- Driven Architecture
- 22. Event-Sourcing Aggregate ID Aggregate Type Event ID Event Type Event Data 301 Order 1001 OrderCreated … 301 Order 1002 OrderApproved … 301 Order 1003 OrderShipped … 301 Order 1004 OrderDelivered … Event Table
- 23. • Open source, lightweight, high-performance cloud native messaging system • Highly performant, extremely light-weight; Capable of sending 11-12 million messages per second • Publish-Subscribe messaging system • Available in two interoperable modules: • NATS Server • NATS Streaming Server (with persistent messaging) Introducing NATS - Shiju Varghese's Blog
- 25. Messaging Patterns • Publish-Subscribe • Queueing • Request-Replay
- 26. Components of Messaging Architecture • Message: Messages are the unit of data exchange. A payload, which is used for exchanging the data between applications. • Subject: Subject specifies the destination of messages. • Producer: Producers send messages to the NATS server. • Consumer: Consumers receive messages from the NATS server. • Messaging Server: NATS Server distributes the messages from producers to consumers.
- 28. DEMO
- 29. Demo App - Workflow OrderService - gRPC Server gRPC client Subscriber OrderCreated Event Subscriber Subscriber Queue Group NATS publisher, which publishes events when new orders are created RPC call for creating a new order Example Source: https://github.com/shijuvar/gokit/tree/master/examples/grpc-nats
- 30. Thank you Blog: medium.com/@shijuvar LinkedIn: linkedin.com/in/shijuvar Email: gophermonk@gmail.com