"gRPC vs REST: let the battle begin!" DevoxxUK 2018 edition
2 likes7,694 views
The document discusses gRPC vs REST for building microservices. It begins with introductions from two software engineers and then delves into explanations of what gRPC and REST are, including how gRPC uses protocol buffers to define service interfaces, generates client/server code, and supports multiple languages. It also covers how gRPC performs remote calls more efficiently than REST and is better suited than REST for microservices that require features like service discovery, load balancing, and fault tolerance.
![RESTful API
GET /user/15
{
“name”: “John Doe”,
“email”:“john.doe@gmail.com”,
...
}
non-RESTful API
GET /last_search?page=2
{
“products”: [...]
...
}
@aiborisov
@mykyta_p](https://image.slidesharecdn.com/devoxxukgrpcrest-180511114306/85/gRPC-vs-REST-let-the-battle-begin-DevoxxUK-2018-edition-8-320.jpg)
![Heterogeneous Data Format
Src
#2
Src
#1
Aggr
...
Src
#X
<XML>...<XML>
{JSON}
Binary 110011
[ Unified Format ]
Client
@aiborisov
@mykyta_p](https://image.slidesharecdn.com/devoxxukgrpcrest-180511114306/85/gRPC-vs-REST-let-the-battle-begin-DevoxxUK-2018-edition-46-320.jpg)
"gRPC vs REST: let the battle begin!" DevoxxUK 2018 edition
- 1. #gRPCvsREST @aiborisov @mykyta_p gRPC vs REST: let the battle begin! Alex Borysov @aiborisov Mykyta Protsenko @mykyta_p
- 2. Who are we? Mykyta Protsenko Software Engineer @ Roku • passionate about all things scalable • 18+ years in software engineering • avid biker • Author of Henka REST vs gRPC Alex Borysov Software Engineer @ Google • large scale systems developer • 12+ years in software engineering • devoxx.org.ua PC member • Active gRPC user REST vs gRPC @aiborisov @mykyta_p
- 5. I am getting frustrated by the number of people calling any HTTP-based interface a REST API. Roy Fielding http://roy.gbiv.com/untangled/2008/rest-apis-must-be-hypertext-driven @aiborisov @mykyta_p
- 8. RESTful API GET /user/15 { “name”: “John Doe”, “email”:“john.doe@gmail.com”, ... } non-RESTful API GET /last_search?page=2 { “products”: [...] ... } @aiborisov @mykyta_p
- 10. What is gRPC? A high performance, general purpose, feature-rich RPC framework. Part of Cloud Native Computing Foundation cncf.io HTTP/2 and mobile first. Open sourced version of Stubby RPC used in Google. @aiborisov @mykyta_p
- 11. g in gRPC stands for 1.0 'gRPC' 1.1 'good' 1.2 'green' 1.3 'gentle' . . . 1.9 'glossy' 1.10 'glamorous' 1.11 'gorgeous' 1.12 'glorious' @aiborisov @mykyta_p https://github.com/grpc/grpc/blob/master/doc/g_stands_for.md
- 13. gRPC is not RMI Maitainability Ease of use Performance Scalability L e s s o n s Years of using Stubby @aiborisov @mykyta_p
- 14. What is gRPC? Abstractions and best practices on how to design RPCs. Default implementation(s) from Google. Extension points to plug custom implementations and modifications. Supports 10+ programming languages @aiborisov @mykyta_p
- 15. What is gRPC? Abstractions and best practices on how to design RPCs. Default implementation(s) from Google. Extension points to plug custom implementations and modifications. Supports 10+ programming languages, including JS! @aiborisov @mykyta_p
- 19. Microservices? How to draw an owl? @aiborisov @mykyta_p
- 20. Microservices? How to draw an owl? How to build microservices? @aiborisov @mykyta_p
- 21. Microservices? How to draw an owl? How to build microservices? Draw some circles. @aiborisov @mykyta_p
- 22. Microservices? How to draw an owl? How to build microservices? Draw some circles. Take XYZ framework. @aiborisov @mykyta_p
- 23. Microservices? How to draw an owl? How to build microservices? Draw the REST of the owlDraw some circles. Take XYZ framework. @aiborisov @mykyta_p
- 24. Microservices? How to draw an owl? How to build microservices? Draw the REST of the owl Write your microservices! Draw some circles. Take XYZ framework. @aiborisov @mykyta_p
- 32. Multiple Instances #1 #N #2 . . . @aiborisov @mykyta_p
- 33. Multiple Instances #1 #N #2 ? ? ? . . . @aiborisov @mykyta_p
- 41. A distributed system is one in which the failure of a computer you didn't even know existed can render your own computer unusable. Leslie Lamport, 1987 https://www.microsoft.com/en-us/research/wp-content/uploads/2016/12/Distribution.pdf @aiborisov @mykyta_p
- 43. Microservices?! But... Performance Hit? Service Discovery? Load Balancing? Fault Tolerance? Monitoring? Testing? @aiborisov @mykyta_p
- 46. Heterogeneous Data Format Src #2 Src #1 Aggr ... Src #X <XML>...<XML> {JSON} Binary 110011 [ Unified Format ] Client @aiborisov @mykyta_p
- 47. REST: It’s All About Resources @aiborisov @mykyta_p
- 48. REST: Call Hierarchy Controller Service Data Source A . . . Data Source N RestTemplate RestTemplate RestTemplate @aiborisov @mykyta_p
- 49. REST: Data Source JSON URL: http://pokemon.com/content/11 { "id": 11, "content": "Pikachu" } XML URL: http://crypto.com/content/22 <ContentResponse> <id>22</id> <content>Ethereum</content> </ContentResponse> @aiborisov @mykyta_p
- 50. REST: Data Source ... ResponseEntity<Content> contentEntity = restTemplate.getForEntity( url + "{content_id}" Content.class, ImmutableMap.of("content_id", contentId)); ... @aiborisov @mykyta_p
- 51. REST: Service public class AggregatingService { public AggregatedContent fetch(int id) { ... return new AggregatedContent(...); } } public class AggregatedContent { private Integer id; private String type; private String content; private Integer nextId; @aiborisov @mykyta_p
- 52. REST: Service public class AggregatingService { public AggregatedContent fetch(int id) { ... return new AggregatedContent(...); } } public class AggregatedContent { private Integer id; private String type; private String content; private Integer nextId; @aiborisov @mykyta_p
- 53. REST: Service public class AggregatingService { public AggregatedContent fetch(int id) { ... return new AggregatedContent(...); } } public class AggregatedContent { private Integer id; // 115 private String type; // Pokemon private String content; // Pikachu private Integer nextId; // 116 @aiborisov @mykyta_p
- 54. REST: Service public class AggregatingService { public AggregatedContent fetch(int id) { ... return new AggregatedContent(...); } } public class AggregatedContent { private Integer id; // 115 private String type; // Pokemon private String content; // Pikachu private Integer nextId; // 116 @aiborisov @mykyta_p
- 55. REST: Controller @GetMapping( value = "/content/{id}", produces = "application/json") public AggregatedContent aggregated(@PathVariable("id") int id) { return aggregatingService.fetch(id); } @aiborisov @mykyta_p
- 56. REST: It’s All About Resources @GetMapping( value = "/content/{id}", produces = "application/json") public AggregatedContent aggregated(@PathVariable("id") int id) { return aggregatingService.fetch(id); } @aiborisov @mykyta_p
- 57. REST: It’s simple http://localhost:8080/content/115 { "id": 115, "content_type": "CRYPTO", "content": "Ethereum", "next_uri": "/content/116" } @aiborisov @mykyta_p
- 59. k8s/pokemon.yaml ... kind: Service metadata: name: rest-pokemon-content-service k8s/aggregator.yaml ... env: - name: datasource_a_url value: "http://rest-pokemon-content-service:8080" REST: Service Discovery @aiborisov @mykyta_p
- 60. k8s/pokemon.yaml ... kind: Service metadata: name: rest-pokemon-content-service k8s/aggregator.yaml ... env: - name: datasource_a_url value: "http://rest-pokemon-content-service:8080" REST: Service Discovery @aiborisov @mykyta_p
- 61. Controllers and POJOs, oh my! public class AggregatedContent { @JsonProperty("id") private Integer id; @JsonProperty("type") private String type; @JsonProperty("content") private String content; @JsonProperty("next_uri") private String nextUri; ... } { "id": 115, "content_type": "Pokemon", "content": "Pikachu", "next_uri": "/content/116" } @aiborisov @mykyta_p
- 62. gRPC: It’s All About APIs @aiborisov @mykyta_p
- 65. Service Definition (aggregator.proto) syntax = "proto3"; service AggregationService { rpc Get(AggregationRequest) returns (AggregationResponse); } @aiborisov @mykyta_p
- 66. Service Definition (aggregator.proto) syntax = "proto3"; service AggregationService { rpc Get(AggregationRequest) returns (AggregationResponse); } message AggregationRequest { int32 item_id = 1; } message AggregationResponse { int32 id = 1; ResponseType type = 2; string content = 3; int32 next_item_id = 4; } enum ResponseType { UNDEFINED = 0; POKEMON = 1; CRYPTO = 2; } @aiborisov @mykyta_p
- 69. Service Definition aggregator.proto AggregationServiceImplBase.java AggregationRequest.java AggregationResponse.java AggregationServiceStub.java AggregationServiceFutureStub.java AggregationServiceBlockingStub.java Service Implementation Request and response Client libraries gRPC Java runtime @aiborisov @mykyta_p
- 70. Implement gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void get(AggregationRequest request, StreamObserver<AggregationResponse> responseObserver) { } } @aiborisov @mykyta_p
- 71. Implement gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void get(AggregationRequest request, StreamObserver<AggregationResponse> responseObserver) { } }
- 72. Implement gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void get(AggregationRequest request, StreamObserver<AggregationResponse> responseObserver) { } } @aiborisov @mykyta_p
- 73. Thread #X Thread ... Thread #7 Thread #6 Thread #5 Thread #4 Blocking API (aka Thread-per-Request)? Thread #3 Thread #2 Thread #1 Thread pool of size X @aiborisov @mykyta_p
- 74. Thread #X Thread ... Thread #7 Thread #6 Thread #5 Thread #4 Blocking API (aka Thread-per-Request)? Thread #3 Thread #2 Thread #1 Thread pool of size X 1 @aiborisov @mykyta_p
- 75. Thread #X Thread ... Thread #7 Thread #6 Thread #5 Thread #4 Blocking API (aka Thread-per-Request)? Thread #3 Thread #2 Thread #1 Thread pool of size X 1 2 @aiborisov @mykyta_p
- 76. Thread #X Thread ... Thread #7 Thread #6 Thread #5 Thread #4 Blocking API (aka Thread-per-Request)? Thread #3 Thread #2 Thread #1 Thread pool of size X 1 2 3 @aiborisov @mykyta_p
- 77. Thread #X Thread ... Thread #7 Thread #6 Thread #5 Thread #4 Thread #3 Thread #2 Blocking API (aka Thread-per-Request)? Thread #1 Thread pool of size X 1 2 3 X . . . @aiborisov @mykyta_p
- 78. Thread #X Thread ... Thread #7 Thread #6 Thread #5 Thread #4 Thread #3 Thread #2 Blocking API (aka Thread-per-Request)? Thread #1 Thread pool of size X 1 2 3 X . . . X + 1 @aiborisov @mykyta_p
- 79. Thread #X Thread ... Thread #7 Thread #6 Thread #5 Thread #4 Thread #3 Thread #2 Blocking API (aka Thread-per-Request)? Thread #1 Thread pool of size X 1 2 3 X . . . X + 1 @aiborisov @mykyta_p
- 80. Implement gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void get(AggregationRequest request, StreamObserver<AggregationResponse> responseObserver) { } } @aiborisov @mykyta_p
- 81. Implement gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void get(AggregationRequest request, public interface StreamObserver<AggregationResponse> responseObserver){{ void onNext(AggregationResponse response); void onCompleted(); void onError(Throwable error); } } } @aiborisov @mykyta_p
- 82. Non-Blocking API 1 2 3 . . . X + Y X . . . @aiborisov @mykyta_p
- 83. Non-Blocking API (aka Hollywood Principle) 1 2 3 . . . X + Y X . . . WillCallYouLater! @aiborisov @mykyta_p
- 84. Non-Blocking API (aka Hollywood Principle) 1 2 3 . . . X + Y X . . . WillCallYouLater! onNext(1) @aiborisov @mykyta_p
- 85. Non-Blocking API (aka Hollywood Principle) 1 2 3 . . . X + Y X . . . WillCallYouLater! onNext(3) @aiborisov @mykyta_p
- 86. Non-Blocking API (aka Hollywood Principle) 1 2 3 . . . X + Y X . . . WillCallYouLater! onNext(X) @aiborisov @mykyta_p
- 87. Implement gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void get(AggregationRequest request, StreamObserver<AggregationResponse> responseObserver) { AggregationResponse response = AggregationResponse .newBuilder() .setId(request.getItemId()) .setContent("Ethereum") .setType(ResponseType.CRYPTO) .build(); responseObserver.onNext(response); responseObserver.onCompleted(); } } @aiborisov @mykyta_p
- 88. Implement gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void get(AggregationRequest request, StreamObserver<AggregationResponse> responseObserver) { AggregationResponse response = AggregationResponse .newBuilder() .setId(request.getItemId()) .setContent("Ethereum") .setType(ResponseType.CRYPTO) .build(); responseObserver.onNext(response); responseObserver.onCompleted(); } } @aiborisov @mykyta_p
- 89. Service Definition (aggregator.proto) syntax = "proto3"; service AggregationService { rpc Get(AggregationRequest) returns (AggregationResponse); } message AggregationRequest { int32 item_id = 1; } message AggregationResponse { int32 id = 1; ResponseType type = 2; string content = 3; int32 next_item_id = 4; } enum ResponseType { UNDEFINED = 0; POKEMON = 1; CRYPTO = 2; } @aiborisov @mykyta_p
- 90. Service Definition (aggregator.proto) syntax = "proto3"; service AggregationService { rpc Get(AggregationRequest) returns (AggregationResponse); } message AggregationRequest { } message AggregationResponse { int32 id = 1; ResponseType type = 2; string content = 3; } enum ResponseType { UNDEFINED = 0; POKEMON = 1; CRYPTO = 2; } @aiborisov @mykyta_p
- 91. Service Definition (aggregator.proto) syntax = "proto3"; service AggregationService { rpc Get(AggregationRequest) returns (AggregationResponse); } message AggregationRequest { } message AggregationResponse { int32 id = 1; ResponseType type = 2; string content = 3; } enum ResponseType { UNDEFINED = 0; POKEMON = 1; CRYPTO = 2; } @aiborisov @mykyta_p
- 92. Service Definition (aggregator.proto) syntax = "proto3"; service AggregationService { rpc Get(AggregationRequest) returns (stream AggregationResponse); } message AggregationRequest { } message AggregationResponse { int32 id = 1; ResponseType type = 2; string content = 3; } enum ResponseType { UNDEFINED = 0; POKEMON = 1; CRYPTO = 2; } @aiborisov @mykyta_p
- 93. Service Definition (aggregator.proto) syntax = "proto3"; service AggregationService { rpc Subscribe(AggregationRequest) returns (stream AggregationResponse); } message AggregationRequest { } message AggregationResponse { int32 id = 1; ResponseType type = 2; string content = 3; } enum ResponseType { UNDEFINED = 0; POKEMON = 1; CRYPTO = 2; } @aiborisov @mykyta_p
- 94. Service Definition (aggregator.proto) syntax = "proto3"; service AggregationService { rpc Subscribe(AggregationRequest) returns (stream AggregationResponse); } message AggregationRequest { } message AggregationResponse { int32 id = 1; ResponseType type = 2; string content = 3; } enum ResponseType { UNDEFINED = 0; POKEMON = 1; CRYPTO = 2; } @aiborisov @mykyta_p
- 97. content.proto syntax = "proto3"; service ContentService { rpc Subscribe(ContentRequest) returns (stream ContentResponse); } message ContentRequest { } message ContentResponse { int32 id = 1; string content = 2; } @aiborisov @mykyta_p
- 98. Streaming gRPC Service public class AggregationService extends AggregationServiceImplBase { private final Collection<ContentServiceStub> contentStubs; public AggregationService(Collection<ContentServiceStub> contentStubs) { this.contentStubs = contentStubs; } ... @aiborisov @mykyta_p
- 99. Streaming gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void subscribe(AggregationRequest request,StreamObserver<AggregationResponse> responseObserver) { contentStubs.forEach(stub -> { stub.subscribe(ContentRequest.getDefaultInstance(), new StreamObserver<ContentResponse>() { @Override public void onNext(ContentResponse response) { ... } @Override public void onError(Throwable error) { responseObserver.onError(error); } @Override public void onCompleted() {} }); }); } @aiborisov @mykyta_p
- 100. Streaming gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void subscribe(AggregationRequest request,StreamObserver<AggregationResponse> responseObserver) { contentStubs.forEach(stub -> { stub.subscribe(ContentRequest.getDefaultInstance(), new StreamObserver<ContentResponse>() { @Override public void onNext(ContentResponse response) { ... } @Override public void onError(Throwable error) { responseObserver.onError(error); } @Override public void onCompleted() {} }); }); } @aiborisov @mykyta_p
- 101. Streaming gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void subscribe(AggregationRequest request,StreamObserver<AggregationResponse> responseObserver) { contentStubs.forEach(stub -> { stub.subscribe(ContentRequest.getDefaultInstance(), new StreamObserver<ContentResponse>() { @Override public void onNext(ContentResponse response) { ... } @Override public void onError(Throwable error) { responseObserver.onError(error); } @Override public void onCompleted() {} }); }); } @aiborisov @mykyta_p
- 102. Streaming gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void subscribe(AggregationRequest request,StreamObserver<AggregationResponse> responseObserver) { contentStubs.forEach(stub -> { stub.subscribe(ContentRequest.getDefaultInstance(), new StreamObserver<ContentResponse>() { @Override public void onNext(ContentResponse response) { ... } @Override public void onError(Throwable error) { responseObserver.onError(error); } @Override public void onCompleted() {} }); }); } @aiborisov @mykyta_p
- 103. Streaming gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void subscribe(AggregationRequest request,StreamObserver<AggregationResponse> responseObserver) { contentStubs.forEach(stub -> { stub.subscribe(ContentRequest.getDefaultInstance(), new StreamObserver<ContentResponse>() { @Override public void onNext(ContentResponse response) { ResponseType type = typeForStub(stub); int aggregationId = aggregationId(response.getId(), type); AggregationResponse aggrResponse = AggregationResponse.newBuilder() .setContent(response.getContent()).setId(aggregationId). .setType(type).build(); responseObserver.onNext(aggrResponse); } }); }); } @aiborisov @mykyta_p
- 104. Streaming gRPC Service public class AggregationService extends AggregationServiceImplBase { @Override public void subscribe(AggregationRequest request,StreamObserver<AggregationResponse> responseObserver) { contentStubs.forEach(stub -> { stub.subscribe(ContentRequest.getDefaultInstance(), new StreamObserver<ContentResponse>() { @Override public void onNext(ContentResponse response) { ResponseType type = typeForStub(stub); int aggregationId = aggregationId(response.getId(), type); AggregationResponse aggrResponse = AggregationResponse.newBuilder() .setContent(response.getContent()).setId(aggregationId). .setType(type).build(); responseObserver.onNext(aggrResponse); } }); }); } @aiborisov @mykyta_p
- 106. Streaming gRPC Service Src #2 Src #1 Aggr ... Src #X Client Subscribe() @aiborisov @mykyta_p
- 107. Streaming gRPC Service Src #2 Src #1 Aggr ... Src #X Client Subscribe() Subscribe() Subscribe() Subscribe() @aiborisov @mykyta_p
- 109. Streaming gRPC Service Src #2 Src #1 Aggr ... Src #X Client onNext() onNext() @aiborisov @mykyta_p
- 111. Streaming gRPC Service Src #2 Src #1 Aggr ... Src #X Client onNext() onNext() @aiborisov @mykyta_p
- 112. Start gRPC Server ContentServiceStub cryptoClient = ... ContentServiceStub pokemonClient = ... Server grpcServer = NettyServerBuilder.forPort(8080) .addService(new AggregationService(asList(cryptoClient, pokemonClient))) .build().start(); @aiborisov @mykyta_p
- 113. Start gRPC Server ContentServiceStub cryptoClient = ... ContentServiceStub pokemonClient = ... Server grpcServer = NettyServerBuilder.forPort(8080) .addService(new AggregationService(asList(cryptoClient, pokemonClient))) .build().start(); @aiborisov @mykyta_p
- 114. Create gRPC Client String host = System.getenv("crypto_host"); int post = Integer.valueOf(System.getenv("crypto_port")); ManagedChannel cryptoChannel = NettyChannelBuilder.forAddress(host, port).build(); @aiborisov @mykyta_p
- 115. Create gRPC Client String host = System.getenv("crypto_host"); int post = Integer.valueOf(System.getenv("crypto_port")); ManagedChannel cryptoChannel = NettyChannelBuilder.forAddress(host, port).build(); ContentServiceStub cryptoClient = ContentServiceGrpc.newStub(cryptoChannel); @aiborisov @mykyta_p
- 116. Create gRPC Client String host = System.getenv("crypto_host"); int port = Integer.valueOf(System.getenv("crypto_port")); ManagedChannel cryptoChannel = NettyChannelBuilder.forAddress(host, port).build(); ContentServiceStub cryptoClient = ContentServiceGrpc.newStub(cryptoChannel); ContentServiceBlockingStub cryptoBlockingClient = ContentServiceGrpc.newBlockingStub(cryptoChannel); @aiborisov @mykyta_p
- 117. Create gRPC Client tring host = System.getenv("crypto_host"); int port = Integer.valueOf(System.getenv("crypto_port")); ManagedChannel cryptoChannel = NettyChannelBuilder.forAddress(host, port).build(); ContentServiceStub cryptoClient = ContentServiceGrpc.newStub(cryptoChannel); ContentServiceBlockingStub cryptoBlockingClient = ContentServiceGrpc.newBlockingStub(cryptoChannel); ContentServiceFutureStub cryptoFutureClient = ContentServiceGrpc.newFutureStub(cryptoChannel); @aiborisov @mykyta_p
- 118. Service Discovery & Load Balancing String host = System.getenv("crypto_host"); int post = Integer.valueOf(System.getenv("crypto_port")); ManagedChannel cryptoChannel = NettyChannelBuilder.forAddress(host, port).build(); @aiborisov @mykyta_p
- 119. Service Discovery & Load Balancing ManagedChannel cryptoChannel = NettyChannelBuilder.forAddress(host, port).build(); @aiborisov @mykyta_p
- 120. Service Discovery & Load Balancing ManagedChannel cryptoChannel = NettyChannelBuilder.forTarget("crypto") .build(); @aiborisov @mykyta_p
- 121. Service Discovery & Load Balancing ManagedChannel cryptoChannel = NettyChannelBuilder.forTarget("crypto") .nameResolverFactory(new DnsNameResolverProvider()) .loadBalancerFactory(RoundRobinLoadBalancerFactory.getInstance()) .build(); @aiborisov @mykyta_p
- 122. Service Discovery & Load Balancing ManagedChannel cryptoChannel = NettyChannelBuilder.forTarget("crypto") .nameResolverFactory(new MyCustomNameResolverProviderFactory()) .loadBalancerFactory(new MyMoonPhaseLoadBalancerFactory()) .build(); @aiborisov @mykyta_p
- 123. Netty ManagedChannel cryptoChannel = NettyChannelBuilder.forTarget("crypto") .nameResolverFactory(new MyCustomNameResolverProvider()) .loadBalancerFactory(new MyMoonPhaseLoadBalancerFactory()) .build(); @aiborisov @mykyta_p
- 124. Netty + HTTP/2 + Protobuf @aiborisov @mykyta_p
- 125. Netty + HTTP/2 + Protobuf = Performance http://www.grpc.io/docs/guides/benchmarking.html @aiborisov @mykyta_p 8 core VMs, streaming throughput
- 126. Netty + HTTP/2 + Protobuf = Performance http://www.grpc.io/docs/guides/benchmarking.html @aiborisov @mykyta_p 32 core VMs, streaming throughput
- 129. pay 24/7 Classic Cloud VM VM LB ... VM pay as you go @aiborisov @mykyta_p
- 130. Serverless pay as you go Func Funcinput ... Func input ... input @aiborisov @mykyta_p
- 131. All about resources IDL optional Synchronous by default Unary Perfect fit for serverless All about APIs IDL centric Asynchronous by nature Streaming or Unary Performance first REST gRPC @aiborisov @mykyta_p
- 136. Sample Problem: Voting & Leaderboard Src #2 Src #1 ... Src #X Client Voting Aggr L-board @aiborisov @mykyta_p
- 137. Sample Problem: Voting & Leaderboard Src #2 Src #1 ... Src #X Client Voting Aggr L-board @aiborisov @mykyta_p
- 138. Sample Problem: Voting & Leaderboard Src #2 Src #1 ... Src #X Gateway Voting Aggr L-board @aiborisov @mykyta_p
- 151. Timeouts? Src #2 Src #1 ... Src #X Gateway VotingL-board Aggr 200 ms 2 sec @aiborisov @mykyta_p
- 152. Large Timeouts Gateway Voting L-Board 1,000 ms timeout 1,000 ms timeout 200 ms client timeout @aiborisov @mykyta_p
- 153. Large Timeouts Gateway Voting L-Board 1,000 ms timeout 1,000 ms timeout 200 ms client timeout 50 ms @aiborisov @mykyta_p
- 154. Large Timeouts Gateway Voting L-Board 1,000 ms timeout 1,000 ms timeout 200 ms client timeout 50 ms 400 ms @aiborisov @mykyta_p
- 155. Large Timeouts Gateway Voting L-Board 1,000 ms timeout 1,000 ms timeout 200 ms client timeout 50 ms 400 ms @aiborisov @mykyta_p
- 156. Large Timeouts Gateway Voting L-Board 1,000 ms timeout 1,000 ms timeout 200 ms client timeout 50 ms 400 ms 300 ms @aiborisov @mykyta_p
- 157. Short Timeouts Gateway Voting L-Board 100 ms timeout 100 ms timeout @aiborisov @mykyta_p
- 158. Short Timeouts Gateway Voting L-Board 100 ms timeout 100 ms timeout 2,000 ms client timeout @aiborisov @mykyta_p
- 159. Short Timeouts Gateway Voting L-Board 100 ms timeout 100 ms timeout 2,000 ms client timeout 50 ms @aiborisov @mykyta_p
- 160. Short Timeouts Gateway Voting L-Board 100 ms timeout 100 ms timeout 2,000 ms client timeout 50 ms 400 ms @aiborisov @mykyta_p
- 161. Short Timeouts Gateway Voting L-Board 100 ms timeout 100 ms timeout 2,000 ms client timeout 50 ms 400 ms @aiborisov @mykyta_p
- 162. Short Timeouts Gateway Voting L-Board 100 ms timeout 100 ms timeout 2,000 ms client timeout 50 ms 400 ms @aiborisov @mykyta_p
- 163. gRPC Deadline Propagation Gateway Voting L-Board 200 ms client timeout @aiborisov @mykyta_p
- 164. gRPC Deadline Propagation Gateway Voting L-Board 200 ms client timeout 50 ms @aiborisov @mykyta_p
- 165. gRPC Deadline Propagation Gateway Voting L-Board 200 - 50 ms timeout 200 ms client timeout 50 ms @aiborisov @mykyta_p
- 166. gRPC Deadline Propagation Gateway Voting L-Board 200 - 50 ms timeout 200 ms client timeout 50 ms 400 ms @aiborisov @mykyta_p
- 167. gRPC Deadline Propagation Gateway Voting L-Board 200 - 50 - 400 ms timeout 200 - 50 ms timeout 200 ms client timeout 50 ms 400 ms @aiborisov @mykyta_p
- 168. gRPC Deadline Propagation (Short) Gateway Voting L-Board 200 - 50 - 400 ms timeout 200 - 50 ms timeout 200 ms client timeout 50 ms 400 ms @aiborisov @mykyta_p
- 169. gRPC Deadline Propagation (Large) Gateway Voting L-Board 2,000 - 50 - 400 ms timeout 2,000 - 50 ms timeout 2,000 ms client timeout 50 ms 400 ms 300 ms @aiborisov @mykyta_p
- 177. Zipkin: Traces and Latency @aiborisov @mykyta_p
- 178. Zipkin and gRPC https://github.com/openzipkin/brave/tree/master/instrumentation/grpc URLConnectionSender sender = ... GrpcTracing grpcTracing = GrpcTracing.create(Tracing.newBuilder() .sampler(ALWAYS_SAMPLE).spanReporter(AsyncReporter.create(sender)).build()); @aiborisov @mykyta_p
- 179. Zipkin and gRPC https://github.com/openzipkin/brave/tree/master/instrumentation/grpc URLConnectionSender sender = ... GrpcTracing grpcTracing = GrpcTracing.create(Tracing.newBuilder() .sampler(ALWAYS_SAMPLE).spanReporter(AsyncReporter.create(sender)).build()); ManagedChannel cryptoChannel = NettyChannelBuilder.forAddress(cryptoHost, cryptoPort) .intercept(grpcTracing.newClientInterceptor()) .build(); Server grpcServer = NettyServerBuilder.forPort(8080) .addService(new AggregationService(asList(cryptoClient, pokemonClient))) .intercept(grpcTracing.newServerInterceptor()) .build().start(); @aiborisov @mykyta_p
- 180. Zipkin and gRPC https://github.com/openzipkin/brave/tree/master/instrumentation/grpc URLConnectionSender sender = ... GrpcTracing grpcTracing = GrpcTracing.create(Tracing.newBuilder() .sampler(ALWAYS_SAMPLE).spanReporter(AsyncReporter.create(sender)).build()); ManagedChannel cryptoChannel = NettyChannelBuilder.forAddress(cryptoHost, cryptoPort) .intercept(grpcTracing.newClientInterceptor()) .build(); Server grpcServer = NettyServerBuilder.forPort(8080) .addService(new AggregationService(asList(cryptoClient, pokemonClient))) .intercept(grpcTracing.newServerInterceptor()) .build().start(); @aiborisov @mykyta_p
- 181. Zipkin and REST build.gradle: dependencies { compile 'org.springframework.cloud:spring-cloud-sleuth-zipkin' compile 'org.springframework.cloud:spring-cloud-starter-sleuth' ... application.properties: spring.zipkin.baseUrl=http://zipkin:9411/ # sample 100% spring.sleuth.sampler.percentage=1.0 ... @aiborisov @mykyta_p
- 188. No code changes Implementation neutral Isolation Cross-cutting functionality No additional calls Deeper integration Flexibility Span Customization Sidecar/proxy Instrumentation @aiborisov @mykyta_p
- 189. Zipkin : REST and gRPC @aiborisov @mykyta_p
- 192. Explore More? Demo: https://github.com/grpcvsrest http://grpc.io https://github.com/grpc http://www.grpc.io/docs/quickstart/java.html gRPC -Web: https://github.com/grpc/grpc-web gRPC Google group: grpc-io@googlegroups.com REST: http://google.com/search?q=rest @aiborisov @mykyta_p
- 193. Demo UI is written by Yevgen Golubenko Software Engineer @ Anomali • Twitter: @HalloGene_ • github.com/HalloGene • linkedin.com/in/yevgen-golubenko @aiborisov @mykyta_p
- 195. All about resources Synchronous and unary Simplicity first External fault-tolerance Production ready All about APIs Async and streaming Performance first Built-in fault-tolerance Production ready REST gRPC @aiborisov @mykyta_p
- 196. All about resources Synchronous and unary Simplicity first External fault-tolerance Production ready All about APIs Async and streaming Performance first Built-in fault-tolerance Production ready REST gRPC Be pragmatic, start with your problem! @aiborisov @mykyta_p