2019 Lightning Talk: Discovery, Consul and Inversion of Control for the infrastructure
- 1. Pierre Souchay Discovery Team @Criteo Twitter: @vizionr Github: pierresouchay Inversion Of Control with Consul Leading Discovery Team @Criteo (SDKs + Consul) Dealing with 240k+ services, 38k Consul nodes in 9 DCs 1st external contributor to Consul Author of consul-templaterb
- 2. Infrastructure is changing faster & faster Services in VM/containers/FAAS Several clusters, cloud providers Multiplication of ยตServices Service Mesh (East/West traffic)
- 3. Itโs hard to discover where things actually are
- 4. Cloud Provider/tech might provide it โฆ But usually, it is hard to mix
- 5. God made the world in 7 days Because there were no legacy
- 6. What is Consul? โข OSS Distributed Discovery system โข Each agent declares its services โข IP/PORT + health + TAGS + META โข Anyone can discover all services โข Notified when services changes โข Provides DNS! โข โฆ โข Fault tolerance โข Multi DC/Clouds
- 7. 7 โข More servers every year DC: 12 (9 prod) Servers: 38 000+ Services: 4000+ Instances: 240k+ HTTP req/s: 3M+ BigData: 180+ Pb Kafka msg/s: 8M+ We registered all of our services in Consul starting in 2015
- 9. What did we learn about our users? love their services configuration into their systems
- 10. What did we learn about our users? love their services want predictability configuration into their systems give them tools to investigate
- 11. What did we learn about our users? love their services want predictability love business semantics configuration into their systems give them tools to investigate focus on semantics, ignore tools
- 12. What did we learn about our users? love their services want predictability love business semantics want it fast and magic configuration into their systems give them tools to investigate focus on semantics, ignore tools magic is better than As A Service
- 13. So, what is this IoC?
- 14. 14 โข Inversion of Control Decoupling systems stuff using a framework Provides semantics of your needs Someone will provide what you need (and much more) Broader than Dependency Injection
- 16. 16 โข Inversion Of Control
- 17. 17 โข Inversion Of Control: Swagger
- 18. 18 โข Inversion Of Control: Automatic alerts
- 19. Why is meta so cool? Direct configuration โข alert_* => automatic alerts โข vip_*=> VAAS Configuration โข swagger_* => you saw it โฆand information โข version โข start โข team โข OWNERS... .. Automatically cleaned up
- 20. More meta, More power, More services node meta + service meta: 2 layers metrics can re-use it as well (ex: Prometheus/Consul integration) Templates are re-useable Same meta can be re-used for new tools It gets easier and easier
- 21. 21 โข How IoC changes infra
- 22. Removes configuration from hidden places If you are providing a cross service new system, you probably donโt need a git repository for the configuration So everything is transparent and open to everybody Information is where it needs to be, on the service itself Ease onboarding of newcomers
- 23. Cleanup is not a hard problem anymore Systems live and die, consumers react Ops synchronization is not needed anymore
- 24. Help innovating Real decoupling You can start your new project on your laptop Templating systems create your configs easily No migration costs anymore, we donโt configure tools Semantics are better than YAML config files
- 27. Automatic Metering / Alerts โข templates of consul-templaterb generating prometheus alerts โข Provide 100% of coverage of Criteo for free โข Also provide metrics such as availability for all of Criteo โข App availability according to version/OS/rack, using meta! โข Re-use those meta in all metrics
- 28. 28 โข VAAS โข Provides all networking for Criteo โข Serving more than 4M HTTP req/s โข Share semantics for several load-balancers โข HaProxy โข F5 โข Provisioning of much more than reverse proxies โข DNS (including Geo-DNS) โข TLS โข Real time creation of Services (less than 1 minute)
- 29. 29 โข โข Detect old applications โข Detect invalid ownership โข Old security groups โข Deprecated usersโฆ Services Scanner
- 30. 30 โข Consul-UI / Consul- Timeline โข Live logs for all services โข History of services โข http://github.com/criteo/consul- templaterb/ โข Provides real time updates about the status of all services โข Provides an history of changes for all services