Cassandra and DataStax Enterprise on PCF
0 likes865 views
The document discusses the integration of DataStax Cassandra and DataStax Enterprise on Pivotal Cloud Foundry (PCF), highlighting features like automated deployment, elastic scaling, and self-healing architecture. It outlines the mechanism for creating and managing on-demand clusters and details the platform's resilience and performance capabilities. The document also invites participation in an early adopter program for the Cassandra service on PCF and provides contact information for key personnel.
Cassandra and DataStax Enterprise on PCF
- 1. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Cassandra and DataStax Enterprise on PCF Ben Lackey DataStax @benofben Cornelia Davis Pivotal @cdavisafc
- 2. PIVOTAL Brokered Services PARTNEREDUSERPROVIDED … … PIVOTAL BOSH Managed Services PARTNER … … Automated, Polyglot Build/ Package/Deploy Container Scheduling Elastic (Auto)Scale PCF Elastic Runtime z PCF Tools • Apps Manager UI (App Admin UI) • CLI • REST APIs • PCF Metrics Dashboard Ops Manager UI (Cloud Admin UI) Mobile Push Notifications Dingo PostgreSQL Gemfire Redis RabbitMQ Spring Cloud Services Single Sign On MySQL HDB Greenplum DB VMware (vSphere + Photon) MS SQL Server … IBM DB/2 Active MQ Infrastructure OpenStack *Integration with various 3rd party visualization and management vendors Security (Application & Platform) Self-Healing & High Availability (Application & Platform) Zero Downtime Upgrades & Patches (Application & Platform) Integrated Logging/ Metrics* (Application & Platform) Dynamic Routing & Extensible Route Services Dev + Ops Role- Based Self-Service Access Amazon Web Services Microsoft Azure Google Cloud Platform Oracle DB Cluster Orchestration and Management (BOSH) Infrastructure Agnostic Software Packaging Multi-Cloud Orchestration of Infrastructure Provisioning Distributed Software Configuration and Health/Lifecycle Management Applications/APIs/Microservices Compiled, staged, containerized, deployed and managed by platform Pre-packaged container deployed and managed by platform Java | .NET | Ruby | Node.js | Python | PHP | Go Pivotal Cloud Foundry
- 3. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ How do we handle massive transactional data and never go down? 3© 2016 DataStax, All Rights Reserved. Schema Memtables Compaction SStables Commit Log
- 4. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/© 2016 DataStax, All Rights Reserved. Cassandra • Distributed self healing mesh • No active/passive • Peer to peer replication • No single point of failure • Writes are done to all nodes simultaneously • Data is safe from node, rack, and datacenter failure • Optimized for high volume, low latency operations 4
- 5. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 5 http://12factor.net/
- 6. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 6 Stateless apps allows the platform to do all sorts of things for you demo Factor 6 – Processes
- 7. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 7 Router Cloud Controller CELL CELL Data Service PCF Elastic Runtime Data Service
- 8. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 8 Router Cloud Controller CELL CELL PCF Elastic Runtime
- 9. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 9 demo
- 10. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Creating and Binding a DataStax Cassandra Service 10 Router PCF Elastic Runtime create resourcescreate service (HTTP) create service (HTTP) bind service (HTTP)bind service (HTTP) obtain connection data CLI Cloud Controller Service Broker
- 11. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ On Demand Clusters 11 create service CLI Service Broker
- 12. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ On Demand Clusters 12 create service CLI Service Broker BOSH Director create Manifest
- 13. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ On Demand Clusters 13 create service CLI Service Broker BOSH Director create bosh deploy via BOSH Director API Manifest
- 14. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ On Demand Clusters 14 create service CLI Service Broker BOSH Director create VM VM VM bosh deploy via BOSH Director API Manifest
- 15. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 15 PCF Data Center 1 PCF Data Center 2
- 16. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 16 PCF Data Center 1 PCF Data Center 2 Pipelines Distribute Deployments Active/Active
- 17. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 17 PCF Data Center 1 PCF Data Center 2 Pipelines Distribute Deployments “Active/Active”
- 18. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 18 PCF Data Center 1 PCF Data Center 2 Pipelines Distribute Deployments “Active/Active”
- 19. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 19 PCF Data Center 1 PCF Data Center 2 Pipelines Distribute Deployments Active/Active
- 20. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Summary • On-demand single tenant database-as-a-service on PCF • Supports DataStax Enterprise 5.0 (incl. OpsCentre 6.0) • Currently under active development • Early adopter program late Q3/early Q4 Vision: • DataStax multi-data center support We want to hear from you: • Damian O'Connor, daoconnor@pivotal.io (Product Manager for the Cassandra Service on PCF) • Cornelia Davis, cdavis@pivotal.io (Sr. Director of Technology, Platform) • Ben Lackey, ben.lackey@datastax.com (Partner Architect) 20
- 21. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Learn More. Stay Connected. Cornelia Davis @cdavisafc Ben Lackey @benofben @springcentral spring.io/blog @pivotal pivotal.io/blog @pivotalcf http://engineering.pivotal.io