V fabric overview
1 like1,122 views
The vFabric Cloud Application Platform provides a full suite of products including tc Server, RabbitMQ, GemFire, SQLFire, and App Director to build, deploy, and manage cloud applications on both private and public clouds. It offers developers tools for rapid application development as well as operations tools for automated provisioning and management of applications in production environments. The platform provides a full stack solution for building and running scalable Java applications in private, hybrid, and public cloud environments.
V fabric overview
- 1. vFabric | Cloud Application Platform Pronam Chatterjee pronamc@vmware.com twitter:pronamc © 2011 VMware Inc. All rights reserved
- 2. VMware Solutions for Cloud Computing End User Computing vFabric vCloud Infrastructure 2 2
- 3. VMware vFabric Cloud Application Platform vFabric The ideal application platform environment to run and manage your custom, Java applications – in the datacenter, virtualized environment, or the cloud. Messaging Data Management 3
- 4. Use Case: App Intelligence for “Just-in-Time” Infrastructure Hotel room promotion Hotel room comes online Users are booking rooms promotion ends Traffic PST 8 am 9 am 10 am 11 am 12 pm 1 pm 2 pm 3 pm 4 pm 5 pm Policy-based Capacity 4
- 5. New Applications Need To Be Portable vCloud partners Private Cloud Hybrid Cloud vFabric vFabric Your Java vSphere vSphere Spring App “In partnership with VMware, we are bringing Spring to Force.com.” Build your application “With VMware, we are making it easy Select the runtime platform for developers to create Spring Java apps in the cloud.” Deploy your application The industry’s first open PaaS 5
- 6. VMware Cloud Application Platform for Spring/Java Apps Programming Rich Social and Data Integration Batch Spring WaveMaker Code2Cloud Model Web Mobile Access Patterns Framework Tool Suite Services Java Runtime Web Runtime Messaging Global Data In-mem SQL App Monitoring Performance Mgmt (tc Server) (ERS) (RabbitMQ) (GemFire) (ElasticSQL) (Spring Insight) (Hyperic) Java Automated Optimizations Virtual Datacenter App Provisioning (EM4J, …) (AppDirector) Cloud Infrastructure and Management 6
- 7. Operational Control: tc Server Spring Edition vFabric tc Server 7
- 8. STS - Developer Efficiency SpringSource Tool Suite Spring Roo Grails Spring Java (Core, Rich Web, Integration) Groovy tc Server (Spring Insight) § Agile Development - Integrated Testing • Tight integration with tc Server minimizes application redeploys/restarts • Links performance issues to code traces highlighted in Spring Insight § Supports flexible deployment targets • tc Server, Java EE servers, VMware, Cloud, etc. 8
- 9. Tomcat is a Proven Standard WebLogic 26% Spring Applications JBoss 38% WebSphere 43% Apache Tomcat 68% 0% 10% 20% 30% 40% 50% 60% 70% Java Application Server Usage, Source: 2008 Evans Data Survey “ The adoption of Tomcat reflects the Java developers' preference for lighter, simpler technologies ” 9
- 10. tc Server Fills the Gap 10
- 11. Developer Efficiency: Deep Performance Insight into Spring Apps 11
- 12. Developer Efficiency: Deep Performance Insight into Spring Apps 12
- 13. Monitor: VM, OS, JVM, tcRuntime Container… " Monitor Application Server Status, Health, and Response Times " Availability, Session Count, Throughput, Utilization, Connection & Thread Pool Health, Deadlock Detection, Garbage Collection 13
- 14. vFabric EM4J (Elastic Memory for Java) Use ESX to Share Memory Between VMs Running Java Description Benefits • Use virtualization to • Higher consolidation through memory over-commit for overcome the Java workloads limitation of Java’s • Protect Java applications against workload spikes static heap without wasting memory • New ‘memory balloon’ • Lets you give Java more memory than it needs under runs inside JVM to normal load. Memory your application doesn’t need is capture unused returned to ESX but remains available in case it is memory and return it needed to avoid Java out-of-memory errors to ESX • Memory returned to JVM when it is under pressure 14
- 15. Lightweight Application Platform Harmonizes Lifecycle App Developer App Operator Create Apps Quickly Meet Business Goals Applications Spring tc Server Build Run Manage “ Setting up the infrastructure for an application used to take days. With “ Everything we did in Tomcat works the same way in tc Server, plus we Spring, we can do it in two hours. - Sahana Hussein Visa Europe ” have the additional advantages. ” - Jeffrey Hickman Arizona State Retirement System 15
- 16. Deployment Flexibility: Distribute or Combine tc Server tc Server tc Server Instance 1 Instance m ... Instance X Spring Spring Spring Spring Spring tc Server ver X (shared binaries) ... tc Server ver Y (shared binaries) Operating System & JVM 16
- 17. Breaking free of the RDBMS bottleneck Data Management 17
- 18. Scaling the Tiers The web and application tiers can be easily combined and virtualized. Nodes can be added or Load Balancer Add/remove web/ removed on the fly. application servers Web Tier Application Tier The database only grows by moving the VM to a larger Database Tier machine The disk systems can be virtualized and can grow on Storage Tier demand 18
- 19. Linear Scalability GemFire can achieve near linear scalability with nodes that can be added or removed on the fly. Scale Add/remove web/ application/data servers Disks may be direct or network attached Web, Application and Data tiers can be collapsed into a Optional reliable, asynchronous feed to Data Warehouse or single virtual machine. Archival Database 19
- 20. What is GemFire? Database • Storage • High Availability = • Persistence • Load Balancing • Transactions • Data Replication • Queries • L1 Caching + Messaging System + Service Bus • Data Distribution • System Integration • Event Propagation • Data Transformation • Guaranteed Delivery • Service Loose Coupling + Grid Controller + Complex Event Processor • Task Decomposition • Business Event Detection • Distributed Task Assignment • Real-time Analysis • Map-Reduce, Scatter-Gather • Event Driven Architectures • Result Summarization GemFire combines select features from all of these products and combines them into a low-latency, linearly scalable, memory-based data fabric 20
- 21. Memory-based Performance GemFire uses memory on a peer machine to make data updates Perform durable, allowing the updating thread to return 10x to 100x faster than updates that must be written through to disk, without risking any data loss. Typical latencies are in the few hundreds of microseconds instead of in the tens to hundreds of milliseconds. GemFire can optionally write updates to disk, or to a data warehouse, asynchronously and reliably. 21
- 22. Data-Aware Function Routing Data Aware Function Execute Batch Controller or Client Scatter-Gather (Map-Reduce) Function GemFire provides ‘data aware function routing’ – moving the behavior to the correct data instead of moving the data to the behavior. 22
- 23. Data Distribution Distribute GemFire can keep clusters that are distributed around the world synchronized in real- time and can operate reliably in Disconnected, Intermittent and Low-Bandwidth network environments. 23
- 24. GemFire virtualizes the database into the application tier Cloud Ready Add/remove web/ application/data servers Add/remove disk GemFire server is a small Java jar file that can be easily deployed with Java applications. Optional reliable, asynchronous feed to Data Warehouse or Archival Database 24
- 25. vFabric SQLFire Data Management 25
- 26. vFabric SQLFire: Scalability at the Data Tier § Speed: In-memory, distributed SQL database. § Scale: More scalable design than traditional RDBMS. § SQL: Familiar SQL interface, accessible from Java and C#. 26
- 27. vFabric SQLFire: Speed Through In-Memory Design 1Writes are 2Later asynchronously synchronously persisted across persisted to disk two servers SQLFire Database 27
- 28. vFabric SQLFire: Dynamic Scalability 3Remove nodes 1Add new nodes when load returns any time load spikes. to normal SQLFire Database 2Data is automatically rebalanced to new nodes. 28
- 29. vFabric SQLFire: A Real SQL Interface § SQLFire syntax is based on the SQL-92 standard. § SQLFire extensions are to Data Definition Language (DDL) only, e.g. CREATE TABLE. § DML 100% standards compatible. § JDBC and ADO.NET drivers. • Built-in, transparent high availability. § Easily accessible via Spring Data 29
- 30. Breaking free of the RDBMS bottleneck vFabric data director Powering Database-as-a-Service for Your Cloud 30
- 31. Data Problems Addressed by Cloud Database Sprawl Long Lead Time DB Tuning for Virtualization Corporate IT Shadow IT Database Lead time of provision or weeks clone request Server & Storage Database Implementation Provisioning & Tuning • Thousands of under-managed and • Database operations not fully • Database not designed for under-secured databases automated virtualized environments with • Long lead time for database dynamic resources • Difficult to enforce policy and compliance services for developers • DBA tunes databases to specific setup 31
- 32. vFabric Data Director • Powers database-as-a-service across private and public App App App App App App App App clouds vFabric Data Director Graphical User Interface/API • Self-service database virtualization platform for Self-service IT Control vSphere-Optimized traditional and new databases • First database enabled is PostgreSQL database with optimization for vSphere VMware vSphere 5 • Built on vSphere platform -- extends virtualization benefits to database layer 32
- 33. vFabric Postgres § First database enabled on vFabric Data Director § Based on PostgreSQL 9.0 • Fully ACID compliant, ansi-SQL compliant relational database • Proven architecture known for reliability and wildly used across industries § Added vSphere-Optimization include • Elastic database memory • Self-tuning and automatic configuration • Database-aware high availability • Live on cloudfoundry.com on 8/29 • Soon to be included in Micro Cloud Foundry 33
- 34. vFabric rabbitMQ An enterprise message solution is critical to today’s businesses. Messaging That Just Works Messaging 34
- 35. Customers love RabbitMQ – banking, web, social media, ... Estimate 300-500 in production, 20,000 in dev 35 vfabric.co/rabbitmq
- 36. RabbitMQ and AMQP: technical overview Consumers create queues; these buffer messages for push to consumers Queues are stateful, ordered, and can be persistent, transient, private, shared. Exchanges are stateless routing tables. Consumers tell queues to bind to named exchanges; each binding has a pattern e.g. “tony” or “*.ibm.*” Producers send messages to exchanges with a routing key e.g. “tony”, or ordered set of keys e.g. “buy.ibm.nyse” Exchanges route messages to queues whose binding pattern matches the message routing key or keys 36 vfabric.co/rabbitmq
- 37. UID – a lifetime digital identity for 1.2bn India residents 37 vfabric.co/rabbitmq
- 38. Breaking free of the RDBMS bottleneck vFabric App Director Powering Database-as-a-Service for Your Cloud 38
- 39. What is vFabric Application Director 1.0? § vFabric Application Director automates application deployments on hybrid clouds, specifically on VCD 1.5 Applications Custom or Packaged App binaries, config .war, .jar, .tar, .zip etc Application Stack Middleware, OS App servers, messaging, web servers, databases, opera7ng systems, load balancers, etc vCloud Director 1.5 39
- 40. vFabric Application Director – “Model-driven” cloud-ready App provisioning Application Blueprint Logical Application Topology with Application Binaries Application Policies, Configurations Pre-instrumented with App Monitoring Application Stack - (Middleware, OS) Architect Deployment Deployment Deployment Collection of deployment settings Profile Profile Profile Makes blueprints portable across clouds (dev) (test) (prod) App Dev, QA, Release Standardized configurations of OS, Middleware Automated Deployment Plans with Orchestration Catalog Deployment Environments Dev Org VDC Test Org VDC Prod Org VDC Middleware Admin Cloud Admin 40
- 41. vFabric Application Director Application Blueprint Application Binaries Application Stack - (Middleware, OS) Architect Deployment Deployment Deployment Profile Profile Profile Simplified (dev) (test) (prod) Standardized App Dev, QA, Release Cloud-Ready Automated Deployment Plans with Orchestration Extensible Deployment Environments Dev Org VDC Test Org VDC Prod Org VDC Cloud Admin 41
- 42. VMware’s Active Application Management strategy for IaaS Integrate with Application Performance Management (vFabric APM) for pre- instrumented monitoring & scaling of deployed apps App Provisioning App Performance Collaborate Monitoring Add Policy Capacity Deploy Monitor Components, Optimize Resources, Topology, resource Isolate, trouble Topology compliancy, allocation, Update Reboot shoot, remediate, transactions, users, environment change change impact binding . Burst Scale Policy compute 42
- 43. Application Director provisions vFabric and third party components 43
- 44. NPC International vFabric Helps NPC International Stay Connected to 1,200 Locations “ Application performance is considerably faster since we moved from JBoss to vFabric … We have been very happy with the performance – it is fantastic.” Jon Brisbin, Portal Webmaster, NPC International Challenge Solution Results Application not performing well on JBoss Replaced JBoss Application Severs with Enhanced Application Performance causing downtime; load often exceeded VMware vFabric planned capacity Server Costs Reduced by 75% vFabric instances running on VMware Application experienced regular lockups ESX Server-based private cloud High Availability every time JBoss received out of infrastructure memory errors causing server restarts Greater Scalability Since all web applications built in Costly downtime and other performance Spring, transition to vFabric was Virtual Private Cloud Infrastructure issues caused problems for users and seamless required substantial attention from Increased Developer Productivity development team 44
- 45. Use Case - ForEx real-life use case: Global Foreign Exchange Trading System The project achieved: Ø Low-latency trade insertion Ø Permanent Archival of every trade Ø Kept pace with fast ticking market data Ø Rapid, Event Based Position Calculation Ø Distribution of Position Updates Globally Ø Consistent Global Views of Positions Ø Pass the Book Ø Regional Close-of-day Ø High Availability Ø Disaster Recovery Ø Regional Autonomy 45