Building a multi-tenanted Cloud-native AppServer
- 1. Building a scalable multi-tenanted Cloud-native Application Server using Tomcat, Axis2 & Synapse
- 2. Building a scalable multi-tenanted Cloud-native Application Server using Tomcat, Axis2 & Synapse Afkham Azeez Selvaratnam Uthaiyashankar azeez@{apache.org , wso2.com} shankar@{apache.org, wso2.com} WSO2 Inc WSO2 Inc
- 3. About the Presenters • Afkham Azeez – PMC member Apache Axis, Committer Synapse & Web Services – Member, Apache Software Foundation – Co-author, Axis2 Web Services – Director of Architecture, WSO2 Inc – Blog: http://blog.afkham.org • Selvaratnam Uthaiyashankar – PMC member Apache Axis & committer Web Services – Member, Apache Software Foundation – Senior Manager & Senior Architect, WSO2 Inc © WSO2 2011
- 4. Agenda • Overall Architecture • Elastic Load Balancer • AppServer • Logging • Data & storage • Metering & billing
- 6. Overall Architecture Clients ELB AS1 AS2 AS3 ASn Application Server - Elastic Cluster
- 7. Elastic Load Balancer - Based on Apache Synapse & Apache Tribes
- 9. Service Cluster Aware Load Balancing
- 11. Configuration
- 12. Proxy Port to Real Port Mapping
- 13. Proxy Port to Real Port Mapping
- 16. AppServer - Based on Apache Tomcat, Apache Tribes & Apache Axis2
- 17. Features • Webapp hosting • Uses embedded Tomcat • Services hosting • Axis2 AAR services • JAXWS services • Data services • etc…
- 18. Tomcat
- 19. Tomcat • Stuck thread detection valve • Multi-tenant access log • Webapp lazy loader valve • Tenant-aware Tomcat realm • Tenant-aware management console • Tenant-aware webapp contexts • Tenant-aware session manager
- 20. Clients Tenant Identification & Tenant Context Creation Access Log Valve Lazy Loader Valve Stuck Thread Detector Valve Request Interception WebApp
- 25. User & Role Management
- 26. web.xml - Integrating Identity into WebApps Automatically ties into Identity Management infrastructure
- 27. SaaS Mode • One webapp shared amongst all tenants • One webapp shared amongst selected tenants
- 28. Axis2
- 29. Messaging Messaging Engine In Transports Client Out Message Service Receiver Impl In Fault Out Fault
- 31. Axis2 Configuration & Contexts
- 32. Tenants & Super Tenant Tenant: foo.com Super Tenant Tenant: bar.com
- 33. Pluggable Deployers Deployment Engine POJO Webapp Services Data JAXWS Services Services
- 34. Pluggable Deployers Tenant: foo.com Super Tenant Tenant: bar.com
- 35. Ghost Artifact Deployer • Lazy loading deployment artifacts • Load the tenant configuration & only the required artifact • Unload artifacts & tenants after a period of inactivity
- 36. Ghost Artifact Deployer - Performance Initial Response Time (ms) Number of artifacts
- 38. Tenant-aware Security Manager • Main security manager delegates security verifications to tenant level security managers • Different tenants can have different security policies • Security policies are tied to the multi-tenancy package assigned to the tenant
- 39. Logging
- 40. Distributed Logging • Every service and custom applications logs are captured by the log4j/commons loggings settings • Logs are partitioned & stored by tenant • Logs are sent to the Manager service via syslog • Logs are then viewable / downloadable by tenant admins
- 42. Log Viewer – Stratos Manager {Super-Tenant}
- 43. Log Viewer – Stratos Data Services Server {Tenant User}
- 44. AppServer Logs
- 45. Data & Storage
- 46. WSO2 Cloud Data Solutions • WSO2 Data Server • Carbonized Cassandra Cluster • Database cluster • Carbonized HDFS Cluster • <Data> PaaS Offerings • Apache Cassandra as a Service • Relational Database as a Service • HDFS as a Service • We are also planning MapReduce as a Service as Future work.
- 49. Metering • Each services collects • Number of service calls • Request/response bandwidth • Registry bandwidth (upload, download) • Total registry space usage • Send above to BAM publishers, which sends the data to the BAM Service • BAM summarizes periodically • Summarized data will be centrally accessible
- 50. Throttling • Restrict tenants from using more than the allocated resources, depending on the usage plan • Number of users per tenant • Storage space • Number of requests to webapps, services etc
- 51. Usage Metering/Throttling • Number of users • Incoming and outgoing bandwidths • Request Response count
- 52. Billing • Scheduled invoice generation • Ability to view past invoices and the current(interim) invoice • Securely pay the invoice via Paypal • Notifies the customer via email on received payments • Notifies the super-admin on customers exceeding the credit limit • Presents a summary view to the super-admin
- 54. Recap • Attributes essential for an AppServer running on the Cloud – Elasticity, user management, data, logging, metering, throttling, billing • How Tomcat, Axis2 & Synapse were used to build a cloud-native AppServer
- 55. QUESTIONS?
- 56. Thank You!
Editor's Notes
- #29: Shankar will take over from here