ESB Usage Scenarios and Patterns
7 likes3,555 views
The document discusses usage scenarios and patterns for enterprise service buses (ESBs). It provides an overview of how ESBs simplify connectivity between different applications and data formats. It then describes common usage patterns for ESBs, such as extending existing applications, connecting file and online systems, integrating remote devices, and getting the most from packaged applications. The document also discusses processing scenarios involving service virtualization, message-based integration, and event-driven integration. It provides examples of typical customer use cases.
ESB Usage Scenarios and Patterns
- 1. Hursley Comes To You ESB Usage Scenarios and Patterns Brian Hulse WSRR Development brian_hulse@uk.ibm.com WebSphere © 2010 IBM Corporation
- 2. Hursley Comes To You Agenda ESB and Connectivity Overview ESB Usage Patterns © 2010 IBM Corporation 2
- 3. Hursley Comes To You ESB and Connectivity Overview © 2010 IBM Corporation 3
- 4. Hursley Comes To You ESBs Simplify Connectivity File MQ/JMS soap/jms soap/http Enterprise Service Bushttp WebSphere MQ © 2010 IBM Corporation 4
- 5. Hursley Comes To You Enrich your SOA connectivity … Service Enrichment •Match & Route communications between services •Converts between transport protocols •Transforms between data formats •Identifies and distributes bus events … simplifying the overall architecture and reducing IT cost © 2010 IBM Corporation 5
- 6. Hursley Comes To You Agile Connectivity: The Enterprise Service Bus (ESB) Connects everything Matches & routes communications to everything between services Transforms between Distributes different data formats Business events Converts between different transport protocols An ESB enables flexible SOA connectivity for integrating business applications, services and processes © 2010 IBM Corporation 6
- 7. Hursley Comes To You Two core principles enable flexibility The ESB facilitates the decoupling of interactions between requestor(s) and provider(s) Service Service Provider Provider Service Service Service Service Requestor Requestor Requestor Requestor The ESB fulfils two core principles in support of separation of concerns: Service Virtualization Service Virtualization Aspect Oriented Connectivity Aspect Oriented Connectivity Routing Routing Security Security Log and Audit Protocol and transports Protocol and transports Management Management Event tracking Transformation of interfaces Transformation of interfaces etc … etc … © 2010 IBM Corporation 7
- 8. Hursley Comes To You Processing Scenarios & Usage Patterns © 2010 IBM Corporation 8
- 9. Hursley Comes To You Many Defined Patterns for ESB-based Solutions Service Virtualization Service Gateway Enablement OR OR OR Message-based Event-driven Integration Integration File Processing http://www.ibm.com/developerworks/wikis/display/esbpatterns/ © 2010 IBM Corporation 9
- 10. Hursley Comes To You Typical Customer Usage Patterns Extend the Reach of Existing Applications Connect File with Online for End-to-End Efficiency Connect Devices to the Enterprise Get the Most from Packaged Applications Distribute Database Information to Where It’s Needed Make An Application Inventory and Govern processing with a Registry Provide a PEP for Secure Application Connectivity Monitor your Business Activity and Act Intelligently Develop and Reuse Solutions with Patterns © 2010 IBM Corporation 10
- 11. Hursley Comes To You Extend the Reach of Existing Applications Expose existing applications without change SOAP & Web 2.0 based access to existing systems Create a gateway for routing and security INBOUND and OUTBOUND scenarios SOAP Web Services Established as Interoperability Standard – SOAP support allows ESB to act as WS-* façade to existing non WS-* applications • Support for SOAP/HTTP and SOAP/JMS (any), includes transactions & asynchronous processing Web 2.0/REST Provides Lightweight Universal Access – HTTP ubiquity & REST semantic provide universal access to existing systems – Popular with both XML and JSON payloads (JSON for lightweight clients) ESB Outbound Scenarios enable Existing Applications to request New Services – Existing application can invoke and exploit new services with existing technology WS provider clients Typical Customers – US Payroll Corp. exposes MQ applications via self service SOAP interface for responsiveness & accuracy – WW (US based) Airline access external web services from existing JMS/MQ reservation system – US Wireless Operator expose legacy billing systems via HTTP/XML for customer self service © 2010 IBM Corporation 11
- 12. Hursley Comes To You Connect File and Online for End-to-End Efficiency Unlock the valuable business data in your files Files exchange between applications still popular and effective – Flexible method of exchange: Neither enterprise has to mandate technology There are legitimate reasons for using files to exchange information – Usually relate to the way businesses run or physical processes occur Examples – A cargo ship has thousands of containers each with hundreds of palettes – Reduce unit transaction costs by aggregating numerous clients requests End to End File Movement and File Processing – Reliable and secure delivery File Transfer with MQ FTE – File processing allows clients to get file/batch work online, easily Typical Customers – German Retailer uses ESB & FTE for POS reporting to HQ & price list distribution to store – NE US Retailer using FTE & ESB to provide timely inventory updates to and from online systems © 2010 IBM Corporation 12
- 13. Hursley Comes To You Connect Devices to the Enterprise Monitor remote systems and devices Provide near real-time insight about physical systems, and act Industry Observation – “How to we get information from everywhere, understand it, and act?” – Medical, Energy and Utilities, Distribution, Transport, Gaming… – Issues based e.g. traffic congestion, efficient energy, timely supply… A Smarter Planet is full of devices – Data is generated *outside* the enterprise • Typically very large numbers of devices: • Often concentrator technology; differentiate, integrate & forward – MQTT for standards based device integration IBM is working with Brisbane, • Small footprint client, embeddable, Low bandwidth cost London, Singapore and • Fragile network support for hostile environments Stockholm to deploy smarter traffic systems. Stockholm has seen approximately 20 percent ESB to Connect Devices, Apply Intelligence less traffic, a 12 percent drop in – Connects MQTT devices to enterprise systems emissions and a reported 40,000 additional daily users of – Apply intelligence in near real-time; systems tend to be passive today public transportation. Typical Customers – US Medical and Technology services company monitors pacemakers for home health – Swedish city congestion charging, traffic calming and pollution reduction © 2010 IBM Corporation 13
- 14. Hursley Comes To You Get the Most from Packaged Applications Provide broad access to EIS systems Move information to and from packaged systems Packaged Applications Provide Best of Breed Business Function – SAP for purchasing, sales, inventory… – SEBL for Sales, PeopleSoft for HR – Oracle, JDEdwards…etc Interfaces are often non standard: e.g. SAP BAPIs, IDOCs – Processing and data are isolated from other applications – Result: packaged apps have difficultly using/generating information for other apps – Inhibits adoption of a best of breed philosophy Support for SAP, SEBL, PeopleSoft, JDEdwards… inbound and outbound – Connectivity built-in – no extra moving parts – Drive new work into its packaged application from any other supported source – Can send information from packaged application to any other supported target – Packaged applications can focus on what they do best and be integrated Typical customers – NA Railroad uses MB for all SAP to SAP communication – WW Pharmaceutical uses MB for order payment to SAP and distribution notification from SAP – WW Hotel chain uses MB for SEBL customer billing and sales systems © 2010 IBM Corporation 14
- 15. Hursley Comes To You Provide a PEP for Secure Application Connectivity Provide secure access to applications and services Understand and convert broad range of security domain identities Provide secure external access services to partners Connectivity often implies security domain change – ESB supports a broad variety of security tokens – Userid/pw, X509, SAML, Kerberos, LTPA… ESB is Policy Enforcement Point (PEP) – Security is enforced here, still owned by PDP – Identity management, access control, authorization and authentication mechanisms (AAA) are essential Policy Decision Point (PDP) and ESB work together – PDP combination provides a secure infrastructure – Ensures conformance to centralized security policy – Many different PDP technologies supported • Lightweight Directory Access Protocol (LDAP) Microsoft Active Directory, Open LDAP… • Tivoli Federated Identity Manager (TFIM) • WS-Trust, zOS SAF including RACF External Partner Access to Services – Security hardened DMZ device strengths 15 – Combine network and ESB functionality © 2010 IBM Corporation
- 16. Hursley Comes To You A Flexible Infrastructure to Support Change Enable Application and Service Replacement with minimum risk ESB creates a Virtual Service – Implementation details of a service to be hidden – Flexibility in implementation; change implementations without affecting consumers – Introduce new interfaces to existing service in parallel with new interfaces Examples include M&A, Decommissioning & External partner communication – Connect newly acquired systems, particularly relevant in M&A – Formats and Protocols of acquired technology differ from current systems – ESB provides managed interface to acquired systems for in-house systems – Provides new interface for acquired systems – Staged decommission of legacy implementations – Maintain existing interface to new implementation – Allows Managed risk of client migration – Often combined with new interface definition, often to enable service orientation – External partner communication – ESB provides interface to external systems – Allows partners to be swapped in and out without affecting consumers © 2010 IBM Corporation 16
- 17. Hursley Comes To You Make an Application Inventory & Govern Processing Understand your application assets and control their access dynamically Dynamically change processing without redeployment Provide processing policy and governance Catalog application and service assets using a registry, e.g. WSRR – Web Service and MQ Service definitions – Classifications: by function, owning department – Relationships: applications dependencies for life-cycle management, versioning – User defined properties (meta-data): Application=GOLD or Service=SILVER Service Use registry information in ESB routing Provider – Built-in ESB facilities allow access registry Use metadata to implement ‘smart’ • In memory cache for high performance mediations – Enables policy based processing, examples Virtual 3 • Simple routing based on client meta-data Service • Dynamic WS-SecurityPolicy processing • Dynamic transformation based on endpoint Service A’ A 1 Requestor – WSRR as critical governance point 2 Capture metadata about services for Advertise use by Service Bus availability of the ‘virtual Typical Customers services’ – US automotive sales company uses MB+WSRR • Timely match vehicle availability with customer request © 2010 IBM Corporation 17
- 18. Hursley Comes To You Monitor Your Business and Act Intelligently Understand the business relevance of ESB data Apply business rules to ESB data in-flight Detect business situations and act quickly ESB Connectivity Processes Events from many Sources, Targets – Capture business relevant information for WebSphere Business Monitor • Examples: total dollar trade value per day, orders per hour – Capture business events to correlation with WebSphere Business Events • Look for correlations in data, e.g. fraud, sales opportunities, CRM – Audit, Repair and Replay transported events ILOG rules Generate Business Monitoring Events from existing connectivity engine – Enables integration with WebSphere Monitor to display & analyze KPIs – Design time and operational time event activation – Notification via CEI & Publish subscribe Inputs Outputs Rule-based Decision Services render decisions on input data – Most often this data comes from a variety of data sources: aggregation, transformation is required – Rule-based Decision Services send outcome decisions to other systems: rule based routing Typical Customers – European Motor manufacturer creates virtual system of record for audit – NA Insurance company uses MB+ILOG for business decisions routing – UK Retail group measures store throughput by item for real-time trending © 2010 IBM Corporation 18
- 19. Hursley Comes To You Detect and Act Upon Business Events Compose existing applications and services to create new value ESB Event Capture and Process Initiation – Breadth of ESB connectivity enables multiple business process starting points • Identify event and initiate business process • e.g. message, file, web service, device endpoints can start business process – Synchronous and asynchronous invocation for short & long running transactions • Multiple options with Process Server, Lombardi, FileNet… Business Process Connectivity – Exploit range of ESB connectivity to abstract and simplify BPM – Process focus on WHAT rather than ESB focus on WHERE, HOW concerns – ESB receives service request and routes, re-formats, interacts with provider Business Process Business Process IBM BPM 7.5 ESB ESB © 2010 IBM Corporation 19 Web Service, SAP, MQ, File…
- 20. Hursley Comes To You Develop & Reuse Solutions with Patterns Develop connectivity solutions quickly Capture previous experience for cost reduction Ensure solutions conform to best practices Use ESB’s built-in Patterns to Kick-start Development – Built-in patterns for Web Services, Messaging, File, SAP... – Guided solutions using top-down, parameterized approach – Development artefacts are generated from solution template Create your own Patterns to suit your Business needs – Simple to create your own solution template – User patterns! – Start from an existing Message Broker solution or IBM pattern – Ensure specific business: e.g. audit, notification, validation… Create and Participate in Public and Private Communities – Create reusable assets for sharing across your business – Full check-in/out & versioning with any Library Control System – Private Communities for internal sharing via Web Content tools – Public communities for more widely available patterns Typical Customers – Swedish partner providing patterns for low cost off-premises connectivity – WW GSI using patterns for quicker time-to-value and cost reduction – mqseries.net public patterns community launched Nov 2010 • Patterns created, rated & used by mqseries.net community © 2010 IBM Corporation 20
- 21. Hursley Comes To You Patterns: WESB Service Gateway accelerator © 2010 IBM Corporation 21
- 22. Hursley Comes To You Patterns: WESB Service Gateway accelerator © 2010 IBM Corporation 22
- 23. Hursley Comes To You Patterns: WESB Service Gateway accelerator (Static 3) © 2010 IBM Corporation 23
- 24. Hursley Comes To You Multiple ESB offerings Solutions to Meet Any and Every Demand Platform Based Integration Based WebSphere WebSphere Message Broker Enterprise Service Bus Built for universal connectivity Optimized with WebSphere and transformation in Application server for an heterogeneous integrated SOA platform IT environments Shares common registry, Appliance Based Message transformation security, administrative and developed to accommodate development tools WebSphere disparate service interfaces Services hosted on the Adapters, protocol bridges DataPower application server Integration Appliance XI50 packaged with applications and legacy platforms Hardware built for simplified deployment and hardened security Functions developed in one device © 2010 IBM Corporation 24
- 25. Hursley Comes To You The ESB … at the heart of a smart connectivity ‘ecosystem’ Service Orchestration and BPM Service Monitoring Business Rules IBM BPM 7.5 Tivoli CAM for SOA WebSphere iLog JRules Service Security Universal Tivoli Security Products Transformation Service Registry Publish Find Enrich Manage Govern WebSphere Transformation WebSphere Service Extender Registry and Repository Messaging Backbone for SOA MQI Java JMS XMS for .NET C# XMS for C/C++ WebSphere MQ messaging backbone © 2010 IBM Corporation 25 WebSphere MQ