SlideShare a Scribd company logo
Future Distributed
Computing Architectures
and the Role of SOA
Robert Marcus
robert.marcus@sri.com
My SOA-related Background
Introduced SOAP and XML into General Motors
Organized Software Services Grid Workshop including
W3C, OMG, OASIS, and OGF groups
Developed a SOA strategy for Rogue Wave Software
Proposed Service-Based Architecture for Hong Kong
Wrote book on the “Great Global Grid” including SOA
Director of Colorado Grid Computing Initiative
Organized SOA workshops for US government audience
Emerging Standards for SOA
SOA Deployment: Industry Best Practices
Cloud Computing for Net-Centric Operations
Theme of SOA Extensions Talk
There is a movement underway from
classic “SOA” to a new generation of
Service Based Architectures including
Web 2.0, Event Driven Architectures,
Mobile Clients, Embedded Systems
Information Grids, and Cloud Computing
Overview of the Talk
SOA Evolution
Service Oriented Levels
Web 2.0 – WOA, Ajax and Mashups
Everything as a Service (Cloud)
Event Driven Architectures and Processing
Pervasive Computing
Social Networking
Mobile Device Services
Data Middleware
Semantic SOA
Information Grid
Great Global Grid
Service Oriented Architecture
(SOA) Evolution
Pre-SOA Enterprise
Heavily siloed; built with familiar models:
Database-centric; Client-server/n-tier; Messaging/pub-sub
DB
Client
App Server
Client Client Client
BUS
App Server
ClientClient Client Client
App ServerApp Server
DBDB
Client
DBDB
App Server
App ServerApp Server
Mainframe
App Server
From Hugh Grant of Credit-Suisse
Transition to Service Oriented Vision
7
From David Chou
of Microsoft
Many Web Services Standards
From Chinese International Standards Open Lab
Current Enterprise SOA
Web services used within individual silos
In reality, many interfaces are not SOAP-based
Java
Client
Web
Client
Web
Client
Client
BUS
Java
Client
Java
Client
.NET
Client
.NET
Client
.NET
Client
Java
Client
J2EE
Server
.NET
Client
.NET
Server
.NET
Server
SOAP SOAP
SOAP
CLASSIC CLIENT-SERVER
DB
J2EE
Server
App
Server
.NET
Server
J2EE
Server
DBDB DBDB
.NET
Server
App Server
.NET
Server
Mainframe
CORBA
Server
.NET
Server
J2EE
Server
CORBA
Server
SOAP
SOAP
WRAPPER
SOAP AS INTEGRATION GLUE
Web
Client
Web
Client
App
Server
SOAP SOAP
SOAP AS WEB GLUE
From Hugh Grant of Credit-Suisse
Enterprise Service Bus (ESB)
ESBs are the foundation of most robust SOA deployments
ESBs can support routing, multiple transports, data conversions,
reliability, and event response
The next generation of ESBs must extend interoperability across
organizational boundaries (e.g. other ESBs, B2B, Clouds)
10
From Fiorano
Service Oriented Levels
A Service provides functionality that is accessible through predefined interfaces and protocols
Definitions of SOA
SOA has many definitions which has caused confusion
“SOA also describes IT infrastructure which allows different
applications to exchange data and provide and consume
services with one another as they participate in business
processes” (Development)
“SOA is a methodology for systems development and
integration where functionality is grouped around business
processes and packaged as interoperable services.” (Analysis
and Design)
Software as a service is a model of software deployment
where an application is hosted as a service provided to
customers across the Internet. (Deployment)
All of the above definitions are from Wikipedia
Service Oriented Definitions
Service Oriented Middleware – Supports
connection, interaction, and composition of
distributed services
Service Oriented Architecture – Functionality
designed, developed, and deployed to be used
in a pre-defined shared services architecture
Service Oriented Clouds – Infrastructure
including software, computers, and storage
dynamical allocated as scalable services
13
Service Oriented Levels
Service Oriented Middleware (SOM)
Integration and Interfaces (e.g. Web Services)
Designed by Technical Architects
Services are end-points supporting access to capabilities
Service Oriented Architecture (SOA)
Modeling, Structuring, and Governance
Defined by Enterprise System Architects driven by Business Analysis
Services are functional components supporting business processes
Service Oriented Cloud (SOC)
Computing Resources as Virtualized Services
Specified by Enterprise Managers
Services are computing resources supporting flexible operations
All of the above can be used together or independently
Service Oriented Levels Examples
Service Oriented Middleware (SOM)
Web Oriented Architecture (WOA) and REST
SOAP-based, WS-*, Enterprise Service Bus (ESB)
Business Process Execution Language (BPEL)
Service Oriented Architecture (SOA)
Shared Services Enterprise Systems Architecture
Governance, Policy, Management
Business Process Modeling Notation (BPMN)
Service Oriented Cloud Architecture (SOC)
Software as a Service
Platform as a Service
Infrastructure as a Service
Web Services to Cloud Computing
16
From OGF
Middleware (SOM)
Architecture (SOA)
Cloud
(SOC)
Combination of SOM, SOA, and SOC
Service Container
Client Mash-up
AJAX AJAX
Service Service
Workflow / Orchestration Layer
Composite
Service
Composite
Service
Composite
Service
Service Container
Service Service
Service Container
Service Service
Service Container
Service Service
Client Mash-up
AJAX AJAX
Client Mash-up
AJAX AJAX
Client Mash-up
AJAX AJAX
Client Mash-up
AJAX AJAX
Utility Compute Cloud
From Hugh Grant of Credit-Suisse
SOM
SOA
SOC
Gartner Hype Cycle 2008
18
SOM
SOA
SOC
Web 2.0 (WOA, Ajax and Mashups)
Service Oriented Middleware
Web Oriented Architecture (WOA) Terms
REST – Representational State Transfer is an architecture style for distributed
systems based on transferring and manipulating resources
Ajax (Asynchronous Java and XML) – Toolkits for building browser
interfaces using scripting (e.g. Javascript), Web data formats (XML) and
asynchronous access to Web data (XMLHttpRequest)
Mashups – Combining data from multiple sources into an unified
representation for display or manipulation
Rich Interface Applications (RIA) – Robust client side user interface (e.g.
Ajax, mashups) running within an Web browser
WOA – Uses native Web protocols and data types for clients (e.g. RIA),
transport (HTTP) and servers (e.g. Get, Post for REST )
Web 2.0 - Collaborative applications based on Web platforms (e.g. WOA)
20
WOA Foundations
Information in a WOA is represented as
resources on the network
Every resource on the network can located via a
globally unique URI
Resources are manipulated by HTTP verbs
(GET, PUT, POST, DELETE) i.e. Representation
State Tranfer (REST) style
WOA resources contain embedded URIs that
build a larger network
The service contract of WOA resources is implicit
21
WOA vs SOAP-based Middleware
22
WOA SOAP-based
Resource based Service based
Individual URIs for each resource
over HTTP
Single end-point for SOAP server
(multiple transports)
Uses standard HTTP verbs Get,
Put, Post , Delete
Use SOAP content to determine
verb
Web Application Description
Language can be used
Web Services Description
Language
Simpler data formats (e.g. JSON
Javascript Simple Object Notation)
SOAP encodings
Easier to mashup in browser and
easier interface to Ajax
More difficult to mashup in browser
Fewer supporting standards Wide range of supporting
standards
Easier development but not as
robust
More complex development but
more robust
WOA vs. SOA Attributes
23
WOA Formats, Links, and Resources
From Dion Hinchcliffe
Applications with REST APIs
Zoho – Suite of applications
Twitter – Microblogging
Facebook – Social network
Amazon – Their REST APIs are much more popular
than their SOAP APIs
eBay - REST and SOAP APIs
Google – Dropped support for their SOAP Search API
in favor of the REST APIs
Salesforce.com - SOAP-based API and REST APIs
Mashery - A new company that manages REST
APIs as a Service
25
Popular Web APIS
Google Chrome
New browser designed to be a front-end for WOA and
could be a future client “operating system”
Tabs and plug-ins all run in independent processes
providing enhance security
Multicore chips will enable increased performance
Fast JavaScript virtual machine including dynamic
code generation will support higher performance Ajax
Task Manager provides visibility of process memory,
CPU and network usage
Elements of Chrome will run on Google’s Android
mobile platform in the future
27
Nexaweb RIA and SOM Architecture
Example: Combining WOA, SOA,
Mashups, Ajax, and Web Push
Nexaweb RIA and SOM Architecture
29
Web 2.0 connecting to Information Cloud
30
Emerging Future for SOA
RESTful Web Services and WOA are becoming
the predominant Service Oriented Middleware
SOAP-based middleware is considered to be
too complex by many developers
Service Oriented Clouds will be an increasing
part of deployments
The need for enterprise Service Oriented
Architectures will increase to maintain control
over WOA and Cloud implementations
31
Everything as a Service (Cloud)
News: IBM opened a Cloud Computer Center in Bangalore on September 24
Service-Oriented Clouds Definition
Infrastructure including software, computers,
and storage dynamical allocated as services
using distributed virtualization for scalability
33
Cloud Computing Services Layers
Application Services (e.g. Software as a Service = SaaS)
Middleware and Data Services (e.g. Database as a Service)
Development and Deployment Services (e.g. Platform as a Service)
Resource Services (e.g. Infrastructure as a Service)
Computing Hardware and Physical Storage
Event, Processes, Interfaces (e.g. Event Processing as a Service)
Distributed Virtualization Services
Service Oriented Cloud Architecture
Cloud-based Services
e.g. databases, queues
Software
as a Service
Platform
as a Service
Infrastructure
as a Service
Internet and
Web 2.0 Clients
Cloud Storage
and Data Sources
Cloud Servers
Cloud Tools
e.g. development, monitoring
configuration
Cloud Middleware Services
e.g. dynamic allocation, security,
workflow
Virtualized Resources Cloud
Service Oriented Systems
Workload Distribution in the Cloud
3610/7/2008
Software as a Service (SaaS)
Some Software as a Service Suppliers
Salesforce.com - Customer Relationship
Management
Netsuite – Business applications
Workday – Human Resources
Zoho – Online office
Google App – Collaboration and Messaging
Facebook – Social Network
Cisco’s Webex – Conferencing
SAP BusinessByDesign- ERP for small business
38
Infrastructure as a Service (IaaS)
Sun’s Network.com
Provides hardware (Sun), software (Solaris-based),
and storage resources on a pay-per-use basis
Usage modes
Upload and run applications through a portal or an API
Run applications from a catalog or utilize long-running services
ATT Synaptic Hosting
41From ATT
VMware vCloud
The new VMware Cloud Services have the three levels below
VMware Ready use VMware Infrastructure to deliver flexible enterprise class
cloud, hosting, and managed services.
VMware Ready Optimized use the Cloud vServices API, vApp technology, the
OVF specification, and other VMware technologies to provide enterprise class
virtualization capabilities for on-premise datacenters and in off-premise clouds.
VMware Ready Integrated enable a common approach to integrated
manageability between on-premise and external clouds as part of vCenter,
42
Amazon Web Services
43
Examples of Cloud Computing Stacks
44From Dion Hinchcliffe
Cloud Services Stacks
Google App Engine
MapReduce
BigTable
Google File System
Sawzall (Query on top of MapReduce)
Protocol Buffers for data description and Remote Procedure Calls
Amazon Web Services
Elastic Computing Cloud (EC2)
Simple Storage System (S3)
Simple Queuing System (SQS)
SimpleDB (Database)
Elastic Block Store (EBS)
Open Source
Yahoo Hadoop (MapReduce), Hbase , HDFS(Google-like), Pig (Query on
top of Hadoop), UCSB Eucalyptus (Amazon-like),
Many vendors building development platforms for Clouds
Industry Cloud Computing Initiatives
Amazon’s Web Services http://aws.amazon.com/
VMware VCloud http://www.vmware.com/go/vcloud
Sun’s Network.com Internet Utility Computing
http://network.com/
AT&T Synaptic Hosting http://blogs.zdnet.com/BTL/?p=9560
IBM’s Blue Cloud for Enterprises
http://www-03.ibm.com/press/us/en/pressrelease/22613.wss
Citrix Cloud Center for Enterprises http://www.citrix.com
Research Cloud Computing Initiatives
IBM, Google and US National Science Foundation
“Cluster Exploratory” (CluE) initiative
http://www.nsf.gov/news/news_summ.jsp?cntn_id=111470
Yahoo, HP, and Intel “Cloud Computing Testbed”
http://www.techcrunch.com/2008/07/29/hp-yahoo-intel-announce-
cloud-computing-research-initiative/
IBM and EU’s “Resources and Services Virtualization
without Barriers” (Reservoir) http://websphere.sys-
con.com/node/495772
Enterprise Cloud Computing
August 24, 2008
IBM’s Model for Cloud Computing
Service Request &
Operations
Service
Creation & Deployment
End User
Requests
& Operators
…
Design
& Build
Image Library
(Store)
Deployment
Operational
Lifecycle
of Images
IT Infrastructure & Application
Provider
Virtual Image
Management
Service Catalog
Request UI
Operational UI
Standards Based Interfaces
Virtualized Infrastructure
Service Management
Service Oriented Architecture Information Architecture
Standards Based Interfaces
Service Catalog,
Component
Library
Datacenter
Infrastructure
Cloud Administrator
Access
Services
Internal SOA and External SaaS
5010/7/2008
From Infoworld
Linking Enterprise and Internet Clouds
51
From David Chappell
Firewall
Citrix Cloud Center
52
Enterprise Cloud Computing Workshop
8:00 – 9:00 HP
Susanne Balle (Architect, Scalable Computing and Infrastructure Organization)
"Emergence of Cloud Computing“
9:00 -10:00 IBM
David Lindquist (Cloud Computing chief architect and IBM Fellow)
Lauren States (VP of Cloud Computing)
"IBM's Perspective on Cloud Computing“
10:00 – 11:00 Google
Todd Wiseman (Manager, Google's Federal Enterprise Team)
Cloud Computing from Google"
11-00 – 12:00 Amazon
Jeff Barr (Chief Evangelist for Amazon Web Services)
"Amazon Web Services: Cloud Computing in Action“
12:00 – 1:30 Discussion about an Enterprise Cloud Computing group with
industry, government and standards groups members
53
Enterprise Cloud Computing Group
An Enterprise Cloud Computing Group was initiated
September 17 at an NCOIC.org meeting including industry,
government, standards groups, and vendors
The goal of the Group will be to exchange information
about standardizations, critical requirements, best
practices, use cases, success stories, and emerging
technologies
There is a planned follow-on meeting at an Open Group
Conference in San Diego, February 2-5, 2009
54
Platform as a Service (PaaS)
Platform as a Service Example
Several companies are supplying Platform as a
Services for high performance computing fabrics
e.g..Amazon EC2 and S3From GigaSpaces
Elastra Platform on top of IaaS
Elastra proposed Elastic Computing (ECML) and Deployment
(EDML) Markup Languages as potential standards
ECML
EDML
e.g..Amazon EC2 and S3
Integration as a Service
BT provides an appliance for SOA integration
The software includes Progress ESB and iWay data
connectors
Installed onsite and managed remotely
58From BT
Desktop as a Service (Desktone)
59
NComputing (Shared PC Desktops)
NComputing allows up to 30 users to share a PC
Users have very inexpensive, low power terminals
Many-core PCs will make this approach a big global winner
Macedonia provides a terminal to all students in the country
60From NComputing
Event Driven Architectures
EDA and SOA
From http://soa-eda.blogspot.com
Web Distribution Mechanisms
63From Dion Hinchcliffe
Push Technologies
In general, push technologies for events and
messages are a good match for WOA
Syndication Services - There are many protocols (e.g.
RSS, Atom) based on polling for distributing
information on the Web (logical push)
XMPP – Protocol underlying instant messaging that
can be used to carry XML content
Comet and Bayeux – Comet is a term for describing
push updates through HTTP Server Push. Bayeux is a
publish-and-subscribe capability on top of Comet
Publish-and-subscribe messaging – Available through
ESBs and other middleware
64
65
Databases
Intranets /
Extranets
Email
Portals
Enterprise
Search Web Servers
Apps: eg,
ERP, CRM
[ manage information ]
[ transform and deliver ]
[ automate relevancy ]
[ monitor data ]
Blogs &
wikis
Recordchanges
Docrevisions
Orderstatusupdates
Priceupdates
Productchanges
Calendarevents
Salesleads
Content-based routing Alerts / Notifications Transformation
Aggregation Filtering / Matching Security
In-line editors
Collaboration Tools
Email
Comet-based Syndication
Complex Event Processing
Event Sensing and Service Response
HQ OperationsField Operations
Observation and Control Components
In
Event
Input
u
Complex
Event
Processing
In
Response
Outputs
u
Assessment
and
Decision
Preprocess
Simple
Event
Processing
SituationObject
Simple Response
Service Composition of Services
Complex
Response
Sensor and Effects
Management
Measurement
Field Processors
Data Structured Data Information
Service Oriented Architecture
Event Driven Architecture
Response
Event
External
Input
External
Output
from Tim Bass
Complex Event Processing Reference Model
Complex Event Processing will:
Save multiple man-years of development & maintenance
Speed time-to-market
Dramatically increase responsiveness to the business
InputDataStreams
Execution
Continuous Processing, Synchronization, Threading, Security, Clustering, Availability
Output Control
Ordering
Routing
Delivery
Interfaces
Pattern
Matching
Specification
Identification
Non-Events
State
Persistence, Caching, Locking, Database Reads/Writes
Data
Management
Filtering
Indexing
Windows
Merging
Correlation
Aggregation
Stream
Management
Ordering
Routing
Delays
Missing Mgs.
Decomposition
OutputEvents
From Coral8
Complex Event Processing Engine
Event Processing as a Service
Complex event processing (CEP) is a key component for
many application areas (e.g. finance, supply chain,
situation awareness)
Required resources for CEP may fluctuate greatly over
time (e.g. emergency response)
Deploying “Event Processing as a Service” on a Cloud
infrastructure could support dynamic requirements
“Event Processing as Service” needs standardizations:
Identifying event sources to be monitored
Describe event patterns of interest
Specify quality of services for reporting events
Presentation on “Event Processing as a Service” to
Event Processing Technical Society last week
Event Processing Using Multiple Services
Remote Monitoring as a Service
Selection of sensing source and data feeds to monitor
Ability to turn on sensing sources or data feeds
QoS as a Service
Event transmission and processing as a Service using priorities
Network and compute resources to be applied
Pattern Detection (CEP)
Computing as a Service to obtain resources
Software as a Service to utilize specific applications (e.g. CEP)
Select Sources Select Priorities Select Patterns Event Processing as a
Service
Map Reduce(Complex Event Processing)
Event ID,
Event Attributes
Pattern ID, Partial Match
Pattern ID,
Complete Match
by Pattern ID
Embedded Systems
Microsoft Robotics Studio
CCR (Concurrency and Coordination Runtime) - Highly
concurrent, message handling with orchestration primitives enabling
simplified message coordination and response to failures
DSS (Decentralized Software Services) – REST-based
framework for services using HTTP extensions for structured data,
notifications, and composition.
Service-based Orchestration using CCR and DSS
75From: http://msdn.microsoft.com/en-us/library/bb648752.aspx.
SODA Architecture
SODA is the “Service-oriented Device and Delivery
Architecture” from the Eclipse Foundation
From IEEE Pervasive Computing
Device Profile for Web Services (DPWS)
A proposed OASIS standard for resource constrained
end-points
Provides key services for networking devices include:
Discovery services
Metadata exchange services.
Publish/subscribe eventing services
Uses core SOAP Web Services such as SOAP, WSDL,
WS-Security, WS-Policy, WS-Addressing,
Also supports WS-MetadataExchange, WS-Transfer,
WS-Discovery, WS-Eventing to provide key services
OASIS has just started a Web Services Discovery and
Devices (WS-DD) Technical Committee to standardize
DPWS, WS-Discovery, and SOAP over UDP.
77
Socrades
Socrades is Service-Oriented Cross-Layer Infrastructure for
Distributed Smart Embedded Systems research project
DPWS is the
Device Profile
for Web Services
Device-to-Business Requirements
79From SAP for Socrades
Sensors to the Enterprise
From SAP
Social Networking (Crowd Computing)
Open Social for Social Networking
Facebook Application Architecture
Facebook Query Language (FQL) – Simple SQL-like query language for
accessing user profiles, friends, groups, events, and photo
API – Web Services interface with a client library
Facebook Markup Language (FBML) – Subset of HTML + Proprietary
Extensions including UI and procedural tags
83
Mobile SOA
Rogue Wave Internet Dispatcher 2000
85
IBM Mobile Web Initiative
Led by IBM Bangalore
Targeted at mobile phones
The Spoken Web - Voice-enabled mobile commerce
Instant Translation - Real-time communication between
multiple languages through mobile devices
SoulPad - Enabling any portable device to carry
computing applications in your pocket
Social networking on-the-go
Good Samaritan - Mobile healthcare information made
available in any emergency situation
Open Handset Alliance
Consortium of over 30 companies from all aspects of
mobile phone computing
Supports the Android platform developed by Google
Built on the Linux 2.6 kernel
Comprehensive set of libraries
Rich multimedia user interface
Many phone applications
Porting of Google’s new Chrome browsers capabilities to Android
could enable new applications
Microsoft “Mesh” Strategy
Live Mesh – Unified device, data, and application management
Social Mesh – Office Mobile and Office Live Workspace
Business Mesh - Office Live Small Business and Online Services
Also there will be online Skymarket for downloading Windows Mobile 7 apps
From www.microsoft.com/presspass/download/press/2008/0423ServicesStrategyUpdate.pdf
Sun’s MSOA Framework
MSOA Software Architecture
90
Sun Project Hydrazine
Data Middleware
Data Integration Types
ETL – Extract, Transform, Load
EAI – Enterprise Application Integration
EII – Enterprise Information Integration
From: www.dmreview.com
Roles of EAI, ETL, and EII
EAI moves small amounts of data to enable synchronization
ETL moves large amount of between data stores
EII moves and merges data from multiple sources for decision support
From: www.dmreview.com
Data Integration and SOA
Standard XML data representations simplify
integration when high performance is not needed
EAI is performed by the Enterprise Service Bus
EII can be implemented as mashups
ETL can be implemented with the SOAP Message
Transmission Optimization Mechanism (MTOM)
DataPower Appliances from IBM
96
XML Accelerator
Data Transformations
Policy Enforcement
High Performance Data Middleware
XMPP from Jabber provides a light-weight standard
transport for large volumes of small XML messages
Data Distribution Services (DDS) is an OMG standard
for real time publish-and-subscribe messaging with
guaranteed QoS
Protocol Buffers is a recently open sourced non-XML
based data serialization at the foundations of Google’s
RPC architecture http://code.google.com/p/protobuf/
Facebook’s Thrift provides similar cross-language and
data serialization RPC capabilities as Protocol Buffers
http://incubator.apache.org/thrift/
OMG Data Distribution Service
From RTI
Semantic SOA
Evolution to Semantic Web Services
RDF,
OWL
SOAP,
WSDL
OWL-S
WSDL-S
Semantic Web
OWL-S
Ontology Web Language for Services
A W3C OWL language/ontology for formally describing
properties and capabilities of Web Services
Based on input from many sources
Description Logic
AI Planning
Workflow
Formal Process Modeling
Agents
Web Services
Reference http://www.daml.org/services/owl-s
102
OWL-S Ontologies
UIMA
UIMA – Unstructured Information Management Architecture
Uses Semantic Analysis to add structure to unstructured information
Initial development by IBM then transferred to Apache
104From IBM
Open Calais Semantic Indexing
Open Calais has a Web Service that converts
unstructured data into W3C RDF format
Initially the Web Services can extract names, facts
and events from documents
Open Calais also supplies tool, applications, and an
API to the output that can be used by other Web tools
105
Information Grids
10710/7/2008
Information Grid
From Geoffrey Fox of OGF
108
Colorado Information Grid Vision
Instruments
Data
Visualization
Large-Scale
Databases
Small
Computers
HPC
Mobile
Computing
Sensors
DoD Global Information Grid - Definition
“Globally interconnected, end-to-end
set of information capabilities,
associated processes, and personnel
for collecting, processing, storing,
disseminating, and managing
information on demand to warfighters,
policy makers, and support
personnel.”
11010/7/2008
Global Information Grid (GES.DOD.MIL)
11110/7/2008
Global Information Grid
Net-Centric Operations 2.0 for Defense
1. Web Client
Application
4. Composites
2. Web Message Bus
3 .Enterprise
Service Manager
5. Enterprise
Service Buses
6. Enterprise
Data and
Systems
8. Tactical
Networks
7. Gateway
Adaptor
Data
Browser – RIA, AJAX, Mashups
XML over
HTTP
XMLHttpRequest
Web Server
SOAP over
HTTP
SOAP Server, WCF Host, Application Server
Services, SCA Services, SCAESBs with multiple transports
Orchestration – BPEL, JBI, BizTalk
Data
HTTP
Enterprise
Mashups/Pipes
System
Aggregation
Gateway Server – Protocol and Data Transformations
Sensor Networks, Mobile Platforms, Devices, Gateways (DDS, Efficient XML)
Event Processing
External
Interfaces
SDOSDO
HTTP Server
Push
ESB and Tactical Network Interface
Sensors to Data Grid to SOA Workflows
From HiSeasNet.ucsd.edu
Great Global Grid
Convergence of Technologies
GREAT
GLOBAL
GRID
Cloud
Computing
Data Intensive
Computing and
Infrastructure
Everything
as a ServiceService Oriented
Architectures
Event Driven
Architectures
Sensors
and Devices
High Productivity
Computing and
Networking
Rich User
Experiences
(Web 2.0)
117
The Great Global Grid is universal
access (when authorized) to shared
services including application,
collaboration, communication, data,
software, and hardware
Free Book - http://www.great-global-grid.com
Great-Global-Grid.com Book (2002)
END

More Related Content

PDF
Software Evolution: From Legacy Systems, Service Oriented Architecture to Clo...
PDF
Service Oriented Architecture & Beyond
PDF
Service Oriented Architecture
PPTX
Service Oriented Architecture (SOA)
PPT
Web 2 0 Fullfeatures
PPT
Web 2 0 Fullfeatures
PPTX
Web Services - Introduction
Software Evolution: From Legacy Systems, Service Oriented Architecture to Clo...
Service Oriented Architecture & Beyond
Service Oriented Architecture
Service Oriented Architecture (SOA)
Web 2 0 Fullfeatures
Web 2 0 Fullfeatures
Web Services - Introduction

What's hot (20)

PPT
SOA Fundamentals
PDF
Arquitectura orientada a servicios
PPTX
Introduction to SOA
PPT
Soa chapter 5
PPT
Soa & Bpel With Web Sphere
PPTX
Service Oriented Architecture (SOA)
PPT
Service Oriented Architecture
ODP
Service oriented architecture 27 May 2014
PPTX
SOA Reference Architecture
PPTX
Service oriented architecture characteristics of soa
PDF
6 develop web20_with_rad-tim_frnacis_sarika-s
 
PPTX
2014 q3-platform-update-v1.06.johnmathon
PPTX
Concept of SOA
PPT
Service-oriented Architecture with Respect to Reusability
PDF
Introduction to Micro Services
DOCX
Part II - Summary of service oriented architecture (SOA) concepts, technology...
PPT
Open-Xchange
PPT
Service Oriented Architecture
PPTX
Semantic Mediation Bus Presentation at VORTE 2012
SOA Fundamentals
Arquitectura orientada a servicios
Introduction to SOA
Soa chapter 5
Soa & Bpel With Web Sphere
Service Oriented Architecture (SOA)
Service Oriented Architecture
Service oriented architecture 27 May 2014
SOA Reference Architecture
Service oriented architecture characteristics of soa
6 develop web20_with_rad-tim_frnacis_sarika-s
 
2014 q3-platform-update-v1.06.johnmathon
Concept of SOA
Service-oriented Architecture with Respect to Reusability
Introduction to Micro Services
Part II - Summary of service oriented architecture (SOA) concepts, technology...
Open-Xchange
Service Oriented Architecture
Semantic Mediation Bus Presentation at VORTE 2012
Ad

Viewers also liked (9)

PPT
Méthodes et pratique de l’évaluation communautaire
PPTX
Time management
PDF
Server+ Certification
DOCX
Mortgage officer performance appraisal
ODP
James Cameron (2013)
PPTX
Lean en de zorg
PDF
INCREASED PRODUCTIVITY AND SPEED WITH DIGITALLY CONTROLLED SOFTWARE BASED MIG...
PPTX
The Promise of People in Civic Tech
PPT
CSIW ZERO WASTE MANAGEMENT
Méthodes et pratique de l’évaluation communautaire
Time management
Server+ Certification
Mortgage officer performance appraisal
James Cameron (2013)
Lean en de zorg
INCREASED PRODUCTIVITY AND SPEED WITH DIGITALLY CONTROLLED SOFTWARE BASED MIG...
The Promise of People in Civic Tech
CSIW ZERO WASTE MANAGEMENT
Ad

Similar to 2010 Future Distributed Computing Architectures and SOA (20)

PPT
Web services and SOA
PPT
Cics Web 2.0 With Atom Feeds And Php
ODP
Soa Grundlagen
ODP
Soa Grundlagen
ODP
Soa Grundlagen
ODP
Soa Grundlagen
PDF
Web Services Foundation Technologies
PPT
SOA for SSME 2009
PPTX
Unit 2
PPT
Web services, the ws stack, and research prospects a survey
PPTX
Introduction to webservices
PDF
Secc tutorials development and deployment of rest web services in java_v2.0
PPT
Soa role in telco industry
PPT
Cc unit 2 ppt
PPT
Enterprise Software Architecture
PPTX
Web Services and the Service-Oriented Architecture
PPTX
Service view
PPT
Web services and SOA [Modified]
PDF
Trustworthy service oriented architecture and platform for cloud computing (2...
PPT
Web services and SOA
Cics Web 2.0 With Atom Feeds And Php
Soa Grundlagen
Soa Grundlagen
Soa Grundlagen
Soa Grundlagen
Web Services Foundation Technologies
SOA for SSME 2009
Unit 2
Web services, the ws stack, and research prospects a survey
Introduction to webservices
Secc tutorials development and deployment of rest web services in java_v2.0
Soa role in telco industry
Cc unit 2 ppt
Enterprise Software Architecture
Web Services and the Service-Oriented Architecture
Service view
Web services and SOA [Modified]
Trustworthy service oriented architecture and platform for cloud computing (2...

Recently uploaded (20)

PPT
tcp ip networks nd ip layering assotred slides
PPTX
Introduction to Information and Communication Technology
PDF
The New Creative Director: How AI Tools for Social Media Content Creation Are...
PPTX
PptxGenJS_Demo_Chart_20250317130215833.pptx
PDF
WebRTC in SignalWire - troubleshooting media negotiation
PDF
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
PPTX
introduction about ICD -10 & ICD-11 ppt.pptx
PPTX
artificial intelligence overview of it and more
PPTX
Internet___Basics___Styled_ presentation
PDF
Automated vs Manual WooCommerce to Shopify Migration_ Pros & Cons.pdf
PDF
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
PPTX
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
PDF
Decoding a Decade: 10 Years of Applied CTI Discipline
PPTX
presentation_pfe-universite-molay-seltan.pptx
PPTX
Introuction about ICD -10 and ICD-11 PPT.pptx
PDF
An introduction to the IFRS (ISSB) Stndards.pdf
PPTX
Module 1 - Cyber Law and Ethics 101.pptx
PDF
RPKI Status Update, presented by Makito Lay at IDNOG 10
PPTX
international classification of diseases ICD-10 review PPT.pptx
PPTX
Funds Management Learning Material for Beg
tcp ip networks nd ip layering assotred slides
Introduction to Information and Communication Technology
The New Creative Director: How AI Tools for Social Media Content Creation Are...
PptxGenJS_Demo_Chart_20250317130215833.pptx
WebRTC in SignalWire - troubleshooting media negotiation
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
introduction about ICD -10 & ICD-11 ppt.pptx
artificial intelligence overview of it and more
Internet___Basics___Styled_ presentation
Automated vs Manual WooCommerce to Shopify Migration_ Pros & Cons.pdf
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
Decoding a Decade: 10 Years of Applied CTI Discipline
presentation_pfe-universite-molay-seltan.pptx
Introuction about ICD -10 and ICD-11 PPT.pptx
An introduction to the IFRS (ISSB) Stndards.pdf
Module 1 - Cyber Law and Ethics 101.pptx
RPKI Status Update, presented by Makito Lay at IDNOG 10
international classification of diseases ICD-10 review PPT.pptx
Funds Management Learning Material for Beg

2010 Future Distributed Computing Architectures and SOA

  • 1. Future Distributed Computing Architectures and the Role of SOA Robert Marcus robert.marcus@sri.com
  • 2. My SOA-related Background Introduced SOAP and XML into General Motors Organized Software Services Grid Workshop including W3C, OMG, OASIS, and OGF groups Developed a SOA strategy for Rogue Wave Software Proposed Service-Based Architecture for Hong Kong Wrote book on the “Great Global Grid” including SOA Director of Colorado Grid Computing Initiative Organized SOA workshops for US government audience Emerging Standards for SOA SOA Deployment: Industry Best Practices Cloud Computing for Net-Centric Operations
  • 3. Theme of SOA Extensions Talk There is a movement underway from classic “SOA” to a new generation of Service Based Architectures including Web 2.0, Event Driven Architectures, Mobile Clients, Embedded Systems Information Grids, and Cloud Computing
  • 4. Overview of the Talk SOA Evolution Service Oriented Levels Web 2.0 – WOA, Ajax and Mashups Everything as a Service (Cloud) Event Driven Architectures and Processing Pervasive Computing Social Networking Mobile Device Services Data Middleware Semantic SOA Information Grid Great Global Grid
  • 6. Pre-SOA Enterprise Heavily siloed; built with familiar models: Database-centric; Client-server/n-tier; Messaging/pub-sub DB Client App Server Client Client Client BUS App Server ClientClient Client Client App ServerApp Server DBDB Client DBDB App Server App ServerApp Server Mainframe App Server From Hugh Grant of Credit-Suisse
  • 7. Transition to Service Oriented Vision 7 From David Chou of Microsoft
  • 8. Many Web Services Standards From Chinese International Standards Open Lab
  • 9. Current Enterprise SOA Web services used within individual silos In reality, many interfaces are not SOAP-based Java Client Web Client Web Client Client BUS Java Client Java Client .NET Client .NET Client .NET Client Java Client J2EE Server .NET Client .NET Server .NET Server SOAP SOAP SOAP CLASSIC CLIENT-SERVER DB J2EE Server App Server .NET Server J2EE Server DBDB DBDB .NET Server App Server .NET Server Mainframe CORBA Server .NET Server J2EE Server CORBA Server SOAP SOAP WRAPPER SOAP AS INTEGRATION GLUE Web Client Web Client App Server SOAP SOAP SOAP AS WEB GLUE From Hugh Grant of Credit-Suisse
  • 10. Enterprise Service Bus (ESB) ESBs are the foundation of most robust SOA deployments ESBs can support routing, multiple transports, data conversions, reliability, and event response The next generation of ESBs must extend interoperability across organizational boundaries (e.g. other ESBs, B2B, Clouds) 10 From Fiorano
  • 11. Service Oriented Levels A Service provides functionality that is accessible through predefined interfaces and protocols
  • 12. Definitions of SOA SOA has many definitions which has caused confusion “SOA also describes IT infrastructure which allows different applications to exchange data and provide and consume services with one another as they participate in business processes” (Development) “SOA is a methodology for systems development and integration where functionality is grouped around business processes and packaged as interoperable services.” (Analysis and Design) Software as a service is a model of software deployment where an application is hosted as a service provided to customers across the Internet. (Deployment) All of the above definitions are from Wikipedia
  • 13. Service Oriented Definitions Service Oriented Middleware – Supports connection, interaction, and composition of distributed services Service Oriented Architecture – Functionality designed, developed, and deployed to be used in a pre-defined shared services architecture Service Oriented Clouds – Infrastructure including software, computers, and storage dynamical allocated as scalable services 13
  • 14. Service Oriented Levels Service Oriented Middleware (SOM) Integration and Interfaces (e.g. Web Services) Designed by Technical Architects Services are end-points supporting access to capabilities Service Oriented Architecture (SOA) Modeling, Structuring, and Governance Defined by Enterprise System Architects driven by Business Analysis Services are functional components supporting business processes Service Oriented Cloud (SOC) Computing Resources as Virtualized Services Specified by Enterprise Managers Services are computing resources supporting flexible operations All of the above can be used together or independently
  • 15. Service Oriented Levels Examples Service Oriented Middleware (SOM) Web Oriented Architecture (WOA) and REST SOAP-based, WS-*, Enterprise Service Bus (ESB) Business Process Execution Language (BPEL) Service Oriented Architecture (SOA) Shared Services Enterprise Systems Architecture Governance, Policy, Management Business Process Modeling Notation (BPMN) Service Oriented Cloud Architecture (SOC) Software as a Service Platform as a Service Infrastructure as a Service
  • 16. Web Services to Cloud Computing 16 From OGF Middleware (SOM) Architecture (SOA) Cloud (SOC)
  • 17. Combination of SOM, SOA, and SOC Service Container Client Mash-up AJAX AJAX Service Service Workflow / Orchestration Layer Composite Service Composite Service Composite Service Service Container Service Service Service Container Service Service Service Container Service Service Client Mash-up AJAX AJAX Client Mash-up AJAX AJAX Client Mash-up AJAX AJAX Client Mash-up AJAX AJAX Utility Compute Cloud From Hugh Grant of Credit-Suisse SOM SOA SOC
  • 18. Gartner Hype Cycle 2008 18 SOM SOA SOC
  • 19. Web 2.0 (WOA, Ajax and Mashups) Service Oriented Middleware
  • 20. Web Oriented Architecture (WOA) Terms REST – Representational State Transfer is an architecture style for distributed systems based on transferring and manipulating resources Ajax (Asynchronous Java and XML) – Toolkits for building browser interfaces using scripting (e.g. Javascript), Web data formats (XML) and asynchronous access to Web data (XMLHttpRequest) Mashups – Combining data from multiple sources into an unified representation for display or manipulation Rich Interface Applications (RIA) – Robust client side user interface (e.g. Ajax, mashups) running within an Web browser WOA – Uses native Web protocols and data types for clients (e.g. RIA), transport (HTTP) and servers (e.g. Get, Post for REST ) Web 2.0 - Collaborative applications based on Web platforms (e.g. WOA) 20
  • 21. WOA Foundations Information in a WOA is represented as resources on the network Every resource on the network can located via a globally unique URI Resources are manipulated by HTTP verbs (GET, PUT, POST, DELETE) i.e. Representation State Tranfer (REST) style WOA resources contain embedded URIs that build a larger network The service contract of WOA resources is implicit 21
  • 22. WOA vs SOAP-based Middleware 22 WOA SOAP-based Resource based Service based Individual URIs for each resource over HTTP Single end-point for SOAP server (multiple transports) Uses standard HTTP verbs Get, Put, Post , Delete Use SOAP content to determine verb Web Application Description Language can be used Web Services Description Language Simpler data formats (e.g. JSON Javascript Simple Object Notation) SOAP encodings Easier to mashup in browser and easier interface to Ajax More difficult to mashup in browser Fewer supporting standards Wide range of supporting standards Easier development but not as robust More complex development but more robust
  • 23. WOA vs. SOA Attributes 23
  • 24. WOA Formats, Links, and Resources From Dion Hinchcliffe
  • 25. Applications with REST APIs Zoho – Suite of applications Twitter – Microblogging Facebook – Social network Amazon – Their REST APIs are much more popular than their SOAP APIs eBay - REST and SOAP APIs Google – Dropped support for their SOAP Search API in favor of the REST APIs Salesforce.com - SOAP-based API and REST APIs Mashery - A new company that manages REST APIs as a Service 25
  • 27. Google Chrome New browser designed to be a front-end for WOA and could be a future client “operating system” Tabs and plug-ins all run in independent processes providing enhance security Multicore chips will enable increased performance Fast JavaScript virtual machine including dynamic code generation will support higher performance Ajax Task Manager provides visibility of process memory, CPU and network usage Elements of Chrome will run on Google’s Android mobile platform in the future 27
  • 28. Nexaweb RIA and SOM Architecture Example: Combining WOA, SOA, Mashups, Ajax, and Web Push
  • 29. Nexaweb RIA and SOM Architecture 29
  • 30. Web 2.0 connecting to Information Cloud 30
  • 31. Emerging Future for SOA RESTful Web Services and WOA are becoming the predominant Service Oriented Middleware SOAP-based middleware is considered to be too complex by many developers Service Oriented Clouds will be an increasing part of deployments The need for enterprise Service Oriented Architectures will increase to maintain control over WOA and Cloud implementations 31
  • 32. Everything as a Service (Cloud) News: IBM opened a Cloud Computer Center in Bangalore on September 24
  • 33. Service-Oriented Clouds Definition Infrastructure including software, computers, and storage dynamical allocated as services using distributed virtualization for scalability 33
  • 34. Cloud Computing Services Layers Application Services (e.g. Software as a Service = SaaS) Middleware and Data Services (e.g. Database as a Service) Development and Deployment Services (e.g. Platform as a Service) Resource Services (e.g. Infrastructure as a Service) Computing Hardware and Physical Storage Event, Processes, Interfaces (e.g. Event Processing as a Service) Distributed Virtualization Services
  • 35. Service Oriented Cloud Architecture Cloud-based Services e.g. databases, queues Software as a Service Platform as a Service Infrastructure as a Service Internet and Web 2.0 Clients Cloud Storage and Data Sources Cloud Servers Cloud Tools e.g. development, monitoring configuration Cloud Middleware Services e.g. dynamic allocation, security, workflow Virtualized Resources Cloud Service Oriented Systems
  • 36. Workload Distribution in the Cloud 3610/7/2008
  • 37. Software as a Service (SaaS)
  • 38. Some Software as a Service Suppliers Salesforce.com - Customer Relationship Management Netsuite – Business applications Workday – Human Resources Zoho – Online office Google App – Collaboration and Messaging Facebook – Social Network Cisco’s Webex – Conferencing SAP BusinessByDesign- ERP for small business 38
  • 39. Infrastructure as a Service (IaaS)
  • 40. Sun’s Network.com Provides hardware (Sun), software (Solaris-based), and storage resources on a pay-per-use basis Usage modes Upload and run applications through a portal or an API Run applications from a catalog or utilize long-running services
  • 42. VMware vCloud The new VMware Cloud Services have the three levels below VMware Ready use VMware Infrastructure to deliver flexible enterprise class cloud, hosting, and managed services. VMware Ready Optimized use the Cloud vServices API, vApp technology, the OVF specification, and other VMware technologies to provide enterprise class virtualization capabilities for on-premise datacenters and in off-premise clouds. VMware Ready Integrated enable a common approach to integrated manageability between on-premise and external clouds as part of vCenter, 42
  • 44. Examples of Cloud Computing Stacks 44From Dion Hinchcliffe
  • 45. Cloud Services Stacks Google App Engine MapReduce BigTable Google File System Sawzall (Query on top of MapReduce) Protocol Buffers for data description and Remote Procedure Calls Amazon Web Services Elastic Computing Cloud (EC2) Simple Storage System (S3) Simple Queuing System (SQS) SimpleDB (Database) Elastic Block Store (EBS) Open Source Yahoo Hadoop (MapReduce), Hbase , HDFS(Google-like), Pig (Query on top of Hadoop), UCSB Eucalyptus (Amazon-like), Many vendors building development platforms for Clouds
  • 46. Industry Cloud Computing Initiatives Amazon’s Web Services http://aws.amazon.com/ VMware VCloud http://www.vmware.com/go/vcloud Sun’s Network.com Internet Utility Computing http://network.com/ AT&T Synaptic Hosting http://blogs.zdnet.com/BTL/?p=9560 IBM’s Blue Cloud for Enterprises http://www-03.ibm.com/press/us/en/pressrelease/22613.wss Citrix Cloud Center for Enterprises http://www.citrix.com
  • 47. Research Cloud Computing Initiatives IBM, Google and US National Science Foundation “Cluster Exploratory” (CluE) initiative http://www.nsf.gov/news/news_summ.jsp?cntn_id=111470 Yahoo, HP, and Intel “Cloud Computing Testbed” http://www.techcrunch.com/2008/07/29/hp-yahoo-intel-announce- cloud-computing-research-initiative/ IBM and EU’s “Resources and Services Virtualization without Barriers” (Reservoir) http://websphere.sys- con.com/node/495772
  • 49. August 24, 2008 IBM’s Model for Cloud Computing Service Request & Operations Service Creation & Deployment End User Requests & Operators … Design & Build Image Library (Store) Deployment Operational Lifecycle of Images IT Infrastructure & Application Provider Virtual Image Management Service Catalog Request UI Operational UI Standards Based Interfaces Virtualized Infrastructure Service Management Service Oriented Architecture Information Architecture Standards Based Interfaces Service Catalog, Component Library Datacenter Infrastructure Cloud Administrator Access Services
  • 50. Internal SOA and External SaaS 5010/7/2008 From Infoworld
  • 51. Linking Enterprise and Internet Clouds 51 From David Chappell Firewall
  • 53. Enterprise Cloud Computing Workshop 8:00 – 9:00 HP Susanne Balle (Architect, Scalable Computing and Infrastructure Organization) "Emergence of Cloud Computing“ 9:00 -10:00 IBM David Lindquist (Cloud Computing chief architect and IBM Fellow) Lauren States (VP of Cloud Computing) "IBM's Perspective on Cloud Computing“ 10:00 – 11:00 Google Todd Wiseman (Manager, Google's Federal Enterprise Team) Cloud Computing from Google" 11-00 – 12:00 Amazon Jeff Barr (Chief Evangelist for Amazon Web Services) "Amazon Web Services: Cloud Computing in Action“ 12:00 – 1:30 Discussion about an Enterprise Cloud Computing group with industry, government and standards groups members 53
  • 54. Enterprise Cloud Computing Group An Enterprise Cloud Computing Group was initiated September 17 at an NCOIC.org meeting including industry, government, standards groups, and vendors The goal of the Group will be to exchange information about standardizations, critical requirements, best practices, use cases, success stories, and emerging technologies There is a planned follow-on meeting at an Open Group Conference in San Diego, February 2-5, 2009 54
  • 55. Platform as a Service (PaaS)
  • 56. Platform as a Service Example Several companies are supplying Platform as a Services for high performance computing fabrics e.g..Amazon EC2 and S3From GigaSpaces
  • 57. Elastra Platform on top of IaaS Elastra proposed Elastic Computing (ECML) and Deployment (EDML) Markup Languages as potential standards ECML EDML e.g..Amazon EC2 and S3
  • 58. Integration as a Service BT provides an appliance for SOA integration The software includes Progress ESB and iWay data connectors Installed onsite and managed remotely 58From BT
  • 59. Desktop as a Service (Desktone) 59
  • 60. NComputing (Shared PC Desktops) NComputing allows up to 30 users to share a PC Users have very inexpensive, low power terminals Many-core PCs will make this approach a big global winner Macedonia provides a terminal to all students in the country 60From NComputing
  • 62. EDA and SOA From http://soa-eda.blogspot.com
  • 64. Push Technologies In general, push technologies for events and messages are a good match for WOA Syndication Services - There are many protocols (e.g. RSS, Atom) based on polling for distributing information on the Web (logical push) XMPP – Protocol underlying instant messaging that can be used to carry XML content Comet and Bayeux – Comet is a term for describing push updates through HTTP Server Push. Bayeux is a publish-and-subscribe capability on top of Comet Publish-and-subscribe messaging – Available through ESBs and other middleware 64
  • 65. 65 Databases Intranets / Extranets Email Portals Enterprise Search Web Servers Apps: eg, ERP, CRM [ manage information ] [ transform and deliver ] [ automate relevancy ] [ monitor data ] Blogs & wikis Recordchanges Docrevisions Orderstatusupdates Priceupdates Productchanges Calendarevents Salesleads Content-based routing Alerts / Notifications Transformation Aggregation Filtering / Matching Security In-line editors Collaboration Tools Email Comet-based Syndication
  • 67. Event Sensing and Service Response HQ OperationsField Operations Observation and Control Components In Event Input u Complex Event Processing In Response Outputs u Assessment and Decision Preprocess Simple Event Processing SituationObject Simple Response Service Composition of Services Complex Response Sensor and Effects Management Measurement Field Processors Data Structured Data Information Service Oriented Architecture Event Driven Architecture Response Event External Input External Output
  • 68. from Tim Bass Complex Event Processing Reference Model
  • 69. Complex Event Processing will: Save multiple man-years of development & maintenance Speed time-to-market Dramatically increase responsiveness to the business InputDataStreams Execution Continuous Processing, Synchronization, Threading, Security, Clustering, Availability Output Control Ordering Routing Delivery Interfaces Pattern Matching Specification Identification Non-Events State Persistence, Caching, Locking, Database Reads/Writes Data Management Filtering Indexing Windows Merging Correlation Aggregation Stream Management Ordering Routing Delays Missing Mgs. Decomposition OutputEvents From Coral8 Complex Event Processing Engine
  • 70. Event Processing as a Service Complex event processing (CEP) is a key component for many application areas (e.g. finance, supply chain, situation awareness) Required resources for CEP may fluctuate greatly over time (e.g. emergency response) Deploying “Event Processing as a Service” on a Cloud infrastructure could support dynamic requirements “Event Processing as Service” needs standardizations: Identifying event sources to be monitored Describe event patterns of interest Specify quality of services for reporting events Presentation on “Event Processing as a Service” to Event Processing Technical Society last week
  • 71. Event Processing Using Multiple Services Remote Monitoring as a Service Selection of sensing source and data feeds to monitor Ability to turn on sensing sources or data feeds QoS as a Service Event transmission and processing as a Service using priorities Network and compute resources to be applied Pattern Detection (CEP) Computing as a Service to obtain resources Software as a Service to utilize specific applications (e.g. CEP)
  • 72. Select Sources Select Priorities Select Patterns Event Processing as a Service
  • 73. Map Reduce(Complex Event Processing) Event ID, Event Attributes Pattern ID, Partial Match Pattern ID, Complete Match by Pattern ID
  • 75. Microsoft Robotics Studio CCR (Concurrency and Coordination Runtime) - Highly concurrent, message handling with orchestration primitives enabling simplified message coordination and response to failures DSS (Decentralized Software Services) – REST-based framework for services using HTTP extensions for structured data, notifications, and composition. Service-based Orchestration using CCR and DSS 75From: http://msdn.microsoft.com/en-us/library/bb648752.aspx.
  • 76. SODA Architecture SODA is the “Service-oriented Device and Delivery Architecture” from the Eclipse Foundation From IEEE Pervasive Computing
  • 77. Device Profile for Web Services (DPWS) A proposed OASIS standard for resource constrained end-points Provides key services for networking devices include: Discovery services Metadata exchange services. Publish/subscribe eventing services Uses core SOAP Web Services such as SOAP, WSDL, WS-Security, WS-Policy, WS-Addressing, Also supports WS-MetadataExchange, WS-Transfer, WS-Discovery, WS-Eventing to provide key services OASIS has just started a Web Services Discovery and Devices (WS-DD) Technical Committee to standardize DPWS, WS-Discovery, and SOAP over UDP. 77
  • 78. Socrades Socrades is Service-Oriented Cross-Layer Infrastructure for Distributed Smart Embedded Systems research project DPWS is the Device Profile for Web Services
  • 80. Sensors to the Enterprise From SAP
  • 82. Open Social for Social Networking
  • 83. Facebook Application Architecture Facebook Query Language (FQL) – Simple SQL-like query language for accessing user profiles, friends, groups, events, and photo API – Web Services interface with a client library Facebook Markup Language (FBML) – Subset of HTML + Proprietary Extensions including UI and procedural tags 83
  • 85. Rogue Wave Internet Dispatcher 2000 85
  • 86. IBM Mobile Web Initiative Led by IBM Bangalore Targeted at mobile phones The Spoken Web - Voice-enabled mobile commerce Instant Translation - Real-time communication between multiple languages through mobile devices SoulPad - Enabling any portable device to carry computing applications in your pocket Social networking on-the-go Good Samaritan - Mobile healthcare information made available in any emergency situation
  • 87. Open Handset Alliance Consortium of over 30 companies from all aspects of mobile phone computing Supports the Android platform developed by Google Built on the Linux 2.6 kernel Comprehensive set of libraries Rich multimedia user interface Many phone applications Porting of Google’s new Chrome browsers capabilities to Android could enable new applications
  • 88. Microsoft “Mesh” Strategy Live Mesh – Unified device, data, and application management Social Mesh – Office Mobile and Office Live Workspace Business Mesh - Office Live Small Business and Online Services Also there will be online Skymarket for downloading Windows Mobile 7 apps From www.microsoft.com/presspass/download/press/2008/0423ServicesStrategyUpdate.pdf
  • 93. Data Integration Types ETL – Extract, Transform, Load EAI – Enterprise Application Integration EII – Enterprise Information Integration From: www.dmreview.com
  • 94. Roles of EAI, ETL, and EII EAI moves small amounts of data to enable synchronization ETL moves large amount of between data stores EII moves and merges data from multiple sources for decision support From: www.dmreview.com
  • 95. Data Integration and SOA Standard XML data representations simplify integration when high performance is not needed EAI is performed by the Enterprise Service Bus EII can be implemented as mashups ETL can be implemented with the SOAP Message Transmission Optimization Mechanism (MTOM)
  • 96. DataPower Appliances from IBM 96 XML Accelerator Data Transformations Policy Enforcement
  • 97. High Performance Data Middleware XMPP from Jabber provides a light-weight standard transport for large volumes of small XML messages Data Distribution Services (DDS) is an OMG standard for real time publish-and-subscribe messaging with guaranteed QoS Protocol Buffers is a recently open sourced non-XML based data serialization at the foundations of Google’s RPC architecture http://code.google.com/p/protobuf/ Facebook’s Thrift provides similar cross-language and data serialization RPC capabilities as Protocol Buffers http://incubator.apache.org/thrift/
  • 98. OMG Data Distribution Service From RTI
  • 100. Evolution to Semantic Web Services RDF, OWL SOAP, WSDL OWL-S WSDL-S
  • 102. OWL-S Ontology Web Language for Services A W3C OWL language/ontology for formally describing properties and capabilities of Web Services Based on input from many sources Description Logic AI Planning Workflow Formal Process Modeling Agents Web Services Reference http://www.daml.org/services/owl-s 102
  • 104. UIMA UIMA – Unstructured Information Management Architecture Uses Semantic Analysis to add structure to unstructured information Initial development by IBM then transferred to Apache 104From IBM
  • 105. Open Calais Semantic Indexing Open Calais has a Web Service that converts unstructured data into W3C RDF format Initially the Web Services can extract names, facts and events from documents Open Calais also supplies tool, applications, and an API to the output that can be used by other Web tools 105
  • 108. 108 Colorado Information Grid Vision Instruments Data Visualization Large-Scale Databases Small Computers HPC Mobile Computing Sensors
  • 109. DoD Global Information Grid - Definition “Globally interconnected, end-to-end set of information capabilities, associated processes, and personnel for collecting, processing, storing, disseminating, and managing information on demand to warfighters, policy makers, and support personnel.”
  • 112. Net-Centric Operations 2.0 for Defense 1. Web Client Application 4. Composites 2. Web Message Bus 3 .Enterprise Service Manager 5. Enterprise Service Buses 6. Enterprise Data and Systems 8. Tactical Networks 7. Gateway Adaptor Data Browser – RIA, AJAX, Mashups XML over HTTP XMLHttpRequest Web Server SOAP over HTTP SOAP Server, WCF Host, Application Server Services, SCA Services, SCAESBs with multiple transports Orchestration – BPEL, JBI, BizTalk Data HTTP Enterprise Mashups/Pipes System Aggregation Gateway Server – Protocol and Data Transformations Sensor Networks, Mobile Platforms, Devices, Gateways (DDS, Efficient XML) Event Processing External Interfaces SDOSDO HTTP Server Push
  • 113. ESB and Tactical Network Interface
  • 114. Sensors to Data Grid to SOA Workflows From HiSeasNet.ucsd.edu
  • 116. Convergence of Technologies GREAT GLOBAL GRID Cloud Computing Data Intensive Computing and Infrastructure Everything as a ServiceService Oriented Architectures Event Driven Architectures Sensors and Devices High Productivity Computing and Networking Rich User Experiences (Web 2.0)
  • 117. 117 The Great Global Grid is universal access (when authorized) to shared services including application, collaboration, communication, data, software, and hardware Free Book - http://www.great-global-grid.com
  • 119. END