Cloud & OSGi - The Dawn of Composite Clouds (Now with demo videos)

Transforming the Way
the World Runs Applications

Cloud & OSGi - The Dawn of Composite Clouds
Richard Nicholson info@paremus.com
Service Fabric Overview Copyright © 2011 Paremus Ltd. March 2011
May not be reproduced by any means without express permission. All rights reserved.

Mythology, marketing...

:-)

:-(


The Problem is...

Cloud Computing
addresses this

?
Anne Thomas Manes (Gartner) – SOA Symposium: Berlin, October 2010


Modular Systems are Maintainable Systems

✗ Deployment of static software images
✔ Dynamic Assembly composites applications

Anne Thomas Manes (Gartner) – SOA Symposium: Berlin, October 2010


Introducing the Paremus Service Fabric
An OSGi™ technology based cloud runtime

SaaS
(1..m) ‘Systems’ may run upon a single
Service Fabric

Fabric ‘EclipseCon’ = ∑ all ‘EclipseCon’ fibres

(1..n) compute resource may contribute to a
IaaS
Service Fabric


Demo Environment
A ‘blue’ Atlas Agent

Oﬀ Fabric node
Service Fabric Nodes
Bootstrap Atlas Manager
Source Repository for Examples
Service Fabric Infrastructure
POSH CLI
Cached Examples
Application UI
Deployed Systems


Atlas & Resource Target State
A blue !"bre#

Managing characteristics of population
rather than each individual node has a
Service Fabric $ EclipseCon dramatic effect on decreasing runtime
fibres:
infra; quota=[10..10]; filter=(&(Group=Red)(os.name=Darwin), complexity -
default; quota=[100..1000]; filter=(Group=Blue)
http://adaptevolve.blogspot.com/
2008/01/complexity-part-ii-it-all-
depends-on.html

Atlas agents:
host resource property: colour
none
red
blue


Demo: Bootstrapping a Service Fabric

A video of the demo is
available on the next page


A Model Driven Runtime

System Description Running System


A System

System Scaling Behaviour Resource Contract
System
Elements (Replication Handlers)
= (os.name=linux) & (CPU.speed > 3 Ghz)

= +
= fl(x)
= fm(y)
= fn(z)
+ = !(os.name=Windows)

= (cost_center=engineering)

ser OSGi - Remote Service / Remote Service Admin
vic
ew
ires
(re Service E

m ote E
E
over Essence RMI

Service E Endpoint
Essence RMI

) Export
Fabric
System
System Element
! Service A
Service B
Service D
Service E
$
%

Service F

A Reference to... E Remote Service Admin
Service Properties Essence RMI
for E

OSGi Service Registry
"
an OSGi assembly or Remote Service Admin
AVRO

a WAR, or EAR or #
Export Registration
&
E

a package name or even Topology Manager
Discovery Provider
SLP '
E

a named VM image.
Discovery Provider
DDS


Starting a System

Target State Runtime State

=1
=3
=1

Deploy


Starting a System

The Service Fabric responds by creating the corresponding System

Provision Delta


Planned Deltas
=1 e.g. Conﬁguration
M!del changes
=3 Runtime
Target State
Unplanned Deltas Entity
"Structure#SLA$
=1 e.g. Resource
failures

Monitor


Updating a System

To change a runtime System, change its model in the required manner.


=1
=5
=1

Re-Conﬁgure


Updating a System

The Service Fabric responds by modifying the running System

Provision Delta


Planned Deltas
=1 e.g. Conﬁguration
M!del changes
=5 Target State
Runtime
Unplanned Deltas Entity
"Structure#SLA$
=1 e.g. Resource
failures

Monitor


Demo: Application Agility



A self-configuring PaaS
Modular & runtime dependencies

❶ ❷ triggers policy
EAR based runtime assembly

JEE WAB

❷
triggers policy
based runtime assembly
❶
WAR

Each ‘ﬁbre’ dynamically assembles and conﬁgures any local infrastructure services
in response to the runtime dependencies of each hosted System Element

Robust Systems...

Reddit Went Down: Blame Amazon, the Cloud or Both?

“I am a data storage/data center specialist. It pains me to see the "cloud" illusion come crashing down on
a great product like Reddit.”
...
...

“It's no secret among most IT folks that the cloud really isn't cheaper than rolling your own infrastructure
for reasons exactly like this.”

http://www.readwriteweb.com/cloud/2011/03/ipad-for-business-round-up-web.php

Financial Services Organization: “How do you stop people rebooting machines....?”


What do we mean by Robust?

• A ‘Robust’ platform is designed to survive
cascading failure.
• A ‘Robust’ platform is adaptive & self-
repairing: continually attempting to
‘settle’ into the desired state.
• No central or static points of command &
control

Adaptive & Recovery Oriented


Whac-A-Mole :)


Whac-A-Mole the Paremus Way



Robust PaaS Services

Registry
Provisioner Service Advertisements
Principles: System Managers
• No ‘special’ management nodes
• Source so*ware repository may fail
• Population changes over time (nodes come and go)
• Systems change over time (upgrades / roll-backs)
• Attempting to cache everything / everywhere / is doomed to C A
failure
B
Approaches:
• All infra services: Dynamic Group formation / re-formation
• All infra services : Dynamic leadership election
Repository
• On-fabric Repository Cache: Eventual Consistency across Management & OSGi bundles
self-selecting set of participating members System Descriptions
Monitoring
Nimble Policies
WAR
EAR
General artifacts


CDS Behaviour - Form Group & Elect Leader

CDS Group Lead
! active members


A System is Loaded
=1
!
=5
=1


Artefacts are automatically cached in response

Business Group
Repository

!
Business Division
Repository


Artefacts propagated around Group

"

$

!
#
Data Flow


Lead Fails


New leader elected - Group closes around failure

!

#
"


New members join team

!

#
"


What about Application Data?

No Silver Bullets!
Consistency, Availability, Partition-ability (CAP) trade-offs still apply.
Use most appropriate data service for each business application.

• Unstructured data processing - Hadoop
• Key / Value - Voldemort
• Column - Cassandra
• Graph Database - Neo4j
• Relational - Derby, MySQL
• Distribution to nodes - BitTorrent

http://blog.nahurst.com/visual-guide-to-nosql-systems


Late Break Demos....


Introducing Zeus

+


SDP Foreign Exchange (FX) functionality;
Lab49 is a strategy, design and technology consulting
‣ Request for Quote (RFQ) firm. Lab49 deliver strategic consulting and build
advanced solutions for the world’s leading investment
‣ Request for Stream (RFS) banks, hedge funds and exchanges.
‣ Execution blotter
‣ Research/News
“Lab49 deliver world-class solutions to some of
the most sophisticated firms in financial services
Lab49 SDP leverages; today. Our innovative approach stems from
‣ Paremus OSGi Service Fabric adopting user-centric practices enabling clients
to respond quickly to today’s challenges, as well
‣ Akka Open Source Agent-Actor Framework as realize new business opportunities in the
‣ Lab49 Design and Engineering modern world of trading.
‣ HTML5/JavaScript

Service Fabric Overview Copyright © © 2011Lab49 UK Ltd.
Copyright 2011 Paremus Ltd. March 2011

Industry Standards...

• OSGi framework - Equinox, Knopflerfish or Felix
• Paremus OSGi command shell (Posh): OSGi RFC147
• Paremus Nimble Resolver: OSGi OBR resolver (RFC112)
• Paremus implementation of OSGi Remote Services Administration
• OSGi ConfigAdmin
• Paremus implementation of OSGi Web Archive Bundle (RFC66)

• RTI implementation of OMG DDS: service discovery, configuration, management &
monitoring


Industry Standards...

• Cloud / OSGi workshop organised by Peter Kriens - EclipseCon 2011
• Ongoing EEG conference calls throughout 2010 / 2011 chaired by
David Bosschaert
• RFP-133 Cloud Computing - Current Status
• To get involved: contact David Bosschaert or Peter Kriens


Modularity is a Must Have not a Maybe!

Patterns of Modular Architecture (Kirk Knoernschild) - http://www.kirkk.com/modularity/chapters/

Diversity and Complexity - Scott E. Page

http://dspace.mit.edu/bitstream/handle/1721.1/60085/BBFRFC66.pdf?sequence=1


Any Questions?

Distributed OSGi - Dr Robert Dunne
Tuesday, 10:40, 20 minutes | Ballroom BC

OSGi DevCon BoF
Tuesday, 7:30 | Napa

& drop by the Paremus stand for a chat!


Cloud & OSGi - The Dawn of Composite Clouds (Now with demo videos)

More Related Content

What's hot (18)

Viewers also liked (20)

Similar to Cloud & OSGi - The Dawn of Composite Clouds (Now with demo videos) (20)

More from mfrancis (20)

Recently uploaded (20)

Cloud & OSGi - The Dawn of Composite Clouds (Now with demo videos)