SlideShare a Scribd company logo

SPLAY: Distributed Systems Made Simple

vschiavoni, profile picture
vschiavoni

The document discusses the challenges and methodologies in developing distributed systems, emphasizing the need for simplicity in implementation and testing. It introduces a framework called Splay, which facilitates the development, evaluation, and debugging of distributed applications using a pseudocode-like language in Lua. Splay aims to streamline the process of handling distributed protocols by providing a user-friendly environment that mitigates the complexities inherent in traditional approaches.

Technology
1 of 60
Downloaded 18 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
!"#$% Distributed Systems Made Simple Pascal Felber, Lorenzo Leonini, Etienne Rivière, Valerio Schiavoni, José Valerio Lua Workshop, 8 September 2011 Frick, Switzerland !"#$%
About Me • 2010-now : PhD student at the University of Neuchatel, Switzerland (and Lua user since then) • Topic: large-scale distributed systems, cloud computing. Daily job: 1. Invent new protocols for cloud applications 2. Do experiments, write papers, go to 1 • 2007-2009: Research engineer at INRIA, France • BSc and MSc in Computer Engineering at the Università degli Studi Roma Tre, Italy !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Motivations !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Motivations • Developing, testing and tuning distributed applications is hard • In Computer Science research, fixing the gap of simplicity between pseudocode description and implementation is hard • Using worldwide testbeds is hard !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
What is !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
What is !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
What is • Machines contributed by universities, companies,etc. • 1098 nodes at 531 sites (02/09/2011) • Shared resources, no privileged access • University-quality Internet links • High resource contention • Faults, churn, packet-loss is the norm • Challenging conditions !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems 1 code 1 • Write (testbed specific) code • Local tests, in-house cluster, PlanetLab... !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems 2 1 code debug 2 • Debug (in this context, a nightmare) !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems 2 1 code debug 2 • Debug (in this context, a nightmare) !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems 3 1 2 code debug deploy 3 • Deploy, with testbed specific scripts !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems 3 1 2 code debug deploy 3 • Deploy, with testbed specific scripts !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems 4 1 2 3 code debug deploy get logs 4 • Get logs, with testbed specific scripts !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems 4 1 2 3 code debug deploy get logs 4 • Get logs, with testbed specific scripts !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems 5 1 2 3 4 code debug deploy get logs plots 5 • Produce plots, hopefully !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Daily Job With Distributed Systems 1 2 3 4 5 code debug deploy get logs plots 5 • Produce plots, hopefully !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
!"#$% At Glance code debug deploy get logs plots • Supports the development, evaluation, testing, and tuning of distributed applications on any testbed: • In-house cluster, shared testbeds, emulated environments • Provides an easy-to-use pseudocode-like language implemented in Lua !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
!"#$% At Glance code debug deploy get logs plots • Supports the development, evaluation, testing, and tuning of distributed applications on any testbed: • In-house cluster, shared testbeds, emulated environments • Provides an easy-to-use pseudocode-like language implemented in Lua !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
!"#$% At Glance code debug deploy get logs plots l ot is gnup riend ur f • Supports the development, evaluation, yo testing, and tuning of distributed applications on any testbed: • In-house cluster, shared testbeds, emulated environments • Provides an easy-to-use pseudocode-like language implemented in Lua !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture require”splay.base” splayd splayd splayd splayd Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture splayd splayd require”splay.base” splayd splayd Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture splayd splayd require”splay.base” splayd splayd Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Why ? !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Why ? • Light & Fast • (Very) Close to equivalent code in C !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Why ? • Light & Fast • (Very) Close to equivalent code in C • Concise • Allowimplementation focus on ideas more than developers to details • Key for researchers !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Why ? • Light & Fast • (Very) Close to equivalent code in C • Concise • Allowimplementation focus on ideas more than developers to details • Key for researchers • Sandbox thanks to the possibility of easily redefine (even built-in) functions !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Concise !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Concise Pseudo code as published on original paper Executable code using SPLAY libraries !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Sandbox: Motivations • Experiments should access only their own resources • Required for non-dedicated testbeds • In universities, companies • Totally available at night/holiday time • Memory-allocation, filesystem, network resources are restricted !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Sandboxing LuaSocket ! ! • Same API as plain LuaSocket if sock.send then ! ! new_sock.send = function(self, data) ! local len = #data • On-demand sandboxed sockets ! ! ! if total_sent + len > max_send then ! ! ! ! l_o:warn("Send restricted (total: "..total_sent..")") ! ! ! ! return nil, "restricted" • Very easy thanks to Lua’s metatable ! ! ! end ! ! ! local n, status ! ! ! if math.random(1000) > udp_drop_ratio then ! ! ! ! n, status = sock:send(data) ! ! ! • Limits chosen by the SPLAYd deployer ! ! ! ! ! ! else ! end n = len • Both TCP and UDP ! ! ! if n then ! ! ! ! total_sent = total_sent + len ! ! ! end • Example: UDP’s socket.send ! ! ! return n, status ! ! end ! end !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Sandboxing LuaSocket ! ! • Same API as plain LuaSocket if sock.send then ! ! new_sock.send = function(self, data) ! local len = #data • On-demand sandboxed sockets ! ! ! if total_sent + len > max_send then ! ! ! ! l_o:warn("Send restricted (total: "..total_sent..")") ! ! ! ! return nil, "restricted" • Very easy thanks to Lua’s metatable ! ! ! end ! ! ! local n, status ! ! ! if math.random(1000) > udp_drop_ratio then ! ! ! ! n, status = sock:send(data) ! ! ! • Limits chosen by the SPLAYd deployer ! ! ! ! ! ! else ! end n = len • Both TCP and UDP ! ! ! if n then ! ! ! ! total_sent = total_sent + len ! ! ! end • Example: UDP’s socket.send ! ! ! return n, status ! ! end ! end !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
for _,module in pairs(splay) !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
for _,module in pairs(splay) luasocket events io crypto llenc/benc json misc log rpc !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
for _,module in pairs(splay) luasocket events io crypto llenc/benc json misc log rpc Modules sandboxed to prevent access to sensible resources !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splay.events luasocket events io crypto llenc/benc json misc log rpc Modules sandboxed to prevent access to sensible resources !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splay.events events !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splay.events • Distributed protocols can use message- passing paradigm to communicate • Nodes react to events events • Local, incoming, outgoing messages • The core of the Splay runtime • splay.socket, splay.io designed to provide a non-blocking operational mode • Based on Lua’s coroutines !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splay.rpc luasocket events io crypto llenc/benc json misc log rpc !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splay.rpc rpc !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splay.rpc • Default mechanism to communicate between nodes • Support for UDP/TCP • Efficient BitTorrent-like encoding rpc • Experimental binary encoding !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Life Before !"#$% • Time spent on developing testbed specific protocols • Or fallback on simulations... • The focus should be on ideas • Researchers usually have no time to produce industrial-quality code !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
public void declareNeighbourInactive(final DHTNode node) { // DO NOTHING HERE: Life Before !"#$% } public void addToLeafSet(final DHTNode node) { // DO NOTHING } /** * Empty UDP message is 64 bytes, to which we must add 1 bytes for the header, • Time spent on developing testbed * 1 bytes for the messageId, 28 bytes (IP,port,Bamboo ID) for message src, 28 * bytes for message dest + bytes for the specific data carried in the specific protocols • Or fallback on simulations... * message. NOTE: the size of informations to ack a message is 10 bytes, */ @Override • The focus should be on ideas public long calculateMessageBytes(final Message msg) { long result = 122; // 64 + 1 + 1 + 28 + 28; • Researchers usually have no time to if (msg.header == MessageType.PING) { /* nothing to add */ return result; produce industrial-quality code } if (msg.header == MessageType.PONG) { /* some bytes for the informations about which message is being acked */ result += ACK_INFORMATIONS_SIZE; return result; } if (msg.header == MessageType.BAMBOO_JOIN_LOOKUP_REQUEST !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland || msg.header == MessageType.BAMBOO_LOOKUP_REQUEST
responseCallback.onResponseReceived(msg); }/* * CAN BE COMMENTED AS SEND RETRIAL OF MESSAGES IS OFF else { it is a Life Before !"#$% * duplicate lookup response, send a PONG to (hopefully) stop source to * send us again that message final Message pong = new * Message(MessageType.PONG, msg.messageId, this, msg.src); pong.ackedMsg * = msg; simulator.send(pong); } */ • Time spent on developing testbed } /* ELSE IF IS SOMETHING NOT A LOOKUP RESPONSE */ else { final Message beingAcked = msg.ackedMsg; specific protocols • Or fallback on simulations... final ResponseArrivedCallback handler = this.sentMessagesCallbacks .remove(beingAcked); • The focus should be on ideas /* if there is a mapping */ if (handler != null) { handler.onResponseReceived(msg); • Researchers usually have no time to }/* * else { this may happen in case of a response arrive later than * expected... log .info("%%% " + this + " received the response => " + produce industrial-quality code * msg + * " but no handler was expecting it! So, simply send back a PONG to make it stop sending again..n" * ); send a PONG to (hopefully) stop source to send us again final * Message pong = new Message(MessageType.PONG, msg.messageId, this, there is more :-( * msg.src); pong.ackedMsg = msg; simulator.send(pong); } */ } // /* it replied at last, so "reset" the value */ !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland // this.nodeConsecutiveTimeouts.put((DHTNode) msg.src, 0);
such as epidemic diffusion on Erd¨ s-Renyi random o graphs [16] and various types of distribution trees [10] Life With !"#$% (n-ary trees, parallel trees). As one can note from the fol- lowing figure, all implementations are extremely concise 7 in terms of lines of code (LOC): Chord (base) 59 (base) + 17 (FT) + 26 (leafset) = 101 Pastry 265 Scribe Pastry 79 SplitStream Pastry Scribe 58 BitTorrent 420 Cyclon 93 Epidemic 35 Trees 47 Although the number of lines is clearly just a rough • Lines thepseudocode ~== Lines of executableitcodestill a indicator of of expressiveness of a system, is 5 Splay daemons have been continuously running on these hosts for !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Live Demo www.splay-project.org !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
ay aw e- e ak lid T S • Distributed systems raise a number of issues related to their evaluation • Their implementation, debug, deployment and tuning is hard • !"#$% leverages Lua to produce an easy to use yet powerful working environment to solve these issues !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
Backup Slides !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture REST API Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture Shell Web REST API Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture Shell Web REST API Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture Shell Web REST API Splay churn Controller jobs SQL DB blacklist !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
The Big Picture alpha require”splay.base” ... Shell Web REST API Splay churn Controller jobs SQL DB blacklist !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web REST API Splay churn Controller jobs SQL DB blacklist !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web REST API Splay churn Controller log jobs log SQL DB blacklist log !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web ctrl REST API ctrl ctrl Splay churn Controller log jobs log SQL DB blacklist log !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web ctrl REST API ctrl ctrl Splay churn Controller log jobs log SQL DB blacklist log !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web ctrl REST API ctrl ctrl Splay churn Controller log jobs log SQL DB blacklist log !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland

More Related Content

ODP
Open al bivio fra software e webware
Davide Carboni
 
PPT
Organizzazione e tipologie di progetto crossmediale
Adele Savarese
 
PPSX
Progetto crossmediale
Cecilia Scolaro
 
PDF
Inspec: Turn your compliance, security, and other policy requirements into au...
Kangaroot
 
PPTX
InSpec - June 2018 at Open28.be
Mandi Walls
 
PPTX
Kurt baumgartner lan_deskse2012
Kurt Baumgartner
 
PDF
Software Lifecycle Management in Asemantics
simonetripodi
 
PDF
SLPAY: Distributed Systems Made Simple
Förderverein Technische Fakultät
 
Open al bivio fra software e webware
Davide Carboni
 
Organizzazione e tipologie di progetto crossmediale
Adele Savarese
 
Progetto crossmediale
Cecilia Scolaro
 
Inspec: Turn your compliance, security, and other policy requirements into au...
Kangaroot
 
InSpec - June 2018 at Open28.be
Mandi Walls
 
Kurt baumgartner lan_deskse2012
Kurt Baumgartner
 
Software Lifecycle Management in Asemantics
simonetripodi
 
SLPAY: Distributed Systems Made Simple
Förderverein Technische Fakultät
 

Similar to SPLAY: Distributed Systems Made Simple (20)

PPT
Reverse engineering
Saswat Padhi
 
PDF
Workflows in the Virtual Observatory
Jose Enrique Ruiz
 
PDF
WTFAST Crack Latest Version FREE Downlaod 2025
channarbrothers93
 
PDF
uTorrent Pro Crack Latest Version free 2025
channarbrothers93
 
PDF
Adobe Master Collection CC Crack 2025 FREE
arslanyounus93
 
PDF
AOMEI Partition Assistant Crack 2025 FREE
yazdanwaqar
 
PDF
K7 Total Security 16.0.1260 Crack + License Key Free
birbaahan
 
PPTX
Evolving Scala, Scalar conference, Warsaw, March 2025
Martin Odersky
 
PDF
Shannon McFarland OpenStack/Cisco Intro
Shannon McFarland
 
PDF
OpenDaylight Developers Experience 1.5: Eclipse Setup, HOT reload, future plans
Michael Vorburger
 
PDF
Blackhat USA 2011 - Cesar Cerrudo - Easy and quick vulnerability hunting in W...
Michael Boman
 
PDF
Rugged DevOps Will help you build ur cloudz
James Wickett
 
PPTX
Infinispan, a distributed in-memory key/value data grid and cache
Sebastian Andrasoni
 
PDF
Implementing Continuous Deployment
Andrew Phillips
 
PDF
Implementing continuous deployment JFall 2010
XebiaLabs
 
PDF
Ionic in 30
Ionic Framework
 
PDF
Unified Deployment: Including the Mainframe in Enterprise DevOps
XebiaLabs
 
PDF
2018 ABRF Tools for improving rigor and reproducibility in bioinformatics
Stephen Turner
 
PDF
Cloud iaa s-labs- ubuntu canonical- fossa2010
fOSSa - Free Open Source Software Academia Conference
 
PDF
EclipseCon 2016 - OCCIware : one Cloud API to rule them all
Marc Dutoo
 
Reverse engineering
Saswat Padhi
 
Workflows in the Virtual Observatory
Jose Enrique Ruiz
 
WTFAST Crack Latest Version FREE Downlaod 2025
channarbrothers93
 
uTorrent Pro Crack Latest Version free 2025
channarbrothers93
 
Adobe Master Collection CC Crack 2025 FREE
arslanyounus93
 
AOMEI Partition Assistant Crack 2025 FREE
yazdanwaqar
 
K7 Total Security 16.0.1260 Crack + License Key Free
birbaahan
 
Evolving Scala, Scalar conference, Warsaw, March 2025
Martin Odersky
 
Shannon McFarland OpenStack/Cisco Intro
Shannon McFarland
 
OpenDaylight Developers Experience 1.5: Eclipse Setup, HOT reload, future plans
Michael Vorburger
 
Blackhat USA 2011 - Cesar Cerrudo - Easy and quick vulnerability hunting in W...
Michael Boman
 
Rugged DevOps Will help you build ur cloudz
James Wickett
 
Infinispan, a distributed in-memory key/value data grid and cache
Sebastian Andrasoni
 
Implementing Continuous Deployment
Andrew Phillips
 
Implementing continuous deployment JFall 2010
XebiaLabs
 
Ionic in 30
Ionic Framework
 
Unified Deployment: Including the Mainframe in Enterprise DevOps
XebiaLabs
 
2018 ABRF Tools for improving rigor and reproducibility in bioinformatics
Stephen Turner
 
Cloud iaa s-labs- ubuntu canonical- fossa2010
fOSSa - Free Open Source Software Academia Conference
 
EclipseCon 2016 - OCCIware : one Cloud API to rule them all
Marc Dutoo
 
Ad

More from vschiavoni (16)

PDF
From Draft to DSN - How to Get your Paper In [DSN 2025 Doctoral Forum Keynote]
vschiavoni
 
PDF
Impact of Network Topologies on Blockchain Performance
vschiavoni
 
PDF
ACM Middleware 2024 PC Chairs Opening Remarks
vschiavoni
 
PDF
Combining Asynchronous Task Parallelism and Intel SGX for Secure Deep Learning
vschiavoni
 
PDF
DEBS-2023.pdf
vschiavoni
 
PDF
Shielding Federated Learning Systems against Inference Attacks with ARM Trust...
vschiavoni
 
PDF
Labri 2021-invited-talk
vschiavoni
 
PDF
SafeFS: A Modular Architecture for Secure User-Space File Systems (One FUSE t...
vschiavoni
 
PDF
X-Search: Revisiting private web search using Intel SGX
vschiavoni
 
PDF
Actor concurrency for the JVM: a case study
vschiavoni
 
KEY
DHT and NAT
vschiavoni
 
PDF
FraSCAti: An Open SCA Platform
vschiavoni
 
PPT
Spring Intro
vschiavoni
 
PPT
Scorware - Spring Introduction
vschiavoni
 
PDF
BindingFactory
vschiavoni
 
ODP
Maven: Convention over Configuration
vschiavoni
 
From Draft to DSN - How to Get your Paper In [DSN 2025 Doctoral Forum Keynote]
vschiavoni
 
Impact of Network Topologies on Blockchain Performance
vschiavoni
 
ACM Middleware 2024 PC Chairs Opening Remarks
vschiavoni
 
Combining Asynchronous Task Parallelism and Intel SGX for Secure Deep Learning
vschiavoni
 
DEBS-2023.pdf
vschiavoni
 
Shielding Federated Learning Systems against Inference Attacks with ARM Trust...
vschiavoni
 
Labri 2021-invited-talk
vschiavoni
 
SafeFS: A Modular Architecture for Secure User-Space File Systems (One FUSE t...
vschiavoni
 
X-Search: Revisiting private web search using Intel SGX
vschiavoni
 
Actor concurrency for the JVM: a case study
vschiavoni
 
DHT and NAT
vschiavoni
 
FraSCAti: An Open SCA Platform
vschiavoni
 
Spring Intro
vschiavoni
 
Scorware - Spring Introduction
vschiavoni
 
BindingFactory
vschiavoni
 
Maven: Convention over Configuration
vschiavoni
 
Ad

Recently uploaded (20)

PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
David Malick Dieng
 
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
IAESIJAI
 
PDF
Machine learning based COVID-19 study performance prediction
IAESIJAI
 
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
DOCX
The AUB Centre for AI in Media Proposal.docx
GAONE9
 
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
PPTX
Machine Learning_overview_presentation.pptx
kondavamsidharreddy2
 
PDF
Chapter 3 Spatial Domain Image Processing.pdf
Getnet Tigabie Askale -(GM)
 
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
PDF
Encapsulation_ Review paper, used for researhc scholars
gurumoop
 
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
SandeepSingh286037
 
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
ZubinRadhakrishnan
 
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
PDF
NewMind AI Weekly Chronicles - August'25-Week II
NewMind AI
 
PPTX
Cloud computing and distributed systems.
kkkkkhan
 
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
PPTX
MYSQL Presentation for SQL database connectivity
Swati270511
 
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Jian-Hong Pan
 
PDF
MIND Revenue Release Quarter 2 2025 Press Release
MIND CTI
 
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 
Digital-Transformation-Roadmap-for-Companies.pptx
David Malick Dieng
 
Advanced methodologies resolving dimensionality complications for autism neur...
IAESIJAI
 
Machine learning based COVID-19 study performance prediction
IAESIJAI
 
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
The AUB Centre for AI in Media Proposal.docx
GAONE9
 
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
Machine Learning_overview_presentation.pptx
kondavamsidharreddy2
 
Chapter 3 Spatial Domain Image Processing.pdf
Getnet Tigabie Askale -(GM)
 
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
Encapsulation_ Review paper, used for researhc scholars
gurumoop
 
Building Integrated photovoltaic BIPV_UPV.pdf
SandeepSingh286037
 
“AI and Expert System Decision Support & Business Intelligence Systems”
ZubinRadhakrishnan
 
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
NewMind AI Weekly Chronicles - August'25-Week II
NewMind AI
 
Cloud computing and distributed systems.
kkkkkhan
 
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
MYSQL Presentation for SQL database connectivity
Swati270511
 
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Jian-Hong Pan
 
MIND Revenue Release Quarter 2 2025 Press Release
MIND CTI
 
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 

SPLAY: Distributed Systems Made Simple

  • 1. !"#$% Distributed Systems Made Simple Pascal Felber, Lorenzo Leonini, Etienne Rivière, Valerio Schiavoni, José Valerio Lua Workshop, 8 September 2011 Frick, Switzerland !"#$%
  • 2. About Me • 2010-now : PhD student at the University of Neuchatel, Switzerland (and Lua user since then) • Topic: large-scale distributed systems, cloud computing. Daily job: 1. Invent new protocols for cloud applications 2. Do experiments, write papers, go to 1 • 2007-2009: Research engineer at INRIA, France • BSc and MSc in Computer Engineering at the Università degli Studi Roma Tre, Italy !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 3. Motivations !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 4. Motivations • Developing, testing and tuning distributed applications is hard • In Computer Science research, fixing the gap of simplicity between pseudocode description and implementation is hard • Using worldwide testbeds is hard !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 5. What is !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 6. What is !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 7. What is • Machines contributed by universities, companies,etc. • 1098 nodes at 531 sites (02/09/2011) • Shared resources, no privileged access • University-quality Internet links • High resource contention • Faults, churn, packet-loss is the norm • Challenging conditions !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 8. Daily Job With Distributed Systems !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 9. Daily Job With Distributed Systems 1 code 1 • Write (testbed specific) code • Local tests, in-house cluster, PlanetLab... !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 10. Daily Job With Distributed Systems 2 1 code debug 2 • Debug (in this context, a nightmare) !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 11. Daily Job With Distributed Systems 2 1 code debug 2 • Debug (in this context, a nightmare) !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 12. Daily Job With Distributed Systems 3 1 2 code debug deploy 3 • Deploy, with testbed specific scripts !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 13. Daily Job With Distributed Systems 3 1 2 code debug deploy 3 • Deploy, with testbed specific scripts !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 14. Daily Job With Distributed Systems 4 1 2 3 code debug deploy get logs 4 • Get logs, with testbed specific scripts !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 15. Daily Job With Distributed Systems 4 1 2 3 code debug deploy get logs 4 • Get logs, with testbed specific scripts !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 16. Daily Job With Distributed Systems 5 1 2 3 4 code debug deploy get logs plots 5 • Produce plots, hopefully !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 17. Daily Job With Distributed Systems 1 2 3 4 5 code debug deploy get logs plots 5 • Produce plots, hopefully !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 18. !"#$% At Glance code debug deploy get logs plots • Supports the development, evaluation, testing, and tuning of distributed applications on any testbed: • In-house cluster, shared testbeds, emulated environments • Provides an easy-to-use pseudocode-like language implemented in Lua !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 19. !"#$% At Glance code debug deploy get logs plots • Supports the development, evaluation, testing, and tuning of distributed applications on any testbed: • In-house cluster, shared testbeds, emulated environments • Provides an easy-to-use pseudocode-like language implemented in Lua !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 20. !"#$% At Glance code debug deploy get logs plots l ot is gnup riend ur f • Supports the development, evaluation, yo testing, and tuning of distributed applications on any testbed: • In-house cluster, shared testbeds, emulated environments • Provides an easy-to-use pseudocode-like language implemented in Lua !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 21. The Big Picture require”splay.base” splayd splayd splayd splayd Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 22. The Big Picture splayd splayd require”splay.base” splayd splayd Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 23. The Big Picture splayd splayd require”splay.base” splayd splayd Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 24. Why ? !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 25. Why ? • Light & Fast • (Very) Close to equivalent code in C !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 26. Why ? • Light & Fast • (Very) Close to equivalent code in C • Concise • Allowimplementation focus on ideas more than developers to details • Key for researchers !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 27. Why ? • Light & Fast • (Very) Close to equivalent code in C • Concise • Allowimplementation focus on ideas more than developers to details • Key for researchers • Sandbox thanks to the possibility of easily redefine (even built-in) functions !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 28. Concise !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 29. Concise Pseudo code as published on original paper Executable code using SPLAY libraries !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 30. Sandbox: Motivations • Experiments should access only their own resources • Required for non-dedicated testbeds • In universities, companies • Totally available at night/holiday time • Memory-allocation, filesystem, network resources are restricted !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 31. Sandboxing LuaSocket ! ! • Same API as plain LuaSocket if sock.send then ! ! new_sock.send = function(self, data) ! local len = #data • On-demand sandboxed sockets ! ! ! if total_sent + len > max_send then ! ! ! ! l_o:warn("Send restricted (total: "..total_sent..")") ! ! ! ! return nil, "restricted" • Very easy thanks to Lua’s metatable ! ! ! end ! ! ! local n, status ! ! ! if math.random(1000) > udp_drop_ratio then ! ! ! ! n, status = sock:send(data) ! ! ! • Limits chosen by the SPLAYd deployer ! ! ! ! ! ! else ! end n = len • Both TCP and UDP ! ! ! if n then ! ! ! ! total_sent = total_sent + len ! ! ! end • Example: UDP’s socket.send ! ! ! return n, status ! ! end ! end !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 32. Sandboxing LuaSocket ! ! • Same API as plain LuaSocket if sock.send then ! ! new_sock.send = function(self, data) ! local len = #data • On-demand sandboxed sockets ! ! ! if total_sent + len > max_send then ! ! ! ! l_o:warn("Send restricted (total: "..total_sent..")") ! ! ! ! return nil, "restricted" • Very easy thanks to Lua’s metatable ! ! ! end ! ! ! local n, status ! ! ! if math.random(1000) > udp_drop_ratio then ! ! ! ! n, status = sock:send(data) ! ! ! • Limits chosen by the SPLAYd deployer ! ! ! ! ! ! else ! end n = len • Both TCP and UDP ! ! ! if n then ! ! ! ! total_sent = total_sent + len ! ! ! end • Example: UDP’s socket.send ! ! ! return n, status ! ! end ! end !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 33. for _,module in pairs(splay) !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 34. for _,module in pairs(splay) luasocket events io crypto llenc/benc json misc log rpc !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 35. for _,module in pairs(splay) luasocket events io crypto llenc/benc json misc log rpc Modules sandboxed to prevent access to sensible resources !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 36. splay.events luasocket events io crypto llenc/benc json misc log rpc Modules sandboxed to prevent access to sensible resources !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 37. splay.events events !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 38. splay.events • Distributed protocols can use message- passing paradigm to communicate • Nodes react to events events • Local, incoming, outgoing messages • The core of the Splay runtime • splay.socket, splay.io designed to provide a non-blocking operational mode • Based on Lua’s coroutines !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 39. splay.rpc luasocket events io crypto llenc/benc json misc log rpc !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 40. splay.rpc rpc !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 41. splay.rpc • Default mechanism to communicate between nodes • Support for UDP/TCP • Efficient BitTorrent-like encoding rpc • Experimental binary encoding !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 42. Life Before !"#$% • Time spent on developing testbed specific protocols • Or fallback on simulations... • The focus should be on ideas • Researchers usually have no time to produce industrial-quality code !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 43. public void declareNeighbourInactive(final DHTNode node) { // DO NOTHING HERE: Life Before !"#$% } public void addToLeafSet(final DHTNode node) { // DO NOTHING } /** * Empty UDP message is 64 bytes, to which we must add 1 bytes for the header, • Time spent on developing testbed * 1 bytes for the messageId, 28 bytes (IP,port,Bamboo ID) for message src, 28 * bytes for message dest + bytes for the specific data carried in the specific protocols • Or fallback on simulations... * message. NOTE: the size of informations to ack a message is 10 bytes, */ @Override • The focus should be on ideas public long calculateMessageBytes(final Message msg) { long result = 122; // 64 + 1 + 1 + 28 + 28; • Researchers usually have no time to if (msg.header == MessageType.PING) { /* nothing to add */ return result; produce industrial-quality code } if (msg.header == MessageType.PONG) { /* some bytes for the informations about which message is being acked */ result += ACK_INFORMATIONS_SIZE; return result; } if (msg.header == MessageType.BAMBOO_JOIN_LOOKUP_REQUEST !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland || msg.header == MessageType.BAMBOO_LOOKUP_REQUEST
  • 44. responseCallback.onResponseReceived(msg); }/* * CAN BE COMMENTED AS SEND RETRIAL OF MESSAGES IS OFF else { it is a Life Before !"#$% * duplicate lookup response, send a PONG to (hopefully) stop source to * send us again that message final Message pong = new * Message(MessageType.PONG, msg.messageId, this, msg.src); pong.ackedMsg * = msg; simulator.send(pong); } */ • Time spent on developing testbed } /* ELSE IF IS SOMETHING NOT A LOOKUP RESPONSE */ else { final Message beingAcked = msg.ackedMsg; specific protocols • Or fallback on simulations... final ResponseArrivedCallback handler = this.sentMessagesCallbacks .remove(beingAcked); • The focus should be on ideas /* if there is a mapping */ if (handler != null) { handler.onResponseReceived(msg); • Researchers usually have no time to }/* * else { this may happen in case of a response arrive later than * expected... log .info("%%% " + this + " received the response => " + produce industrial-quality code * msg + * " but no handler was expecting it! So, simply send back a PONG to make it stop sending again..n" * ); send a PONG to (hopefully) stop source to send us again final * Message pong = new Message(MessageType.PONG, msg.messageId, this, there is more :-( * msg.src); pong.ackedMsg = msg; simulator.send(pong); } */ } // /* it replied at last, so "reset" the value */ !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland // this.nodeConsecutiveTimeouts.put((DHTNode) msg.src, 0);
  • 45. such as epidemic diffusion on Erd¨ s-Renyi random o graphs [16] and various types of distribution trees [10] Life With !"#$% (n-ary trees, parallel trees). As one can note from the fol- lowing figure, all implementations are extremely concise 7 in terms of lines of code (LOC): Chord (base) 59 (base) + 17 (FT) + 26 (leafset) = 101 Pastry 265 Scribe Pastry 79 SplitStream Pastry Scribe 58 BitTorrent 420 Cyclon 93 Epidemic 35 Trees 47 Although the number of lines is clearly just a rough • Lines thepseudocode ~== Lines of executableitcodestill a indicator of of expressiveness of a system, is 5 Splay daemons have been continuously running on these hosts for !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 46. Live Demo www.splay-project.org !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 47. ay aw e- e ak lid T S • Distributed systems raise a number of issues related to their evaluation • Their implementation, debug, deployment and tuning is hard • !"#$% leverages Lua to produce an easy to use yet powerful working environment to solve these issues !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 48. Backup Slides !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 49. The Big Picture !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 50. The Big Picture Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 51. The Big Picture REST API Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 52. The Big Picture Shell Web REST API Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 53. The Big Picture Shell Web REST API Splay Controller SQL DB !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 54. The Big Picture Shell Web REST API Splay churn Controller jobs SQL DB blacklist !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 55. The Big Picture alpha require”splay.base” ... Shell Web REST API Splay churn Controller jobs SQL DB blacklist !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 56. splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web REST API Splay churn Controller jobs SQL DB blacklist !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 57. splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web REST API Splay churn Controller log jobs log SQL DB blacklist log !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 58. splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web ctrl REST API ctrl ctrl Splay churn Controller log jobs log SQL DB blacklist log !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 59. splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web ctrl REST API ctrl ctrl Splay churn Controller log jobs log SQL DB blacklist log !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland
  • 60. splayd The Big Picture splayd alpha splayd require”splay.base” ... Shell Web ctrl REST API ctrl ctrl Splay churn Controller log jobs log SQL DB blacklist log !"#$% Distributed Systems Made Simple - V. Schiavoni - Lua Workshop 2011, Frick, Switzerland