SlideShare a Scribd company logo

Distributed Storage System for Volunteer Computing

A
Arinto Murdopo

This document presents a preliminary proposal for a distributed storage system for volunteer computing. It discusses using volunteer computing resources to create a distributed storage system with no single point of failure that provides data availability and integrity. Some challenges include that distributed storage systems for volunteer computing do not currently exist. The proposal reviews existing peer-to-peer distributed storage systems and surveys which may be suitable. The objectives are to evaluate systems based on security, availability, and reliability, and possibly experiment with suitable systems in a distributed storage testbed.

EducationTechnologyBusiness
Related topics:
Distributed Systems Overview
1 of 11
Downloaded 17 times
1
2
3
4
5
6
7
8
9
10
11
Distributed Storage System for Volunteer Computing Preliminary Presentation G-007 Arinto Murdopo, Diego Montero, Julia Proskurnia, Enkhjin Bayarsaikhan
Overview ● Volunteer Computing (VC) ● Distributed Storage System (DSS) ● Challenges ● Work in Progress ● What's Next
Volunteer Computing(VC) ● Group of computing resources ● Voluntary share the resource ● Trust between peers ● Incentive volunteers!! ● Example: ○ SETI@home ○ storage@home ○ BOINC ● However, data is centrally stored
VC Architecture
Distributed Storage System (DSS) ... self explanatory.. ● No single point of failure ● Data availability & integrity Examples: ● Cassandra, used by Facebook ● Voldemort, used by LinkedIn
Challenges Distributed Storage System for Volunteer Computing System does not really exist.... yet With the help of.. ● increased abundance of storage (speed & size) ● improvement in distributed storage research Yes, we can!
VC with DSS
Work In Progress Review on these following systems ● Ivy ● OverNet ● Squirrel ● Dynamo ● FarSite ● Riak ● Pastis ● Glacier ● PAST ● Voldemort ● Total Recall ● Cassandra ● OceanStore
Work In Progress
Project Objectives ● Evaluation of existing P2P DSS based on ○ Security, availability, reliability, etc ● Survey on DSS, which are suitable for VC ● Possible evaluation of DSS by experimenting in DS testbed (ex: Planet Lab)
Q&A Questions?

More Related Content

ODP
Dsensor.org peer to peer science
James Littlejohn
 
PPTX
Event Management System Document
LJ PROJECTS
 
PDF
The Bleeding Edge
RichardWarburton
 
PDF
The Bleeding Edge
jClarity
 
PDF
AMW43 - Unba.se, Distributed database for human interaction
Daniel Norman
 
PDF
Large Scale Distributed Storage Systems in Volunteer Computing - Slide
Arinto Murdopo
 
ODP
Cloud accounting software uk
Arcus Universe Ltd
 
PDF
Development without Constraint
Chad Davis
 
Dsensor.org peer to peer science
James Littlejohn
 
Event Management System Document
LJ PROJECTS
 
The Bleeding Edge
RichardWarburton
 
The Bleeding Edge
jClarity
 
AMW43 - Unba.se, Distributed database for human interaction
Daniel Norman
 
Large Scale Distributed Storage Systems in Volunteer Computing - Slide
Arinto Murdopo
 
Cloud accounting software uk
Arcus Universe Ltd
 
Development without Constraint
Chad Davis
 

Similar to Distributed Storage System for Volunteer Computing (20)

PPTX
Solving the Database Problem
Jay Gordon
 
PPTX
Data analysis in JavaScript
Ashley Davis
 
PDF
Quick dive into the big data pool without drowning - Demi Ben-Ari @ Panorays
Demi Ben-Ari
 
PPTX
Grandata
Stefano Paluello
 
ODP
Big data nyu
Edward Capriolo
 
PDF
Monitoring Big Data Systems - "The Simple Way"
Demi Ben-Ari
 
PDF
Drupal and Devops , the Survey Results
Kris Buytaert
 
PDF
Hadoop: Big Data Stacks validation w/ iTest How to tame the elephant?
Dmitri Shiryaev
 
ODP
Ceph: A decade in the making and still going strong
Patrick McGarry
 
PPTX
Hacker vs company, Cloud Cyber Security Automated with Kubernetes - Demi Ben-...
Demi Ben-Ari
 
PDF
Container Attached Storage with OpenEBS - CNCF Paris Meetup
MayaData Inc
 
PDF
New paradigms
Borja A. Espejo García
 
PDF
Introduction into Ceph storage for OpenStack
OpenStack_Online
 
ODP
Ceph Day NYC: Building Tomorrow's Ceph
Ceph Community
 
ODP
Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph
Ceph Community
 
PDF
Joker'14 Java as a fundamental working tool of the Data Scientist
Alexey Zinoviev
 
PPTX
Webinar: Overcoming the Storage Roadblock to Data Center Modernization
Storage Switzerland
 
PDF
Real time data driven applications (and SQL vs NoSQL databases)
GoDataDriven
 
PDF
Thinking DevOps in the Era of the Cloud - Demi Ben-Ari
Demi Ben-Ari
 
PDF
Group7 presentation
Julia Proskurnia
 
Solving the Database Problem
Jay Gordon
 
Data analysis in JavaScript
Ashley Davis
 
Quick dive into the big data pool without drowning - Demi Ben-Ari @ Panorays
Demi Ben-Ari
 
Grandata
Stefano Paluello
 
Big data nyu
Edward Capriolo
 
Monitoring Big Data Systems - "The Simple Way"
Demi Ben-Ari
 
Drupal and Devops , the Survey Results
Kris Buytaert
 
Hadoop: Big Data Stacks validation w/ iTest How to tame the elephant?
Dmitri Shiryaev
 
Ceph: A decade in the making and still going strong
Patrick McGarry
 
Hacker vs company, Cloud Cyber Security Automated with Kubernetes - Demi Ben-...
Demi Ben-Ari
 
Container Attached Storage with OpenEBS - CNCF Paris Meetup
MayaData Inc
 
New paradigms
Borja A. Espejo García
 
Introduction into Ceph storage for OpenStack
OpenStack_Online
 
Ceph Day NYC: Building Tomorrow's Ceph
Ceph Community
 
Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph
Ceph Community
 
Joker'14 Java as a fundamental working tool of the Data Scientist
Alexey Zinoviev
 
Webinar: Overcoming the Storage Roadblock to Data Center Modernization
Storage Switzerland
 
Real time data driven applications (and SQL vs NoSQL databases)
GoDataDriven
 
Thinking DevOps in the Era of the Cloud - Demi Ben-Ari
Demi Ben-Ari
 
Group7 presentation
Julia Proskurnia
 
Ad

More from Arinto Murdopo (20)

PDF
Distributed Decision Tree Learning for Mining Big Data Streams
Arinto Murdopo
 
PDF
Distributed Decision Tree Learning for Mining Big Data Streams
Arinto Murdopo
 
PDF
Next Generation Hadoop: High Availability for YARN
Arinto Murdopo
 
PPTX
High Availability in YARN
Arinto Murdopo
 
PDF
Distributed Computing - What, why, how..
Arinto Murdopo
 
PDF
An Integer Programming Representation for Data Center Power-Aware Management ...
Arinto Murdopo
 
PDF
An Integer Programming Representation for Data Center Power-Aware Management ...
Arinto Murdopo
 
PDF
Quantum Cryptography and Possible Attacks-slide
Arinto Murdopo
 
PDF
Quantum Cryptography and Possible Attacks
Arinto Murdopo
 
PDF
Parallelization of Smith-Waterman Algorithm using MPI
Arinto Murdopo
 
PDF
Dremel Paper Review
Arinto Murdopo
 
PDF
Megastore - ID2220 Presentation
Arinto Murdopo
 
PDF
Flume Event Scalability
Arinto Murdopo
 
PDF
Large-Scale Decentralized Storage Systems for Volunter Computing Systems
Arinto Murdopo
 
PDF
Rise of Network Virtualization
Arinto Murdopo
 
PDF
Intelligent Placement of Datacenter for Internet Services
Arinto Murdopo
 
PDF
Architecting a Cloud-Scale Identity Fabric
Arinto Murdopo
 
PDF
Consistency Tradeoffs in Modern Distributed Database System Design
Arinto Murdopo
 
PDF
Apache Flume
Arinto Murdopo
 
PDF
Why File Sharing is Dangerous?
Arinto Murdopo
 
Distributed Decision Tree Learning for Mining Big Data Streams
Arinto Murdopo
 
Distributed Decision Tree Learning for Mining Big Data Streams
Arinto Murdopo
 
Next Generation Hadoop: High Availability for YARN
Arinto Murdopo
 
High Availability in YARN
Arinto Murdopo
 
Distributed Computing - What, why, how..
Arinto Murdopo
 
An Integer Programming Representation for Data Center Power-Aware Management ...
Arinto Murdopo
 
An Integer Programming Representation for Data Center Power-Aware Management ...
Arinto Murdopo
 
Quantum Cryptography and Possible Attacks-slide
Arinto Murdopo
 
Quantum Cryptography and Possible Attacks
Arinto Murdopo
 
Parallelization of Smith-Waterman Algorithm using MPI
Arinto Murdopo
 
Dremel Paper Review
Arinto Murdopo
 
Megastore - ID2220 Presentation
Arinto Murdopo
 
Flume Event Scalability
Arinto Murdopo
 
Large-Scale Decentralized Storage Systems for Volunter Computing Systems
Arinto Murdopo
 
Rise of Network Virtualization
Arinto Murdopo
 
Intelligent Placement of Datacenter for Internet Services
Arinto Murdopo
 
Architecting a Cloud-Scale Identity Fabric
Arinto Murdopo
 
Consistency Tradeoffs in Modern Distributed Database System Design
Arinto Murdopo
 
Apache Flume
Arinto Murdopo
 
Why File Sharing is Dangerous?
Arinto Murdopo
 
Ad

Recently uploaded (20)

PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
KMDee
 
PPTX
Pharma ospi slides which help in ospi learning
rameetkumar304
 
PPTX
Institutional Correction lecture only . . .
limvtheghins
 
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
mohitsuren827
 
PPTX
Presentation on HIE in infants and its manifestations
joghikamal786
 
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Chris Sistrunk
 
PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
ElishamichaelSamwel
 
PDF
O7-L3 Supply Chain Operations - ICLT Program
labyankof
 
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Academy of Grassroots Studies and Research of India (AGRASRI)
 
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
kawisojames10
 
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
ArchitectAFMMohiuddi
 
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
Jonathan Hallett
 
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
shilpa939953
 
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
home
 
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
Raji Murugan
 
PPTX
Microbial diseases, their pathogenesis and prophylaxis
DevlinaSengupta
 
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
jahanzaibmughal6
 
PPTX
Final Presentation General Medicine 03-08-2024.pptx
ZaheerAhmad228692
 
PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
shilpa939953
 
PDF
VCE English Exam - Section C Student Revision Booklet
jpinnuck
 
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
KMDee
 
Pharma ospi slides which help in ospi learning
rameetkumar304
 
Institutional Correction lecture only . . .
limvtheghins
 
Abdominal Access Techniques with Prof. Dr. R K Mishra
mohitsuren827
 
Presentation on HIE in infants and its manifestations
joghikamal786
 
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Chris Sistrunk
 
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
ElishamichaelSamwel
 
O7-L3 Supply Chain Operations - ICLT Program
labyankof
 
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Academy of Grassroots Studies and Research of India (AGRASRI)
 
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
kawisojames10
 
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
ArchitectAFMMohiuddi
 
Module 4: Burden of Disease Tutorial Slides S2 2025
Jonathan Hallett
 
human mycosis Human fungal infections are called human mycosis..pptx
shilpa939953
 
202450812 BayCHI UCSC-SV 20250812 v17.pptx
home
 
2.FourierTransform-ShortQuestionswithAnswers.pdf
Raji Murugan
 
Microbial diseases, their pathogenesis and prophylaxis
DevlinaSengupta
 
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
jahanzaibmughal6
 
Final Presentation General Medicine 03-08-2024.pptx
ZaheerAhmad228692
 
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
shilpa939953
 
VCE English Exam - Section C Student Revision Booklet
jpinnuck
 

Distributed Storage System for Volunteer Computing

  • 1. Distributed Storage System for Volunteer Computing Preliminary Presentation G-007 Arinto Murdopo, Diego Montero, Julia Proskurnia, Enkhjin Bayarsaikhan
  • 2. Overview ● Volunteer Computing (VC) ● Distributed Storage System (DSS) ● Challenges ● Work in Progress ● What's Next
  • 3. Volunteer Computing(VC) ● Group of computing resources ● Voluntary share the resource ● Trust between peers ● Incentive volunteers!! ● Example: ○ SETI@home ○ storage@home ○ BOINC ● However, data is centrally stored
  • 5. Distributed Storage System (DSS) ... self explanatory.. ● No single point of failure ● Data availability & integrity Examples: ● Cassandra, used by Facebook ● Voldemort, used by LinkedIn
  • 6. Challenges Distributed Storage System for Volunteer Computing System does not really exist.... yet With the help of.. ● increased abundance of storage (speed & size) ● improvement in distributed storage research Yes, we can!
  • 8. Work In Progress Review on these following systems ● Ivy ● OverNet ● Squirrel ● Dynamo ● FarSite ● Riak ● Pastis ● Glacier ● PAST ● Voldemort ● Total Recall ● Cassandra ● OceanStore
  • 10. Project Objectives ● Evaluation of existing P2P DSS based on ○ Security, availability, reliability, etc ● Survey on DSS, which are suitable for VC ● Possible evaluation of DSS by experimenting in DS testbed (ex: Planet Lab)