EPrints and the Cloud
Download as PPTX, PDF4 likes1,029 views
Eprints offers a comprehensive platform for managing and sharing research materials, emphasizing cloud-based storage solutions and hybrid storage capabilities. It supports diverse functionalities including administrative reporting, data sharing, and e-learning, while facilitating scalability and performance through various storage types like local and cloud options. The forthcoming Eprints 3.2 aims to enhance its core functionalities and community-driven development through a plugin system, promoting ease of use and integration with external services.
EPrints and the Cloud
- 2. What is EPrints For?EPrints offers a safe, open and useful place to store, share and manage material in the pursuit of research and educational agendas.administrative reporting, collaboration, data sharing, digital profile enhancement , e-learning, e-publishing, e-research, marketing, open access, preservation, publicity, research assessment, research management, scholarly collections
- 3. Research Curation, Researcher SupportResearchers’ environment supported by repositoryResearch data managed by repositoryResearch community assisted by repository
- 4. What is a RepositorySafe, secure, persistent, managed storage for filesSafe, secure, persistent management of shareable FRBR worksSafe, secure, persistent, management of scholarly & scientific working Leading to…Science 2.0 / The Fourth Paradigm / Data Intensive ScienceThe challenge is not cloud computing but cloud thinking
- 6. Current EPrints Cloud CapabilitiesAmazon Elastic Compute Machine Images (AMIs)Small (Single Core / 1.7Gb)Large (64 Bit / Quad Core / 7.5Gb)Extra Large (64 Bit / 8 Core / 15Gb) EPrints 3.2 is 64 Bit EnabledPersistent Database & StorageReally Excited - Super Fast / Cheap / Easy!
- 7. Cloud to Desktop StorageData can be stored on multiple storage servicesLocal disk, SAN, NAS, Honeycomb, CloudResearchers can mount repository objects as a networked filesystemService usage and preservation risks can be monitored and analysed.
- 8. Hybrid Storage In EPrintsA single storage solution has drawbacks.Cost vs. Speed vs. ReliabilityRepositories need to be agile: to utilize and be able to migrate to new platformsLeverage the benefits of each solution without losing control of your digital objects.
- 9. Local Disk StorageNo local bandwidth costsHard to expand Locally Managed High overheads cost Requires space and cooling Tied closely to the software Storage ecosystem
- 10. Local Archival StorageSpecialist Expensive to purchase Locally Managed Space and running costs Expandable Storage ecosystem
- 11. Cloud StorageScalable Externally controlled Known CostingsUnclear retention policy Re-Useable (using simple APIs) Global ScaleStorage ecosystem
- 12. But Clouds Blow AwayRecently:Yahoo BriefcaseXDriveAOL PicturesHP UplineSony Image StationSource: Tom Spring - PCWorld
- 13. Why use Hybrid StorageUse the best features of each storage typePerformanceScaling-up bandwidthOptimisationLarge-file handlingMultimedia streamingLocalised DeliveryLocal delivery from the cloud
- 14. EPrints Storage ControllerThe storage controller decides where to put a file.
- 15. Rule-based policy defined by XML configuration file
- 16. Large binary files of scientific data (raw machine result data) can be stored in a large disk (slower access) system and sent to a tape company for long term storage.
- 17. Processed results can be stored locally and in the cloud ready for rapid delivery to end points. Architecture Diagram
- 18. Controller Ruleset<choose> <when test="datasetid = 'document'"> <choose> <when test="$parent{relation_type} = 'isVolatileVersionOf'"> <plugin name="Local"/> </when> <otherwise> <plugin name="AmazonS3"/> </otherwise> </choose> </when> <otherwise> <plugin name="Local"/> </otherwise> </choose>
- 20. Amazon S3 Localisation (1)
- 21. Amazon S3 Localisation (2)
- 22. Preservation ServicesObject ClassificationRisk AnalysisMitigation and Migration
- 24. EPrints Cloud ServicesWeb based repository setupMuch like getting started with a blog.Fill in a form and obtain a repository.Coming to EPrints core in next major release.Enterprise Support for Cloud SolutionsFull Setup & ConfigurationGlobal DistributionAuto Upgrade & PatchingTrusted Backup
- 25. EPrints 3.2Plug-ins / ModulesEverything builds on the core layerMajor part of v3.2 is strengthening the core and adding more abstraction layersImproved data model Enhanced data facilities Enhanced metadata facilitiesImproved programming & API
- 27. Community Driven DevelopmentThere are many abstraction layers.Display ManipulationUpload HandlersCustom DatasetsImport / Export Plug-insTranscoding Plug-insDatabase Plug-insStorage Plug-insOne API
- 28. Storage Plug-insLocalNFSAmazon S3Sun Cloud Storage ServiceMicrosoft AzureAny others based on the S3 API…. (the last 3 all are)5 Call API (about 30mins to write a plug-in)
- 29. Our Development VisionEmpower the Community with a simple APIAPI in 3.2Give the community a platform to test their codeUse the Cloud!Give the community a distribution mechanismThe EPrints Bazaar (beta)
- 30. EPrints BazaarSimilar in concept to Apple’s App StoreEvery install of EPrints will have access to the BazaarSingle click install/uninstall of plug-insEPrints Services Approved Plug-insEnterprise support for limited 3rd party plug-ins
- 31. SummaryEPrints provides the professional, enterprise level application for resource managementIncluding cloud support at many levelsRepository-in-the-cloudStorage-in-the-cloudServices-in-the-cloud