Ellip Studio - Training session
0 likes74 views
Ellip is a collaborative platform designed for earth science practitioners to create, share, and document applications and resources while adhering to best practices for data interoperability. Users, categorized as producers and consumers, can build scalable processing applications and share assets, allowing for efficient data processing and reusability. The platform emphasizes user ownership of assets and provides flexibility in selecting production environments.
![Ellip Studio tutorials
https://gitlab.com/app-packages/terradue/[
app_package].git
Ellip Studio workspace
https://gitlab.com/ec-nextocean/pml/
[ellip_username]
Ellip Studio workspace
Run Build
Ellip Studio workspace
Git
clone
CWL on Kubernetes
Container registry
Push
Run
https://gitlab.com/ec-nextocean/pml/
[ellip_username]
Ellip Studio workspace
Push
CI Container registry
Learn to automate Container Registry
updates of the App Package, for use
by referenced Production servers
Use Application Package source
from third party, test data access
Learn to build your own application
package
Test for scalability, use Ellip
Studio’s pre-prod environment](https://image.slidesharecdn.com/ellipstudio-trainingsession-230131104450-7e953560/85/Ellip-Studio-Training-session-4-320.jpg)
Ellip Studio - Training session
- 1. Ellip: a collaborative workplace for Earth Science Ellip Studio - Training session April 2022 Hervé Caumont Platform Operations, Terradue
- 2. Ellip users are EO applications builders
- 3. Ellip Studio tutorials Ellip Studio implements the OGC Best Practice for Earth Observation Application Package, a set of recommendations for application design patterns, package encoding, container and data interfaces
- 4. Ellip Studio tutorials https://gitlab.com/app-packages/terradue/[ app_package].git Ellip Studio workspace https://gitlab.com/ec-nextocean/pml/ [ellip_username] Ellip Studio workspace Run Build Ellip Studio workspace Git clone CWL on Kubernetes Container registry Push Run https://gitlab.com/ec-nextocean/pml/ [ellip_username] Ellip Studio workspace Push CI Container registry Learn to automate Container Registry updates of the App Package, for use by referenced Production servers Use Application Package source from third party, test data access Learn to build your own application package Test for scalability, use Ellip Studio’s pre-prod environment
- 6. Ellip Solutions on Terradue Cloud Platform Value Adders who collaborate on ellip: Producers Consumers consumers & producers, interacting
- 7. Ellip Solutions on Terradue Cloud Platform Explorer Subscribers Scaler Subscribers Value Adders who collaborate on ellip Producers Consumers Explorer Subscribers explore new opportunities to make data processing more efficient and reusable within non-specialist communities Scaler Subscribers scale up processing applications onto production environments, and deliver turnkey information layers to their stakeholders Premium Subscribers full access end-to-end (explorer + scaler)
- 9. ● Ellip Notebooks ○ “Create interactive laboratory notebooks” ● Ellip Studio ○ “Design scalable processing chains” ● Ellip Launchpads ○ “Select a data processor and deploy it” ● Ellip Infohubs ○ “Connect data sources to a Client App” Ellip Solutions Vestibulum congue Vestibulum congue V e s t i b u l u m c o n g u e Vestibulum congue Ellip Infohubs Ellip N otebooks Ellip Launchpads Ellip Studio
- 10. Producers Consumers Ellip Solutions Vestibulum congue Vestibulum congue V e s t i b u l u m c o n g u e Vestibulum congue Ellip Infohubs Ellip N otebooks Ellip Launchpads Ellip Studio Ellip Exchange ● Ellip Exchange ○ “Access the marketplace of Ellip-powered resources” ○ Each Ellip Solution embeds read and write operations from/to Ellip Exchange
- 11. Ellip collaborative work in a nutshell As an Explorer subscriber, I want to share my assets with selected Scaler users Integrate for scalability Share my Application Packages with interested parties Advertise to Ellip consumers “Scalers” Consumers Ellip Exchange Publish Application Packages on the marketplace Ellip Studio
- 12. Ellip collaborative work in a nutshell As a Scaler subscriber, I want to reuse assets shared to me by Explorer users Search & import Run at scale Bring in my stakeholders Reuse from Ellip producers “Explorers” Producers Ellip Exchange Import Application Packages in your Producer Deck
- 13. Ellip end-to-end in a nutshell As a Premium Partner subscriber, I want to build and maintain a processing service Interactively prototype Integrate for scalability Run at scale Bring in my stakeholders Ellip Studio
- 14. Ellip Exchange is the core enabler of Ellip as a ‘collaborative workplace’ V e s t i b u l u m c o n g u e V e s t i b u l u m c o n g u e V e s t i b u l u m c o n g u e V e s t i b u l u m c o n g u e Ellip Exchange E l l i p I n f o h u b s E l l i p N o t e b o o k s E l l i p L a u n c h p a d s E l l i p S t u d i o . Application code . Packaged application . Tutorial . Running WPS at a selected Cloud Provider . New information layers . Reproducible experiment as code . Interactive data visualisations . OWS Context template . ad-hoc Community Portal Resources Resources Resources Resources Source Code Git Repo (incl. Jupyter Notebook files) Software Library not Publicly available Application Package ADES instance on a given Cloud Provider ?processing queue (high or low priority) on an ADES? Deployed application (processing service endpoint) Data Source repos not Publicly available Catalog collections not Publicly available Data product files Data Products as an Information Layer (service) Geobrowser App template definition Geobrowser App instance on a given Portal
- 17. Hybrid Cloud Added Cloud API (extension mechanisms) ADDed Cloud Provider EC2 API - powered by jclouds Amazon Web Services Openstack API - powered by libcloud EGI Federated Cloud Opennebula registered partner Terradue Openstack API - powered by libcloud AWS EGI DIAS Copernicus DIAS ADD
- 18. Summary
- 19. So, what does a platform mean nowadays? The Ellip Solutions are built for earth sciences practitioners: ▪ to share about their findings, streamline their creation of new resources and make these accessible, interoperable, ▪ and document their developments on the PaaS as reproducible experiments In line with the FAIR guiding principles to make data findable, accessible, interoperable and reusable
- 20. All of it: an Open Cloud strategy ▪ The Ellip subscribers remain the owners of their created assets, and decide how to share these on the platform, for other users to find and reuse these assets. ▪ They are also empowered to decide on the target production environment of their packaged applications (no lock in with Cloud provider) Producers Consumers
- 21. Looking forward hearing from you! https://www.terradue.com Hervé Caumont, Platform Operations herve.caumont@terradue.com