The LEAD Portal: An OGCE based weather science gateway
- 1. The LEAD Portal: An OGCE based weather science gateway Marcus Christie and Suresh Marru Indiana University LEAD Project (www.leadproject.org)
- 2. The Weather Challenge (WxChallenge)
- 3. WxChallenge - LEAD Portal Beta Testers … and others
- 4. So, what’s the value to the participants?
- 5. So, what’s the value to the participants?
- 6. So, what’s the value to the participants?
- 7. So, what’s the value to the participants?
- 8. So, what’s the value to the participants?
- 9. So, what’s the value to the participants?
- 10. So, what’s the value to the participants?
- 11. Outcome Total participants: 10 Total workflows: 279 Total data storage: 2.6 TB (including non weather challenge participants) Total SUs: 52925 (including non weather challenge participants) Workflow success rate: 78%/36%
- 12. The Architecture of Gateway Services The Users Desktop. Gateway Services Grid Portal Server Physical Resource Layer Core Grid Services Proxy Certificate Server / vault Application Events Resource Broker User Metadata Catalog Replica Mgmt Application Workflow App. Resource catalogs Application Deployment Execution Management Information Services Self Management Data Services Resource Management Security Services OGSA-like Layer
- 13. Info/History Staffing: 2 FTE + several graduate students Fall 2004: Started work on the LEAD Portal (uPortal) Spring 2005: Selected GridSphere Spring 2006: Integrated with BPEL workflow engine and updated metadata schema Summer 2006: First went “live” supporting Unidata Users’ Workshop Spring 2007: WxChallenge and Spring Forecast experiments
- 14. TeraGrid Resources Big Red Data Capacitor NCSA’s Tungsten and Mercury SPRUCE at UC
- 15. Security: Registering for an account
- 17. Security: Email address confirmed
- 20. Security: User gets acceptance email
- 21. Security: User can now log in
- 22. Security: Verifying user account
- 23. A Tale of Two Authorization Systems Application Service LEAD Portal - authenticate with identity certificate verify authorization GSI TeraGrid community account proxy certificate AuthZ
- 24. LEAD Architecture + Auditing App Service LEAD Portal Notification Broker GPEL Workflow Engine App Service App Service Auditing Service GRAM Gatekeeper 1. Portal registers workflow 2. Portal submits workflow 3. WF engine invokes app services 4. Launch GRAM jobs 5. Audit notifs 6. Queries for charge
- 25. Challenges, Lessons Learned Globus reliability issues Become best friends with your RPs Gateway priorities Make sure you know for what audience you are building your gateway Security It’s a lot harder as an afterthought Production deployment You’ll want to be serious about separate deployments; and it will cost you
- 26. Future Work Give user’s more control Allow editing of model configurations Allow users to burn their own allocations Allow users to bring in their own software Running ensembles Data-driven workflows Fault tolerance/monitoring Repackaging
- 27. Wrap Up Go to http://portal.leadproject.org to request an account For more information about OGCE Tuesday, 4:30-5:00: Building a Grid Portal for TeraGrid’s Big Red Wednesday, 9:30-10:00: Grid Portlets and Services from the Open Grid Computing Environments (OGCE) Collaboration (Software Provider Forum) Questions?