SlideShare a Scribd company logo
OGCE Overview: Portals, Services, Workflows, Gadgets, and TagsMarlon Pierce (IU), Suresh Marru (IU), Raminder Singh (IU), ChathuraHerath (IU), Gregor von Laszewski (RIT), Fungang Wang (RIT), Mary Thomas (SDSU), Nancy Wilkins-Diehr (SDSC), Jeff Sale (SDSC), MaytalDahan (TACC), Rion Dooley (TACC), and Wenjun Wu (UC)Funding: NSF SDCI, TeraGrid RP and GIG (synergistic)
Links for More Information Website: http://www.collab-ogce.orgNews/RSS/Blog: http://collab-ogce.blogspot.comEmail: discuss@ogce.orgSVN Code Repository: http://ogce.svn.sourceforge.net/viewvc/ogce/And get tar.gz’sSource Forge: http://sourceforge.net/projects/ogce
OGCE TG09 Tech Track Presentation
OGCE and Gateways We develop and package software for use by TeraGrid Science Gateways and other resources
BioVLAB use OGCE tools to run on Amazon
A lot of this comes from active Gateways.
Information Services (GPIR, QBETS): TeraGrid User Portal
Workflow tools: LEAD
Resource Discovery Service, File Browser Applet: TGUP, GridChem
Gadgets, Open Social Containers: SIDGrid, OLSG
We contribute codes back to these projects.	GatewaysOGCESoftware
Grid Portal SoftwareJava-basedCode managed by Source Forge SVN. Get it by anonymous SVN checkoutDownload the Tar: http://ogce.svn.sourceforge.net/viewvc/ogce/tags/ogce-portal-only-2.5-release.tar.gzOne-line build: mvn clean install.Download has everything you need except Java.
File browser front end from OGCE portal download
Workflow: GFAC and XBaya
LEAD: A Weather Forecasting WorkflowWRF-Static running on TungstenOGCE Workflow Tutorial
Nightly builds on 14 linux, Mac PPC, and Mac X86
JMeter test suite
Some OGCE ServicesInformation Web Services and build framework
Resource Discovery ServiceExtracted from the TeraGrid User PortalContributed by Rion Dooley, TACCAxis2 Web serviceIntegrates information from INCA, GPIR services.What machines are in my GridWhich ones are actually running?Works with TeraGrid deployed services, but you can use it with your own information service installations.
Resource Prediction Service (RPS)Predicts an optimal set of resources for running scientific applications
Predicts a set of resources on which the sum of data transfer time, queue wait time and compute time for the application will be minimum
Data transfer time: Uses input data size and NWS info
Queue wait time: Uses QBETS info
Compute time: Uses application performance info
Axis2 web service with a MySQL backend
RPS is a subset of the Fault Tolerance and Recovery service used in LEAD and VGrADSPackaging ServicesEverything builds with one commandmvn clean installWe use Apache Maven 2 for builds.Structured, modular builds and consistent layoutsBuild a single module: mvn clean install –fsomemod/pom.xmlWe include Apache Tomcat in the download, so all you need is Java and MySQL.Suitable also for the NMI build and test system.Want the Javadoc?  mvnjavadoc:javadoc
Upcoming ServicesXMC-CAT metadata cataloging service with JSDL sample implementation.Swarm Web Service for mass job submission and management.http://escience2008.iu.edu/sessions/SWARM.shtmlGPIR Web Service for information on your Grid. This is being repackaged; older packaged version (but same code) is already available.GFAC and XRegistry services Available now using XSUL Web service engine

More Related Content

PPTX
OGCE MSI Presentation
PPT
OGCE TeraGrid 2010 ASTA Support
PPT
OGCE Overview for SciDAC 2009
PPT
GTLAB Installation Tutorial for SciDAC 2009
PPT
Cyberinfrastructure and Applications Overview: Howard University June22
PPT
Computing Outside The Box June 2009
PPTX
Federated Storage Resources GCC2018 https://vimeo.com/291738189
PDF
Data Streaming Ecosystem Management at Booking.com
OGCE MSI Presentation
OGCE TeraGrid 2010 ASTA Support
OGCE Overview for SciDAC 2009
GTLAB Installation Tutorial for SciDAC 2009
Cyberinfrastructure and Applications Overview: Howard University June22
Computing Outside The Box June 2009
Federated Storage Resources GCC2018 https://vimeo.com/291738189
Data Streaming Ecosystem Management at Booking.com

What's hot (20)

PDF
Oracle cloud data interface
PDF
MongoDB World 2016: The Best IoT Analytics with MongoDB
PDF
Optimizing Elastic for Search at McQueen Solutions
PDF
Elastic Stack Roadmap
PPTX
MongoDB World 2018: MongoDB for High Volume Time Series Data Streams
PDF
MongoDB and the Internet of Things
PDF
Microservices observability
PDF
University of Oxford: building a next generation SIEM
PDF
MongoDB World 2018: Building a New Transactional Model
PDF
Log everything! @DC13
PDF
PigSPARQL: A SPARQL Query Processing Baseline for Big Data
PPTX
2015.03 - The RDF Validator - A Tool to Validate RDF Data (KIM)
PPTX
Introduction to Distributed Tracing
PDF
Zuul's Journey to Non-Blocking
PDF
Achieving HIPAA on GCP
PDF
Scalable Anomaly Detection (with Zero Machine Learning)
PPTX
Config mgmt camp 2015
PPTX
How Thermo Fisher is Reducing Data Analysis Times from Days to Minutes with M...
PDF
Open-source Infrastructure at Lyft
PDF
Puppet Camp Melbourne 2014: Node Collaboration with PuppetDB
Oracle cloud data interface
MongoDB World 2016: The Best IoT Analytics with MongoDB
Optimizing Elastic for Search at McQueen Solutions
Elastic Stack Roadmap
MongoDB World 2018: MongoDB for High Volume Time Series Data Streams
MongoDB and the Internet of Things
Microservices observability
University of Oxford: building a next generation SIEM
MongoDB World 2018: Building a New Transactional Model
Log everything! @DC13
PigSPARQL: A SPARQL Query Processing Baseline for Big Data
2015.03 - The RDF Validator - A Tool to Validate RDF Data (KIM)
Introduction to Distributed Tracing
Zuul's Journey to Non-Blocking
Achieving HIPAA on GCP
Scalable Anomaly Detection (with Zero Machine Learning)
Config mgmt camp 2015
How Thermo Fisher is Reducing Data Analysis Times from Days to Minutes with M...
Open-source Infrastructure at Lyft
Puppet Camp Melbourne 2014: Node Collaboration with PuppetDB
Ad

Similar to OGCE TG09 Tech Track Presentation (20)

PPT
OGCE Project Overview
PPT
OGCE TeraGrid 2010 Science Gateway Tutorial Intro
PPTX
Indiana University's Advanced Science Gateway Support
PPT
OGCE SciDAC2010 Tutorial
PDF
Kubernetes - Hosted OSG Services
PPTX
Ogce Workflow Suite
PPT
Computing Outside The Box
PPTX
General Introduction to technologies that will be seen in the school
PPT
OGCE RT Rroject Review
PPT
OGCE Review for Indiana University Research Technologies
PPTX
OGCE SC10
PPTX
Building Science Gateways with Gadgets and OpenSocial
PPTX
PNNL April 2011 ogce
PPTX
TG11 ORPS Poster
PDF
2012 02 pre_hbs_grid_overview_ianstokesrees_pt2
PDF
agINFRA Science Gateway Presentation
PPTX
Science Gateways: one portal, many e-Infrastructures and related services
PDF
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
PPT
A Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
PDF
OGF Introductory Overview - FAS* 2014
OGCE Project Overview
OGCE TeraGrid 2010 Science Gateway Tutorial Intro
Indiana University's Advanced Science Gateway Support
OGCE SciDAC2010 Tutorial
Kubernetes - Hosted OSG Services
Ogce Workflow Suite
Computing Outside The Box
General Introduction to technologies that will be seen in the school
OGCE RT Rroject Review
OGCE Review for Indiana University Research Technologies
OGCE SC10
Building Science Gateways with Gadgets and OpenSocial
PNNL April 2011 ogce
TG11 ORPS Poster
2012 02 pre_hbs_grid_overview_ianstokesrees_pt2
agINFRA Science Gateway Presentation
Science Gateways: one portal, many e-Infrastructures and related services
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
A Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
OGF Introductory Overview - FAS* 2014
Ad

More from marpierc (11)

PPTX
Scientific
PPTX
IWSG2014: Developing Science Gateways Using Apache Airavata
PPTX
XSEDE14 SciGaP-Apache Airavata Tutorial
PPTX
Sgg crest-presentation-final
PPTX
ACES QuakeSim 2011
PPTX
GCE11 Apache Rave Presentation
PPTX
SC11 Science Gateway Group Overview
PPTX
Experiences with the Apache Software Foundation
PPTX
OREChem Services and Workflows
PPTX
Ogce about-sc10
PPT
GTLAB Overview
Scientific
IWSG2014: Developing Science Gateways Using Apache Airavata
XSEDE14 SciGaP-Apache Airavata Tutorial
Sgg crest-presentation-final
ACES QuakeSim 2011
GCE11 Apache Rave Presentation
SC11 Science Gateway Group Overview
Experiences with the Apache Software Foundation
OREChem Services and Workflows
Ogce about-sc10
GTLAB Overview

Recently uploaded (20)

PPTX
International Football (International football is a type of soccer in which n...
DOCX
NFL Madrid Dolphins Scramble for Reinforcements.docx
PDF
Best All-Access Digital Pass me .... pdf
PDF
Understanding Volunteering_ A Look at Its True Meaning by David Bennett Gallo...
DOCX
NFL Dublin Addison Returns Home To Haunt Pittsburgh.docx
DOCX
FA Cup Final 2026 Siring: Arne Slot Crit
DOCX
NFL Dublin Addison Fuels Steelers-Vikings Showdown.docx
DOCX
FIFA World Cup Semi Final The Battle for Global Supremacy.docx
PPTX
Sports Writing by SHS Teacher Roel A. Naza
PPTX
Best All-Access Digital Pass me .pptxxxx
PDF
How Teams Compete to Find Sponsors for Their Jerseys
PDF
FIFA World Cup Scaloni Hopeful for Messi’s FIFA World Cup 2026 Participation.pdf
DOCX
From Playgrounds to Pitches Empowering the Next Generation.docx
PPT
Aboriginals Achievements in Society and Community Development
PPTX
BADMINTON-2ND-WEEK-FUNDAMENTAL-SKILLS.pptx
DOCX
NFL Dublin Vikings Turn to Speed with Tai Felton.docx
PDF
Download GTA 5 For PC (Windows 7, 10, 11)
PPTX
Performance Analytics in the field of sports.pptx
DOCX
How FIFA 2026 Is Changing Vancouver Before Kickoff.docx
PDF
BOOK MUAYTHAI THAI FIGHT ALEXANDRE BRECK
International Football (International football is a type of soccer in which n...
NFL Madrid Dolphins Scramble for Reinforcements.docx
Best All-Access Digital Pass me .... pdf
Understanding Volunteering_ A Look at Its True Meaning by David Bennett Gallo...
NFL Dublin Addison Returns Home To Haunt Pittsburgh.docx
FA Cup Final 2026 Siring: Arne Slot Crit
NFL Dublin Addison Fuels Steelers-Vikings Showdown.docx
FIFA World Cup Semi Final The Battle for Global Supremacy.docx
Sports Writing by SHS Teacher Roel A. Naza
Best All-Access Digital Pass me .pptxxxx
How Teams Compete to Find Sponsors for Their Jerseys
FIFA World Cup Scaloni Hopeful for Messi’s FIFA World Cup 2026 Participation.pdf
From Playgrounds to Pitches Empowering the Next Generation.docx
Aboriginals Achievements in Society and Community Development
BADMINTON-2ND-WEEK-FUNDAMENTAL-SKILLS.pptx
NFL Dublin Vikings Turn to Speed with Tai Felton.docx
Download GTA 5 For PC (Windows 7, 10, 11)
Performance Analytics in the field of sports.pptx
How FIFA 2026 Is Changing Vancouver Before Kickoff.docx
BOOK MUAYTHAI THAI FIGHT ALEXANDRE BRECK

OGCE TG09 Tech Track Presentation

  • 1. OGCE Overview: Portals, Services, Workflows, Gadgets, and TagsMarlon Pierce (IU), Suresh Marru (IU), Raminder Singh (IU), ChathuraHerath (IU), Gregor von Laszewski (RIT), Fungang Wang (RIT), Mary Thomas (SDSU), Nancy Wilkins-Diehr (SDSC), Jeff Sale (SDSC), MaytalDahan (TACC), Rion Dooley (TACC), and Wenjun Wu (UC)Funding: NSF SDCI, TeraGrid RP and GIG (synergistic)
  • 2. Links for More Information Website: http://www.collab-ogce.orgNews/RSS/Blog: http://collab-ogce.blogspot.comEmail: discuss@ogce.orgSVN Code Repository: http://ogce.svn.sourceforge.net/viewvc/ogce/And get tar.gz’sSource Forge: http://sourceforge.net/projects/ogce
  • 4. OGCE and Gateways We develop and package software for use by TeraGrid Science Gateways and other resources
  • 5. BioVLAB use OGCE tools to run on Amazon
  • 6. A lot of this comes from active Gateways.
  • 7. Information Services (GPIR, QBETS): TeraGrid User Portal
  • 9. Resource Discovery Service, File Browser Applet: TGUP, GridChem
  • 10. Gadgets, Open Social Containers: SIDGrid, OLSG
  • 11. We contribute codes back to these projects. GatewaysOGCESoftware
  • 12. Grid Portal SoftwareJava-basedCode managed by Source Forge SVN. Get it by anonymous SVN checkoutDownload the Tar: http://ogce.svn.sourceforge.net/viewvc/ogce/tags/ogce-portal-only-2.5-release.tar.gzOne-line build: mvn clean install.Download has everything you need except Java.
  • 13. File browser front end from OGCE portal download
  • 15. LEAD: A Weather Forecasting WorkflowWRF-Static running on TungstenOGCE Workflow Tutorial
  • 16. Nightly builds on 14 linux, Mac PPC, and Mac X86
  • 18. Some OGCE ServicesInformation Web Services and build framework
  • 19. Resource Discovery ServiceExtracted from the TeraGrid User PortalContributed by Rion Dooley, TACCAxis2 Web serviceIntegrates information from INCA, GPIR services.What machines are in my GridWhich ones are actually running?Works with TeraGrid deployed services, but you can use it with your own information service installations.
  • 20. Resource Prediction Service (RPS)Predicts an optimal set of resources for running scientific applications
  • 21. Predicts a set of resources on which the sum of data transfer time, queue wait time and compute time for the application will be minimum
  • 22. Data transfer time: Uses input data size and NWS info
  • 23. Queue wait time: Uses QBETS info
  • 24. Compute time: Uses application performance info
  • 25. Axis2 web service with a MySQL backend
  • 26. RPS is a subset of the Fault Tolerance and Recovery service used in LEAD and VGrADSPackaging ServicesEverything builds with one commandmvn clean installWe use Apache Maven 2 for builds.Structured, modular builds and consistent layoutsBuild a single module: mvn clean install –fsomemod/pom.xmlWe include Apache Tomcat in the download, so all you need is Java and MySQL.Suitable also for the NMI build and test system.Want the Javadoc? mvnjavadoc:javadoc
  • 27. Upcoming ServicesXMC-CAT metadata cataloging service with JSDL sample implementation.Swarm Web Service for mass job submission and management.http://escience2008.iu.edu/sessions/SWARM.shtmlGPIR Web Service for information on your Grid. This is being repackaged; older packaged version (but same code) is already available.GFAC and XRegistry services Available now using XSUL Web service engine
  • 30. OGCE Strategies for Web 2.0Java COG --> JavaScript COG (Cyberaide)JavaScript can be integrated with many different frameworks: PHP, JSP, JSF, RoR, etcIntegration with JSON-REST style services.Enable mashups, integrate with Jquery, etc.Portlets--> Google and Open Social GadgetsJSR 168 Containers-->Open Social ContainersOrkut, LinkedIn, MySpace, etcApache Shindig, Sakai 3, other open sourceWeb Services --> REST Services
  • 31. AuthenticationHow to authenticate through the Cyberaide JavaScript API?// construct an authenticator object for authentication// using myproxy// make sure to use the attributes keys specified here.var auth = org.cyberaide.js.jsAuthenticator(url);auth.setAttribute("host", "myproxy.teragrid.org");auth.setAttribute("port", 7512);auth.setAttribute("user", ’YOURTGUSERNAME');auth.setAttribute("password", ’YOURPASSWORD');// currently only 'myproxy' is supportedauth.setProvider("myproxy");http://cyberaide.org at Rochester Institute of Technology
  • 32. Cyberaide JavaScript API SummaryAuthenticationJob and Workflow SubmissionJob MonitoringFile management Listing, upload, download, third party transfer, etc.Graphical components
  • 33. Example OGCE Google Gadgets: MOAB dashboard, remote directory browser, and proxy management. Built with GTLAB.
  • 34. TeraGrid Gadgets using the OpenSocial APIshttp://www.google.com/ig/directorySix teragrid gadgets have been publishedSlide courtesy of Wenjun Wu and Thomas Uram
  • 35. TeraGrid Gadgets on iGoogleSearch for “TeraGrid” in iGoogle Gadget Directory
  • 36. Add two TeraGrid gadgets here
  • 37. Open Life Sciences Gateway gadgetsSlide courtesy of Wenjun Wu and Thomas Uram
  • 38. Pilot Open Social Project: SIDGridGadget Container Integration (W.Wu)Built on top of Shindig
  • 40. Container-Gadget JSON-RPC CommunicationTeraGrid REST Information ServicesSlide courtesy of Rion Dooley
  • 41. Putting It All Back TogetherTime to put it all together again.Working Grid gadgets and mash-up examples.Running in an open social containerCoupled with Axis and REST information servicesContinued support for workflowsExpect this at SC09