SlideShare a Scribd company logo
LSST 2017 Project & Community Workshop
DM/Community Interaction Strategy
Mario Juric <mjuric@astro.washington.edu>
August 14th, 2017.
The Need for Community Interaction (1/2)
• After decades of R&D and years of construction, the LSST is almost here!
• We need to spread the word on what LSST data and services will look like, and
prepare the community to make the best use of them.
2LSST2017 - Tucson, AZ - August 14 - 18, 2017
The Need for Community Interaction (2/2)
• Much of LSST design is frozen at this point (telescope, camera, filters, etc.).
• Two elements where some flexibility remains is deployment (cadence), and
data management (flavors and details of data products and services).
3LSST2017 - Tucson, AZ - August 14 - 18, 2017
Data Management
• DM Mission: “Stand up
operable, maintainable, quality
services to deliver high-quality
LSST data products for science
and education, all on time and
within reasonable cost.”
(http://ls.st/ldm-294)
4LSST2017 - Tucson, AZ - August 14 - 18, 2017
← Data Products
(http://ls.st/dpdd)
(http://ls.st/lsp)
Access and analysis
services →
Data Management
Rephrased to a scientist’s point of view:
1. Understand what data products and
services would maximally enable
LSST science, within budget and
schedule constraints.
2. Design and build a system
delivering those.
3. Communicate the designs, receive
feedback, act on it.
5LSST2017 - Tucson, AZ - August 14 - 18, 2017
← Data Products
(http://ls.st/dpdd)
(http://ls.st/lsp)
Access and analysis
services →
Organization of DM-Comm’ty Interactions
• In Data Management, the System Science Team serves as the interface
between the stakeholders (the community) and the Engineering team.
• LSST Science Collaborations are our proxy for the overall community.
DM System
Science Team
DM
Engineering
Team
Community
LSST2017 - Tucson, AZ - August 14 - 18, 2017
DM System Science Team
7
From http://ls.st/sst o, http://ls.st/LDM-294)
LSST2017 - Tucson, AZ - August 14 - 18, 2017
Juric Graham Slater Bellm Bosch Wood-VaseyDubois-Felsmann Gruendl Lupton
Average effort ~0.5 FTE
Krughoff
Typical Communication Modes
“Consult”: Resolve
remaining design and
requirements questions
Example: Current baseline
for DIAObject catalogs calls
for the computation of
features to enable training
of ML classifiers; need to
understand which features
to use. Will use the TVS SC
as a vehicle to understand
the options.
8LSST2017 - Tucson, AZ - August 14 - 18, 2017
“Inform”: Keep the
community apprised of LSST
DM Status and Plans
Example: Presented the LSST
Science Platform to the SC
Chairs
Example: Presentation to
the Solar System SC on the
status and plans for MOPS
(August 9th 2017)
“Teach”: Communicate
what LSST will deliver (and
receive feedback)
Example: Held a 2-day
workshop with the UK SWG
in April 2016.
Points of Contact
• Community: We use the LSST Science Collaborations as a proxy for the overall
community. Advantages:
• Leverages SC organization; communicate/organize through the Chair, rather
than individually with members
• Note: some special considerations for int’l contributors’ communities (e.g.,
Chile, UK, France)
• DM: Designated Points of Contact (liaisons)
• Every SC has (or will have) a member of the DM SST who designated as their
liaison.
• These PoCs work with SC chairs satisfy both DM and SC needs.
• They’re meant to be generally “plugged in” to collaboration work and plans,
so they can identify and advise both the Project and the SCs on potential
issues.
9LSST2017 - Tucson, AZ - August 14 - 18, 2017
Primary Communication Channels
Meetings, Conferences,
Workshops
Opportunity to reach large
audiences at once. Reaches
broad communities.
Example: Chilean LSST
Science workshop,
December 2016. French LSST
Science Workshop, June
1027. DPS Town-Hall
meetings.
10LSST2017 - Tucson, AZ - August 14 - 18, 2017
Collaboration Telecons (incl.
SWG telecons)
Opportunity to keep the SC
appraised of DM progress &
understand SC plans.
Example: Attending DESC
leadership telecons.
Mailing lists and
community.lsst.org
General discussion venue.
Example: Discussions on
(various) DESC mailing lists
on LSST plans for
photometric redshifts.
+ a well organized and maintained website
SS
T
PoC (or
DMSS)
Po
C
Issues and Work in Progress
• DM is still implementing all aspects. Not all liaisons have been named,
or they haven’t started attending collaboration telecons. Delayed by the
DM replan work, but hope to finish this fall.
• Some aspects still missing, a website being a key one (next slide).
• Need to better differentiate between different communities, and
appropriately use communication tools we have available (see following
slides)
• Resources remain an issue; it’s (too) easy to neglect communication.
11LSST2017 - Tucson, AZ - August 14 - 18, 2017
Thinking Ahead: LSST Data Website
• Our lsst.org website is largely aimed towards the general
science-oriented public
• To complete the DM communication structure, we’d
benefit from a science products-oriented one
• http://dm.lsst.org (though currently too software
oriented; see next slide)
• Place to learn about the planned data products
and services
• Links to existing simulated products, prototype
services
• Place to learn about DM development plans and
progress
• Place to learn about Community interaction
mechanisms and tools (points of contact, tools,
etc.)
• Data-related publications, presentations
• Analogous to what other missions have deployed by their
“data processing” arms (e.g., WFIRST). Natural path
towards the LSST Archive website in operations.
• Not clear we have the resources to maintain it; should try.
12LSST2017 - Tucson, AZ - August 14 - 18, 2017
IPAC WFIRST website: a possible model for making project
information better discoverable by the community.
Thinking Ahead: LSST Community vs. LSST Stack Community
• We’re beginning to distinguish between the “LSST Community” and the ”LSST Stack Community”.
• 1. LSST Community: the community of scientists interested in using LSST data and services
for research.
• 2. LSST Stack Community: the community of people interested in running or modifying the
LSST processing software.
• The two overlap, but have (sometimes significantly) different expectations or needs.
• The former is likely to be significantly larger.
• E.g., compare the number of people who have used SDSS data, vs. who have run Photo.
• We’ve so far put the emphasis on supporting community #2. This had the effect of sometimes
confusing or giving the wrong impression to community #1.
• E.g., a typical LSST user will not be expected to use the LSST stack or reduce the data themselves.
Most users shouldn’t be trying to build it.
• We haven’t yet offered LSST-like simulated datasets, emphasized data model documentation,
broadly offered LSST-reprocessed data, and similar products. These may be more interesting to
community #1.
• We need to support both communities, with appropriate mechanisms.
13LSST2017 - Tucson, AZ - August 14 - 18, 2017
Summary
• DM is putting into place an organized community interaction
effort, in order to fulfill the Construction mandate to deliver data
products and services the community needs, within budget and
schedule constraints.
• The effort is led by the DM System Science Team, centered
around designated liaisons, with Science Collaborations serving as
an organized proxy for the overall community.
• Not all aspects have been established yet (e.g., website) as
resources remain an issue, but progress is being made.
14LSST2017 - Tucson, AZ - August 14 - 18, 2017
Backups
15LSST2017 - Tucson, AZ - August 14 - 18, 2017
How should this work in practice
• The collaboration chairs have monthly meetings with the PST; a chance to discuss
high-level issues (this is broader than just DM)
• The Chairs pass this information to the collaborations
• DM Liaisons will attend regular collaboration telecons. A chance to connect on a
weekly or fortnightly basis.
• This will not be a one-size-fits all arrangement; all collaborations are subtly
different (some require more than one liaison, depending on DM needs)
• We are looking into establishing (at least) a quarterly “DM status update” calls with
each science collaboration. The Solar System SC meeting last week may be a good
model.
• A chance for any collaboration member to be kept appraised of DM progress
16LSST2017 - Tucson, AZ - August 14 - 18, 2017
Supporting Contributions to DM Software
• Most LSST DM software is open source and available on github
• For those interested in trying the LSST codes (as well as our own developers),
we’ve made extensive documentation available on how to install and run it.
For example:
• http://developer.lsst.io
• http://pipelines.lsst.io
• We’re open to community interaction and contributions to the LSST software,
with a number of mechanisms to enable these:
• Bug reports and contributions: Github Issues
• StackOverflow-like message board: http://community.lsst.org
• Real-time chat: Slack
17LSST2017 - Tucson, AZ - August 14 - 18, 2017

More Related Content

PPTX
Moving to an open world
PDF
Business case for_change_jisc_lm_schange_wkshop_ken_chad_july2013
PDF
Franck Rebillard, Professeur Université Paris 3
PPTX
Factors influencing research data management programs.
PPT
Cosi Usage Data
PDF
Desired Outcomes for Libraries+ Network May Meeting
PDF
ARCC National Perspective Panel: XSEDE (Towns)
PPTX
The role of an RDM toolkit in existing workflows
Moving to an open world
Business case for_change_jisc_lm_schange_wkshop_ken_chad_july2013
Franck Rebillard, Professeur Université Paris 3
Factors influencing research data management programs.
Cosi Usage Data
Desired Outcomes for Libraries+ Network May Meeting
ARCC National Perspective Panel: XSEDE (Towns)
The role of an RDM toolkit in existing workflows

Similar to LSST DM/Community Interaction Strategy (20)

PDF
XSEDE National Cyberinfrastructure, NIST, and Supporting NCSI Objectives
PPTX
Standard Safeguarding Dataset - overview for CSCDUG.pptx
PDF
HPC I/O for Computational Scientists
PPTX
What to Expect of the LSST Archive: The LSST Science Platform
PDF
UCT eResearch Emerging Researcher Series: RDM
PDF
Social Computing Research with Apache Spark
PPTX
Mapping presentation THAG big data from space
PDF
IEEE Big data 2016 Title and Abstract
PDF
Survey on Location Based Recommendation System Using POI
PDF
Open Data is not Enough
PDF
XSEDE: an ecosystem of advanced digital services accelerating scientific disc...
PPTX
Rubrics for DMPs
PPTX
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...
PDF
Overview of XSEDE and Introduction to XSEDE 2.0 and Beyond
PPTX
Round Table Introduction: From an institution-developed package to a sustaina...
DOCX
Local plans alpha - weeknotes w/e 10 April
PDF
The web of data: how are we doing so far?
PPTX
Lauren Michael: The Missing Millions Democratizing Computation and Data ...
PPT
Edinburgh DataShare: Tackling research data in a DSpace institutional repository
PDF
Data ecosystems: turning data into public value
XSEDE National Cyberinfrastructure, NIST, and Supporting NCSI Objectives
Standard Safeguarding Dataset - overview for CSCDUG.pptx
HPC I/O for Computational Scientists
What to Expect of the LSST Archive: The LSST Science Platform
UCT eResearch Emerging Researcher Series: RDM
Social Computing Research with Apache Spark
Mapping presentation THAG big data from space
IEEE Big data 2016 Title and Abstract
Survey on Location Based Recommendation System Using POI
Open Data is not Enough
XSEDE: an ecosystem of advanced digital services accelerating scientific disc...
Rubrics for DMPs
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...
Overview of XSEDE and Introduction to XSEDE 2.0 and Beyond
Round Table Introduction: From an institution-developed package to a sustaina...
Local plans alpha - weeknotes w/e 10 April
The web of data: how are we doing so far?
Lauren Michael: The Missing Millions Democratizing Computation and Data ...
Edinburgh DataShare: Tackling research data in a DSpace institutional repository
Data ecosystems: turning data into public value
Ad

More from Mario Juric (7)

PPTX
Round Table Introduction: Analytics on 100 TB+ catalogs
PPTX
Solar System Processing with LSST: A Status Update
PPTX
LSST Solar System Science: MOPS Status, the Science, and Your Questions
PPTX
ADASS XXV: LSST DM - Building the Data System for the Era of Petascale Optica...
PPTX
AstroInformatics 2015: Large Sky Surveys: Entering the Era of Software-Bound ...
PDF
LSST/DM: Building a Next Generation Survey Data Processing System
PDF
GaiaCal2014: Creating and Calibrating LSST Data Product
Round Table Introduction: Analytics on 100 TB+ catalogs
Solar System Processing with LSST: A Status Update
LSST Solar System Science: MOPS Status, the Science, and Your Questions
ADASS XXV: LSST DM - Building the Data System for the Era of Petascale Optica...
AstroInformatics 2015: Large Sky Surveys: Entering the Era of Software-Bound ...
LSST/DM: Building a Next Generation Survey Data Processing System
GaiaCal2014: Creating and Calibrating LSST Data Product
Ad

Recently uploaded (20)

PDF
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
PPTX
ap-psych-ch-1-introduction-to-psychology-presentation.pptx
PPTX
BIOMOLECULES PPT........................
PDF
Placing the Near-Earth Object Impact Probability in Context
PDF
Communicating Health Policies to Diverse Populations (www.kiu.ac.ug)
PPTX
A powerpoint on colorectal cancer with brief background
PDF
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
PDF
Warm, water-depleted rocky exoplanets with surfaceionic liquids: A proposed c...
PPTX
Hypertension_Training_materials_English_2024[1] (1).pptx
PPTX
Seminar Hypertension and Kidney diseases.pptx
PPTX
BODY FLUIDS AND CIRCULATION class 11 .pptx
PPTX
TORCH INFECTIONS in pregnancy with toxoplasma
PPTX
Understanding the Circulatory System……..
PPT
Animal tissues, epithelial, muscle, connective, nervous tissue
PPT
LEC Synthetic Biology and its application.ppt
PPT
Heredity-grade-9 Heredity-grade-9. Heredity-grade-9.
PPTX
Lesson-1-Introduction-to-the-Study-of-Chemistry.pptx
PDF
BET Eukaryotic signal Transduction BET Eukaryotic signal Transduction.pdf
PPT
THE CELL THEORY AND ITS FUNDAMENTALS AND USE
PDF
Looking into the jet cone of the neutrino-associated very high-energy blazar ...
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
ap-psych-ch-1-introduction-to-psychology-presentation.pptx
BIOMOLECULES PPT........................
Placing the Near-Earth Object Impact Probability in Context
Communicating Health Policies to Diverse Populations (www.kiu.ac.ug)
A powerpoint on colorectal cancer with brief background
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
Warm, water-depleted rocky exoplanets with surfaceionic liquids: A proposed c...
Hypertension_Training_materials_English_2024[1] (1).pptx
Seminar Hypertension and Kidney diseases.pptx
BODY FLUIDS AND CIRCULATION class 11 .pptx
TORCH INFECTIONS in pregnancy with toxoplasma
Understanding the Circulatory System……..
Animal tissues, epithelial, muscle, connective, nervous tissue
LEC Synthetic Biology and its application.ppt
Heredity-grade-9 Heredity-grade-9. Heredity-grade-9.
Lesson-1-Introduction-to-the-Study-of-Chemistry.pptx
BET Eukaryotic signal Transduction BET Eukaryotic signal Transduction.pdf
THE CELL THEORY AND ITS FUNDAMENTALS AND USE
Looking into the jet cone of the neutrino-associated very high-energy blazar ...

LSST DM/Community Interaction Strategy

  • 1. LSST 2017 Project & Community Workshop DM/Community Interaction Strategy Mario Juric <mjuric@astro.washington.edu> August 14th, 2017.
  • 2. The Need for Community Interaction (1/2) • After decades of R&D and years of construction, the LSST is almost here! • We need to spread the word on what LSST data and services will look like, and prepare the community to make the best use of them. 2LSST2017 - Tucson, AZ - August 14 - 18, 2017
  • 3. The Need for Community Interaction (2/2) • Much of LSST design is frozen at this point (telescope, camera, filters, etc.). • Two elements where some flexibility remains is deployment (cadence), and data management (flavors and details of data products and services). 3LSST2017 - Tucson, AZ - August 14 - 18, 2017
  • 4. Data Management • DM Mission: “Stand up operable, maintainable, quality services to deliver high-quality LSST data products for science and education, all on time and within reasonable cost.” (http://ls.st/ldm-294) 4LSST2017 - Tucson, AZ - August 14 - 18, 2017 ← Data Products (http://ls.st/dpdd) (http://ls.st/lsp) Access and analysis services →
  • 5. Data Management Rephrased to a scientist’s point of view: 1. Understand what data products and services would maximally enable LSST science, within budget and schedule constraints. 2. Design and build a system delivering those. 3. Communicate the designs, receive feedback, act on it. 5LSST2017 - Tucson, AZ - August 14 - 18, 2017 ← Data Products (http://ls.st/dpdd) (http://ls.st/lsp) Access and analysis services →
  • 6. Organization of DM-Comm’ty Interactions • In Data Management, the System Science Team serves as the interface between the stakeholders (the community) and the Engineering team. • LSST Science Collaborations are our proxy for the overall community. DM System Science Team DM Engineering Team Community LSST2017 - Tucson, AZ - August 14 - 18, 2017
  • 7. DM System Science Team 7 From http://ls.st/sst o, http://ls.st/LDM-294) LSST2017 - Tucson, AZ - August 14 - 18, 2017 Juric Graham Slater Bellm Bosch Wood-VaseyDubois-Felsmann Gruendl Lupton Average effort ~0.5 FTE Krughoff
  • 8. Typical Communication Modes “Consult”: Resolve remaining design and requirements questions Example: Current baseline for DIAObject catalogs calls for the computation of features to enable training of ML classifiers; need to understand which features to use. Will use the TVS SC as a vehicle to understand the options. 8LSST2017 - Tucson, AZ - August 14 - 18, 2017 “Inform”: Keep the community apprised of LSST DM Status and Plans Example: Presented the LSST Science Platform to the SC Chairs Example: Presentation to the Solar System SC on the status and plans for MOPS (August 9th 2017) “Teach”: Communicate what LSST will deliver (and receive feedback) Example: Held a 2-day workshop with the UK SWG in April 2016.
  • 9. Points of Contact • Community: We use the LSST Science Collaborations as a proxy for the overall community. Advantages: • Leverages SC organization; communicate/organize through the Chair, rather than individually with members • Note: some special considerations for int’l contributors’ communities (e.g., Chile, UK, France) • DM: Designated Points of Contact (liaisons) • Every SC has (or will have) a member of the DM SST who designated as their liaison. • These PoCs work with SC chairs satisfy both DM and SC needs. • They’re meant to be generally “plugged in” to collaboration work and plans, so they can identify and advise both the Project and the SCs on potential issues. 9LSST2017 - Tucson, AZ - August 14 - 18, 2017
  • 10. Primary Communication Channels Meetings, Conferences, Workshops Opportunity to reach large audiences at once. Reaches broad communities. Example: Chilean LSST Science workshop, December 2016. French LSST Science Workshop, June 1027. DPS Town-Hall meetings. 10LSST2017 - Tucson, AZ - August 14 - 18, 2017 Collaboration Telecons (incl. SWG telecons) Opportunity to keep the SC appraised of DM progress & understand SC plans. Example: Attending DESC leadership telecons. Mailing lists and community.lsst.org General discussion venue. Example: Discussions on (various) DESC mailing lists on LSST plans for photometric redshifts. + a well organized and maintained website SS T PoC (or DMSS) Po C
  • 11. Issues and Work in Progress • DM is still implementing all aspects. Not all liaisons have been named, or they haven’t started attending collaboration telecons. Delayed by the DM replan work, but hope to finish this fall. • Some aspects still missing, a website being a key one (next slide). • Need to better differentiate between different communities, and appropriately use communication tools we have available (see following slides) • Resources remain an issue; it’s (too) easy to neglect communication. 11LSST2017 - Tucson, AZ - August 14 - 18, 2017
  • 12. Thinking Ahead: LSST Data Website • Our lsst.org website is largely aimed towards the general science-oriented public • To complete the DM communication structure, we’d benefit from a science products-oriented one • http://dm.lsst.org (though currently too software oriented; see next slide) • Place to learn about the planned data products and services • Links to existing simulated products, prototype services • Place to learn about DM development plans and progress • Place to learn about Community interaction mechanisms and tools (points of contact, tools, etc.) • Data-related publications, presentations • Analogous to what other missions have deployed by their “data processing” arms (e.g., WFIRST). Natural path towards the LSST Archive website in operations. • Not clear we have the resources to maintain it; should try. 12LSST2017 - Tucson, AZ - August 14 - 18, 2017 IPAC WFIRST website: a possible model for making project information better discoverable by the community.
  • 13. Thinking Ahead: LSST Community vs. LSST Stack Community • We’re beginning to distinguish between the “LSST Community” and the ”LSST Stack Community”. • 1. LSST Community: the community of scientists interested in using LSST data and services for research. • 2. LSST Stack Community: the community of people interested in running or modifying the LSST processing software. • The two overlap, but have (sometimes significantly) different expectations or needs. • The former is likely to be significantly larger. • E.g., compare the number of people who have used SDSS data, vs. who have run Photo. • We’ve so far put the emphasis on supporting community #2. This had the effect of sometimes confusing or giving the wrong impression to community #1. • E.g., a typical LSST user will not be expected to use the LSST stack or reduce the data themselves. Most users shouldn’t be trying to build it. • We haven’t yet offered LSST-like simulated datasets, emphasized data model documentation, broadly offered LSST-reprocessed data, and similar products. These may be more interesting to community #1. • We need to support both communities, with appropriate mechanisms. 13LSST2017 - Tucson, AZ - August 14 - 18, 2017
  • 14. Summary • DM is putting into place an organized community interaction effort, in order to fulfill the Construction mandate to deliver data products and services the community needs, within budget and schedule constraints. • The effort is led by the DM System Science Team, centered around designated liaisons, with Science Collaborations serving as an organized proxy for the overall community. • Not all aspects have been established yet (e.g., website) as resources remain an issue, but progress is being made. 14LSST2017 - Tucson, AZ - August 14 - 18, 2017
  • 15. Backups 15LSST2017 - Tucson, AZ - August 14 - 18, 2017
  • 16. How should this work in practice • The collaboration chairs have monthly meetings with the PST; a chance to discuss high-level issues (this is broader than just DM) • The Chairs pass this information to the collaborations • DM Liaisons will attend regular collaboration telecons. A chance to connect on a weekly or fortnightly basis. • This will not be a one-size-fits all arrangement; all collaborations are subtly different (some require more than one liaison, depending on DM needs) • We are looking into establishing (at least) a quarterly “DM status update” calls with each science collaboration. The Solar System SC meeting last week may be a good model. • A chance for any collaboration member to be kept appraised of DM progress 16LSST2017 - Tucson, AZ - August 14 - 18, 2017
  • 17. Supporting Contributions to DM Software • Most LSST DM software is open source and available on github • For those interested in trying the LSST codes (as well as our own developers), we’ve made extensive documentation available on how to install and run it. For example: • http://developer.lsst.io • http://pipelines.lsst.io • We’re open to community interaction and contributions to the LSST software, with a number of mechanisms to enable these: • Bug reports and contributions: Github Issues • StackOverflow-like message board: http://community.lsst.org • Real-time chat: Slack 17LSST2017 - Tucson, AZ - August 14 - 18, 2017