SC7 Workshop 2: Big Data pilots for Secure Societies
0 likes387 views
The document outlines the European Union Satellite Centre's initiatives in big data, focusing on research, technology development, and innovation to address societal challenges in areas like health, climate, and transportation. It highlights the project's efforts to build a secure societies community, gather user requirements, and implement pilots for a big data platform. Additionally, it discusses the integration of satellite data and the importance of collaboration with various stakeholders and organizations.
SC7 Workshop 2: Big Data pilots for Secure Societies
- 1. UNCLASSIFIED/FOR OFFICIAL USE ONLY UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 Big Data pilots for Secure Societies Sergio Albani Responsible for RTDI
- 2. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 2 RTDI activities at SatCen • Research, Technology Development and Innovation - Fostering cooperation with EC, EU entities and key organisations in Space such as ESA and GEO - Implementing new solutions with regard to the whole data lifecycle on issues related to Big Data and Cloud Computing EVER-EST NextGEOSS
- 3. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 3 • Integrating Big Data, software & communities for addressing Europe’s Societal Challenges - Health, Food, Energy, Transport, Climate, Social Sciences, Secure Societies • BigDataEurope main activities: - Gathering user requirements - Developing a Big Data platform - Implementing relevant pilots • SatCen is: - Building a Secure Societies community - Eliciting Big Data requirements - Implementing a Space and Security pilot The BigDataEurope Project
- 4. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 4 Stakeholders interviews• Building of a Secure Societies Community with an interest in the Big Data issue • Four types of customized questionnaires submitted - Real use cases, data stories and user needs collected - Inputs analyzed looking for commonalities amongst users • 1st Workshop held in Brussels on September 2015 at SOST • Formalized set of user requirements for the design of the system and the pilot deployment defined Collection of User Requirements
- 5. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 5 • Data Chain - To exploit data coming from space (using open data and tools) - To integrate satellite, geospatial and other data - To develop automatic tools for the whole data chain management - Possible applications of Big Data should be mainly related to access, archiving, analysis, visualization and dissemination • Platform Characteristics - Reliable, stable, efficient, time reducing, economically convenient, open source-based, user-friendly, multi-lingual and interoperable - Security compliant, geospatial oriented, Platform as a Service (PaaS), single access, customizable and extensible User Requirements in Secure Societies
- 6. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 6 Dissemination Activities • Technical Webinars - To present inputs from experts responsible for the architecture, the implementation and the upcoming pilots roll-out • Secure Societies Hangouts - To give details on the use of Big Data in the Security domain • Conferences - 2nd Big Data from Space Conference (15-17 March 2016) - Living Planet Symposium (9-13 May 2016) - EO Open Science Conference (12-14 September 2016) - SatCen Expert User Fora
- 7. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 7 The BigDataEurope SC7 Pilot Remote Sensing Big Data Platform Social Sensing Change Detection Workflow Event Detection Workflow
- 8. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 8 • European Virtual Environment for Research – Earth Science Themes - A VRE is a distributed collaborative system facilitating access, processing and sharing of data, algorithms and results • EVER-EST main activities: - Establish a VRE for Earth Science - Validate the VRE with 4 main VRCs - Implement the use of ROs in ES • SatCen is: - Representing the Land Monitoring VRC - Eliciting requirements for the VRE - Implementing a Space and Security pilot The EVER-EST Project
- 9. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 9 The EVER-EST LaMo Pilot Binary Map (changes / no changes) Classified Map (e.g. land cover)
- 10. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 10 • Next Generation GEOSS for Innovation & Business - The Group on Earth Observations is building the Global Earth Observation System of Systems • NextGEOSS main activities: - Engaging EO and related communities - Advocating GEOSS - Delivering a DH for EO data exploitation • SatCen will be: - Engaging with data providers - Liaising with GEO communities/activities - Implementing a Space and Security pilot The NextGEOSS Project NextGEOSS
- 11. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 11 Big Data General User Scenario Data Access Data Selection Data Processing Data Visualization Data Analytics
- 12. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY 12 Preliminary Results and Conclusions • Technical solutions for Big Data exploitation - System to search, download, pre-process and compare images - Social media and news monitoring by a crawling system - Web-GIS client to properly visualise information and results - Solutions to guarantee a better access to open data - Downloaded images storage in a distributed way - Scalability improved with tile-based processing approaches • Big Data and Cloud Computing based solutions can improve the capabilities of the Space and Security community - Foster use of open source technologies and of free/open datasets - Cooperation with ESA, EC and EU entities to be furthered - Results to be exploited in GEO (e.g. through NextGEOSS)
- 13. UNCLASSIFIED / FOR OFFICIAL USE ONLY European Union Satellite Centre © 2016 UNCLASSIFIED/FOR OFFICIAL USE ONLY Sergio Albani Responsible for RTDI sergio.albani@satcen.europa.eu Thank You!