SC7 Workshop 3: Big Data Europe Project
0 likes403 views
The Big Data Europe project focuses on enhancing mobility management through big data and consists of various stakeholder engagement activities, including workshops and webinars. It has introduced an open-source big data integrator platform to facilitate easy integration and deployment of big data functionalities, aligned with seven European Commission H2020 societal challenges. Future plans include maintaining the platform's independence and conducting workshops on semantics in big data, along with standardization efforts.
SC7 Workshop 3: Big Data Europe Project
- 1. BIG DATA EUROPE PROJECT EMPOWERING MOBILITY MANAGEMENT WITH BIG DATA SC7 Final Workshop03.10.2017
- 2. Stakeholder Engagement & Activities M12M6 M18 M24 M30 Coordination & Support Action 2015-17
- 4. Importance of Volume Importance of Velocity Stakeholder Requirements (1)
- 5. Importance of Variety Efficiency of Data Infrastructures Stakeholder Requirements (II)
- 6. Societal Data Value Chain Requirements
- 8. Watch: big-data-europe.eu/webinar/ 7 Societal Communities Bringing Communities closer o Understanding common challenges & needs o Defining Generic Big Data Architecture Community Activities o Yearly workshops (1 per SC) o Hangouts (SC- specific), Webinars (technical, general) Identifying 7 Pilots, showcase value of BD Platform 16-oct.-17www.big-data-europe.eu
- 9. BDE Integrator Platform Released! Stacks Open Source solutions (Free) Dockerization Facilitates integration and deployment Plug-and-play BD Platform Key BDE additions o Support layer: integrated UI o Semantification layer Final Release: o November 2017 16-oct.-17www.big-data-europe.eu
- 10. BigDataEurope’s 7 Pilots ◎ BigDataEurope Platform Instantiations o Allow end-users to easily deploy functionality in own system environment o Modularized Docker approach - easier to replace components o Reduces effort to keep 3rd party software updated & integrated ◎ 7 Societal Challenge Pilots o Aligned with 7 European Commision H2020 Societal Challenges o Real-world use-cases (Data, Objectives, Solutions) o Some pilots have different data & objectives but a similar solution ◎More info: 16-oct.-17www.big-data-europe.eu www.big-data-europe.eu/pilot/
- 11. 7 Integrator Platform Instances 16-oct.-17www.big-data-europe.eu
- 13. Big Data Platform Open-Source Community o Maintenance of BD components remains independent o Commitment from core BDE consortium team o Maintenance driven by ‘users’ Users include follow-up projects: o BigDataOcean, BETTER, NextGEOSS, Special, … Planned series of ‘Semantics in Big Data’ workshop Standardisation efforts within BDVA 16-oct.-17www.big-data-europe.eu
- 14. Data Protection & Security Engineering & DevOps Standards Data Processing Architectures Data Visualisation and User Interaction Data Analytics Data Management Infrastructure Cloud, Communication (5G), HPC, IoT/CPS BigDataPriorityTechAreas Sectors, Applications, Cross-cutting functions Builds on ForecastingSANSA Ontario Positioning BigDataEurope into BDVA Ref. Model Resource Management Layer (Swarm) Zeppelin Support Layer Init Daemon GUIs Monitor App Layer Forecasting Satellite Image Analysis Platform Layer Spark Flink Semantic Layer Ontario SANSA Semagrow Kafka Real-time Stream Monitoring ... ... Resource Management Layer (Swarm) Hardware Layer Premises Cloud (AWS, GCE, MS Azure, …) Data Layer Hadoop NOSQL Store CassandraElasticsearch ...RDF Store
- 15. Final Project Activities Remaining Final SC workshops Find us at these events! o EBDVF (European Big Data Value Forum), Nov 2017 Booth: Schedule for Pilot demonstrations, Platform demonstration, General info. o ISWC (Intern. Semantic Web Conference), Oct 2017 By Appointment: Platform demonstration, General info. Energy 28 November Amsterdam Colocated with WindEurope Conference’17 Climate 6-7 November Brussels Co-organised with JRC-Ispra Health Nov-Dec t.b.a Brussels Independent Event
- 16. Questions & Contacts www.big-data-europe.eu 16-oct.-17 #BigDataEurope BIG DATA INTEGRATOR www.github.com/big-data-europe PILOT DESCRIPTIONS https://www.big-data-europe.eu/pilot/ PROJECT COORDINATION (Fraunhofer IAIS) Prof. Sören Auer, auer © cs.uni-bonn · de > Dr. Simon Scerri, scerri © cs.uni-bonn · de EIS Department/Group, Fraunhofer IAIS & CS Department Uni-Bonn, Bonn, Germany Input: Requirements, Technical, Standardisation Leads Fraunhofer Big Data Alliance