SlideShare a Scribd company logo
Hans Salomonsson
CEO @ EmbeDL
EU-IoT Training Workshops Series:
Next Generation IoT Architectures
8. Nov 2021
VEDLIoT - Toolchain for Efficient Deep
Learning on heterogenous hardware
2
 Research
 Hardware: Scalable, heterogeneous, distributed
 Accelerators: Efficiency boost by FPGA and ASIC technology
 Toolchain: Optimizing Deep Learning for IoT
 Use cases
 Industrial IoT
 Automotive
 Smart Home
 Open call
 At project mid-term
 Early use and evaluation of VEDLIoT technology
Very Efficient Deep Learning IoT – VEDLIoT
 Call: H2020-ICT2020-1
 Topic: ICT-56-2020 Next Generation Internet
of Things
 Duration: 1. November 2020 – 31. Oktober
2023
 Coordinator: Bielefeld University (Germany)
 Consortium: 12 partners from 4 EU countries
(Germany, Poland, Portugal and Sweden) and
one associated country (Switzerland).
More info:
 https://www.vedliot.eu/
 https://twitter.com/VEDLIoT
 https://www.linkedin.com/company/vedliot/
3
Deep Learning IoT Architecture
t.RECS
u.RECS
Edge
RECS|Box
Optimized Deep Learning
Model
(inference)
Cloud
Embedded
4
VEDLIoT Hardware Platform
 Heterogeneous, modular, scalable microserver system
 Supporting the full spectrum of IoT from embedded over the edge towards the cloud
 Different technology concepts for improving
x86
GPU
ML-ASIC
ARM v8
GPU
SoC
FPGA
SoC
RISC-V
FPGA
VEDLIOT Cognitive
IoT Platform
 Performance
 Cost-effectiveness
 Maintainability
 Reliability
 Energy-Efficiency
 Safety
5
Microserver overview
t.RECS
RECS|Box
u.RECS
6
VEDLIoT‘s Deep Learning Toolchain
• Image
Classification
• Object Detection
• Semantic
Segmentation
• Instance
Segmentation
• Extractive
Question
Answering
Model Zoo Optimization
Engine
Compilers &
Runtime APIs
Heterogeneous
Hardware
Platforms
7
Model ZOO
8
Model ZOO
9
Model ZOO
10
Efficent deep learning for IoT
11
1. Optimization Engine
12
3.a Hardware Evaluation
13
3.a Hardware Evaluation
14
1&3 Flexible and adaptable Accelerators for
Deep Learning
DL Model
DL Model
CPU, GPU-
SoC,
ML-SoC
FPGA-SoC
 End of Moore’s law & dark silicon –
Domain Specific Architectures (DSA)
 Efficient, flexible, scalable accelerators for
the compute continuum
 Algotecture
 Optimized DL algorithms
 Optimized toolchain
 Optimized computer architecture
Heterogeneous DL
Accelerator
Algotecture/
Co-Designed DL
Accelerator
Optimizer &
Compiler
Co-Design
15
The fun has just started!
Follow our work!
https://twitter.com/VEDLIoT
https://www.linkedin.com/company/vedliot/
https://vedliot.eu
Be part of it
Open call at project mid-term
Allow early use and evaluation of VEDLIoT
technology
16
Thank you for your
attention.
Me
Hans Salomonsson
EmbeDL, Sweden
hans@embedl.ai
Contact
Jens Hagemeyer, Carola Haumann
Bielefeld University, Germany
chaumann@cor-lab.uni-bielefeld.de
jhagemey@cit-ec.uni-bielefeld.de

More Related Content

PPTX
VEDLIoT at Stockholm Tech Live 2022
PDF
Mainflux Labs - References (1).pdf
PDF
AccML, co-located with HiPEAC 2021_Pedro Trancoso presentation
PDF
Finnish view of industrial internet
PPTX
Horizon 2020 ICT and Advanced Materials & Manufacturing
PDF
InterConnect Project Overview - OPEN DEI 1st Energy Domain Workshop
PDF
VTT Tampere RobotDay 5.9. - Minna Lanz, Trinity Open Calls
PDF
IEEE Education Society: Reshaping the Future of Technology
VEDLIoT at Stockholm Tech Live 2022
Mainflux Labs - References (1).pdf
AccML, co-located with HiPEAC 2021_Pedro Trancoso presentation
Finnish view of industrial internet
Horizon 2020 ICT and Advanced Materials & Manufacturing
InterConnect Project Overview - OPEN DEI 1st Energy Domain Workshop
VTT Tampere RobotDay 5.9. - Minna Lanz, Trinity Open Calls
IEEE Education Society: Reshaping the Future of Technology

Similar to Next Generation IoT Architectures_Hans Salomonsson (20)

PDF
bhide_connected_raleigh2016 (1)
PPTX
2019 04-30 MIDIH for CONFAPI
PPTX
CONASENSE 2022_Jens Hagemeyer presentation
PPT
Sail project presentation 101019
PPTX
IoT Week 2021_Jens Hagemeyer presentation
PDF
I Lab2 I Lab Vision Ws 3 Oct 06 V2
PDF
SmartCLIDE Demo: Cloud Computing for Dummies
PPTX
2019 06-19 EIT Digital industry event
PDF
Midih open call webinar presentation
PDF
IPCEI Cloud - Using European Open-Source Technologies to Build a Sovereign, M...
DOCX
IOT-4 week.docx
PDF
Secure context-awareness in ubiquitous computing
PPTX
Industry 4.0 – the German vision for advanced manufacturing
PPTX
HiPEAC2023-DL4IoT Workshop_Jean Hagemeyer presentation
PDF
FIRE Open Calls - FIRE Forum 2016
PDF
FIRE Open Calls - FIRE Forum 2016
PPTX
EU-IoT Training Workshops Series: AIoT and Edge Machine Learning 2021_Jens Ha...
PDF
DATE 2018
bhide_connected_raleigh2016 (1)
2019 04-30 MIDIH for CONFAPI
CONASENSE 2022_Jens Hagemeyer presentation
Sail project presentation 101019
IoT Week 2021_Jens Hagemeyer presentation
I Lab2 I Lab Vision Ws 3 Oct 06 V2
SmartCLIDE Demo: Cloud Computing for Dummies
2019 06-19 EIT Digital industry event
Midih open call webinar presentation
IPCEI Cloud - Using European Open-Source Technologies to Build a Sovereign, M...
IOT-4 week.docx
Secure context-awareness in ubiquitous computing
Industry 4.0 – the German vision for advanced manufacturing
HiPEAC2023-DL4IoT Workshop_Jean Hagemeyer presentation
FIRE Open Calls - FIRE Forum 2016
FIRE Open Calls - FIRE Forum 2016
EU-IoT Training Workshops Series: AIoT and Edge Machine Learning 2021_Jens Ha...
DATE 2018
Ad

More from VEDLIoT Project (20)

PPTX
IoT Tech Expo 2023_Micha vor dem Berge presentation
PPTX
Computing Frontiers 2023_Pedro Trancoso presentation
PPTX
HiPEAC-CSW 2022_Pedro Trancoso presentation
PPTX
IoT Week 2022-NGIoT session_Micha vor dem Berge presentation
PPTX
NGIoT standardisation workshops_Jens Hagemeyer presentation
PPTX
IoT Tech Expo 2023_Pedro Trancoso presentation
PPTX
HiPEAC-CSW 2022_Kevin Mika presentation
PPTX
HiPEAC 2022-DL4IoT workshop_René Griessl presentation
PPTX
SS-CPSIoT 2023_Kevin Mika and Piotr Zierhoffer presentation
PPTX
HiPEAC 2022_Marcelo Pasin presentation
PPTX
IoT Tech Expo 2023_Marcelo Pasin presentation
PPTX
IoT Tech Expo 2023_Hans-Martin Heyn presentation
PPTX
HiPEAC 2022_Marco Tassemeier presentation
PPTX
HiPEAC Computing Systems Week 2022_Mario Porrmann presentation
PPTX
HiPEAC2022_António Casimiro presentation
PPTX
NGIoT Sustainability Workshop 2023_ Hans-Martin Heyn presentation
PPTX
NGIoT Sustainability Workshop 2023_Rene Griessl presentation
PPTX
HiPEAC2022-DL4IoT workshop_ Muhammad Waqar Azhar
PPTX
VEDLIoT at FPL'23_Accelerators for Heterogenous Computing in AIoT
PPTX
Industrial Pioneers Days - Machine Learning
IoT Tech Expo 2023_Micha vor dem Berge presentation
Computing Frontiers 2023_Pedro Trancoso presentation
HiPEAC-CSW 2022_Pedro Trancoso presentation
IoT Week 2022-NGIoT session_Micha vor dem Berge presentation
NGIoT standardisation workshops_Jens Hagemeyer presentation
IoT Tech Expo 2023_Pedro Trancoso presentation
HiPEAC-CSW 2022_Kevin Mika presentation
HiPEAC 2022-DL4IoT workshop_René Griessl presentation
SS-CPSIoT 2023_Kevin Mika and Piotr Zierhoffer presentation
HiPEAC 2022_Marcelo Pasin presentation
IoT Tech Expo 2023_Marcelo Pasin presentation
IoT Tech Expo 2023_Hans-Martin Heyn presentation
HiPEAC 2022_Marco Tassemeier presentation
HiPEAC Computing Systems Week 2022_Mario Porrmann presentation
HiPEAC2022_António Casimiro presentation
NGIoT Sustainability Workshop 2023_ Hans-Martin Heyn presentation
NGIoT Sustainability Workshop 2023_Rene Griessl presentation
HiPEAC2022-DL4IoT workshop_ Muhammad Waqar Azhar
VEDLIoT at FPL'23_Accelerators for Heterogenous Computing in AIoT
Industrial Pioneers Days - Machine Learning
Ad

Recently uploaded (20)

PDF
VARICELLA VACCINATION: A POTENTIAL STRATEGY FOR PREVENTING MULTIPLE SCLEROSIS
PPTX
2. Earth - The Living Planet earth and life
PPTX
TOTAL hIP ARTHROPLASTY Presentation.pptx
DOCX
Q1_LE_Mathematics 8_Lesson 5_Week 5.docx
PPTX
DRUG THERAPY FOR SHOCK gjjjgfhhhhh.pptx.
PDF
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
PDF
Sciences of Europe No 170 (2025)
PDF
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
PDF
bbec55_b34400a7914c42429908233dbd381773.pdf
PPTX
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...
PDF
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
PDF
AlphaEarth Foundations and the Satellite Embedding dataset
PPT
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
PDF
HPLC-PPT.docx high performance liquid chromatography
PPTX
GEN. BIO 1 - CELL TYPES & CELL MODIFICATIONS
PDF
The scientific heritage No 166 (166) (2025)
PDF
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
PDF
An interstellar mission to test astrophysical black holes
PPTX
Vitamins & Minerals: Complete Guide to Functions, Food Sources, Deficiency Si...
PPTX
G5Q1W8 PPT SCIENCE.pptx 2025-2026 GRADE 5
VARICELLA VACCINATION: A POTENTIAL STRATEGY FOR PREVENTING MULTIPLE SCLEROSIS
2. Earth - The Living Planet earth and life
TOTAL hIP ARTHROPLASTY Presentation.pptx
Q1_LE_Mathematics 8_Lesson 5_Week 5.docx
DRUG THERAPY FOR SHOCK gjjjgfhhhhh.pptx.
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
Sciences of Europe No 170 (2025)
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
bbec55_b34400a7914c42429908233dbd381773.pdf
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
AlphaEarth Foundations and the Satellite Embedding dataset
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
HPLC-PPT.docx high performance liquid chromatography
GEN. BIO 1 - CELL TYPES & CELL MODIFICATIONS
The scientific heritage No 166 (166) (2025)
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
An interstellar mission to test astrophysical black holes
Vitamins & Minerals: Complete Guide to Functions, Food Sources, Deficiency Si...
G5Q1W8 PPT SCIENCE.pptx 2025-2026 GRADE 5

Next Generation IoT Architectures_Hans Salomonsson

  • 1. Hans Salomonsson CEO @ EmbeDL EU-IoT Training Workshops Series: Next Generation IoT Architectures 8. Nov 2021 VEDLIoT - Toolchain for Efficient Deep Learning on heterogenous hardware
  • 2. 2  Research  Hardware: Scalable, heterogeneous, distributed  Accelerators: Efficiency boost by FPGA and ASIC technology  Toolchain: Optimizing Deep Learning for IoT  Use cases  Industrial IoT  Automotive  Smart Home  Open call  At project mid-term  Early use and evaluation of VEDLIoT technology Very Efficient Deep Learning IoT – VEDLIoT  Call: H2020-ICT2020-1  Topic: ICT-56-2020 Next Generation Internet of Things  Duration: 1. November 2020 – 31. Oktober 2023  Coordinator: Bielefeld University (Germany)  Consortium: 12 partners from 4 EU countries (Germany, Poland, Portugal and Sweden) and one associated country (Switzerland). More info:  https://www.vedliot.eu/  https://twitter.com/VEDLIoT  https://www.linkedin.com/company/vedliot/
  • 3. 3 Deep Learning IoT Architecture t.RECS u.RECS Edge RECS|Box Optimized Deep Learning Model (inference) Cloud Embedded
  • 4. 4 VEDLIoT Hardware Platform  Heterogeneous, modular, scalable microserver system  Supporting the full spectrum of IoT from embedded over the edge towards the cloud  Different technology concepts for improving x86 GPU ML-ASIC ARM v8 GPU SoC FPGA SoC RISC-V FPGA VEDLIOT Cognitive IoT Platform  Performance  Cost-effectiveness  Maintainability  Reliability  Energy-Efficiency  Safety
  • 6. 6 VEDLIoT‘s Deep Learning Toolchain • Image Classification • Object Detection • Semantic Segmentation • Instance Segmentation • Extractive Question Answering Model Zoo Optimization Engine Compilers & Runtime APIs Heterogeneous Hardware Platforms
  • 14. 14 1&3 Flexible and adaptable Accelerators for Deep Learning DL Model DL Model CPU, GPU- SoC, ML-SoC FPGA-SoC  End of Moore’s law & dark silicon – Domain Specific Architectures (DSA)  Efficient, flexible, scalable accelerators for the compute continuum  Algotecture  Optimized DL algorithms  Optimized toolchain  Optimized computer architecture Heterogeneous DL Accelerator Algotecture/ Co-Designed DL Accelerator Optimizer & Compiler Co-Design
  • 15. 15 The fun has just started! Follow our work! https://twitter.com/VEDLIoT https://www.linkedin.com/company/vedliot/ https://vedliot.eu Be part of it Open call at project mid-term Allow early use and evaluation of VEDLIoT technology
  • 16. 16 Thank you for your attention. Me Hans Salomonsson EmbeDL, Sweden hans@embedl.ai Contact Jens Hagemeyer, Carola Haumann Bielefeld University, Germany chaumann@cor-lab.uni-bielefeld.de jhagemey@cit-ec.uni-bielefeld.de