open platform for swarm training
Download as PPTX, PDF0 likes122 views
This document discusses the need for open platforms for drone swarm design, training, and integration. It proposes creating a multi-vendor definition and interoperability platform that would allow for the mixing and matching of components like drones, control systems, communication protocols, and video analytics from different vendors to enable cost-effective and integrated drone swarms. Key requirements discussed include low-cost, upgradeability, reuse of existing components, pluggable analytics, standardized communication and control, and simulation tools for swarm training.
open platform for swarm training
- 1. Yossi Cohen DSP-IP Open Platform for Drone swarm Design & training
- 2. Agenda • The need for drone swarm • Drone swarm design requirements • The need for open platform • Open platform requirements
- 4. Drone Swarm - the need • Price / Quantity ! • Area coverage • Multi-location sensors • Coordinated attacks • Autonomous / Single operator to many drones
- 5. Drone Swarm – my wish list • Cost Cost Cost !!! • Upgrade existing drones to swarm?? • Use existing platforms • (DVRs/ control rooms / communication) • Best platform • Integrate: • multiple drone types • components from different vendors into a single swarm
- 6. Multi-vendors platform • Company 1 – low cost <10K attack drones • Company 2 – smarter drone for communication/control • Company 3 –control cart / system • Company 4 – distributed video analytics platform • Could it all work together “Mix & Match” for the best integrated platform? • Create an open platform / standards for swarm integration
- 7. Swarm coordination simulation & training • Swarm training: • Reinforced learning methods • Hardware requirements • Jetson nano / Jetson NX run RL models (cost of 100-400$)!! • Low cost SoC with NPU/TPU / GPU FPGAs
- 8. Swarm simulation & training - NVIDIA • Low-cost Reinforced learning platforms for drones / UAV • NVIDIA ISAAC SIM
- 9. Swarm simulation & training - Matlab • Matlab Reinforced and UAV Toolboxes
- 10. Swarm training – testing & validation • Open interoperability tests • Swarm coordination • Swarm response to event
- 11. Video Analytics - Detection • Pain • Drone manufacturer doesn’t have all the tools / knowledge for Video Analytics • Target definition changes (new missile truck / target person) • Solution • Pluggable ATR server • Server accept 3rd party analytics models with predefined API • Accept updates (face / new missile track)
- 12. Video Analytics - Metadata • How to send metadata drone-drone & Drone-controller • Solutions • Existing UAV video analytics protocols (STANAG /VMTI) • NVIDIA Metadata format
- 13. Video Analytics - simulation • Simulate Autonomous system environment • Underwater • Ships • Missiles • Drones/UAV • Full Digital twin • Behavior of enemy autonomous systems & Swarms • Systems that accepts a 3D model of object simulate it in combat environment and automatically creates a detector
- 14. Control • Communication • same protocols • Same commands • Meshed communication and relay (optional)
- 15. Naïve Suggestion • Create a multi-vendor definition and interop platform • Communication • Control • Video Analytics • Training • Make this vision happen