CE1009_Implementation of Civil IoT Architecture.pdf
0 likes26 views
The document discusses the implementation of a civil IoT architecture, highlighting the challenges of IoT deployment in rural areas due to the digital gap, and proposes a solution aimed at reducing network transmission costs and enhancing data collection efficiency. It details the architecture of a civil backbone network and data platform, featuring various IoT communication protocols and a focus on performance through real-case experiments. The conclusions emphasize the need for scalable, fault-tolerant mechanisms for IoT data collection and real-time processing capabilities.
CE1009_Implementation of Civil IoT Architecture.pdf
- 1. Implementation of Civil IoT Architecture @WCSE2023 Wei-Yu Chen1 , Chen-Kai Sun2 , Hui-Hung Yu3 1,2,3 National Center for High-performance Computing (NCHC) {1 wych, 2 ceasar, 3 mulder}@narlabs.or.gtw
- 2. 2 Agenda ● A. Introduction ● B. Related Works ● C. Architecture Civil Backborn Network Civil Data Platform ● E. Experiments Results ● F. Future Works
- 3. 3 A. Introduction - IoT Applications Ref: grandviewresearch.com https://www.grandviewresearch.com/industry-analysis/iot-market Ref: iot-analytics.com https://iot-analytics.com/iot-market-size/
- 4. 4 A. Introduction - Motivation Difficult to implement into rural areas because of the digital gap. Crucial to improve operational efficiency and manufacturing processes due to the increasing velocity and volume of big data. Issue
- 5. 5 A. Introduction - Our Proposal (1) Reduce the network transmission cost, (2) Develop a high-throughput and low-latency data collection mechanism (3) Serve as high availability and high-quality services. Band20 Base Station Cable Backbone Network Data Platform NCHC Civil IoT Sensors Applications Internet 1 2
- 6. 6 https://www.eettaiwan.com/20190401nt11-wi-fi-802-11-ah/ B.2 IoT Communication Protocal
- 7. 7 B.3 IoT Transformation Protocals IP ( IPv6 or IPv4 ) TCP UDP AMQP XMPP MQTT DDS CoAP Behavior Publisher/ Subscriber N/A Publisher/ Subscriber Publisher/ Subscriber Request/ Reply Architecture P2P/Broker N/A Broker Global P2P QoS 2 N/A 3 22 2 Performace 1k msg/s 1k msg/s 1k msg/s 100k msg/s 0.1k msg/s Protocal
- 8. 8 VPN Security Gateway Band20 Station Band20 LTE Cat.M1 HeMS HSS EMS EPC Backbone Facilities Cable IoT Sensors C1. Civil Backborn Network
- 9. 9 C.1 Civil Backborn Network (1) device Core Server IoT Gateway SmallCell Sim Card
- 10. Core Network C.1 Civil Backborn Network (2) Connection smallcell A CellPhone + band20 LTE_Router + band20 Device + band20 Tube-E4G Asus 4G-N12 B1 Asus 4G-AX56 PC + vpn (internet) IPsec Server IoTGW + band20 Askey IoTGW wifi + hotspot wifi + DHCP RJ45 + DHCP BlueTooth mesh App RaspberryPi/ NB customed iot sensor NB FortiClient APP RaspberryPi/ NB RaspberryPi/ NB Route Net Connec tion Device Conn ection End Device ● Band20 SIM Card ● LTE Cat.M1
- 11. 11 MQTT Broker (HA Cluster) Log Exporter Status - Subscriber Supervisor Civil Data Platform PostgreSQL (HA -Cluster) Notify - Subscriber ElasticSearch Internet Kibana Grafana Applications Persistence Transformation Collection Process Data Data Data C2. Civil Data Platform
- 12. 12 D. Experiment Results : Real-case
- 13. 13 * A（ 410m）RSRP= -118 dBm。 * B（ 480 m）RSRP= -115 dBm。 * C（ 245 m）RSRP= -119 dBm。 * D（ 460 m）RSRP= -119 dBm。 * PLMN / Out of Service。 * A（ 735m）RSRP= -118 dBm。 * B（ 916m）RSRP= -116 dBm。 * C（ 493m）RSRP= -112 dBm。 * D（ 391m）RSRP= -118 dBm。 * PLMN / Out of Service。 * A（ 620m）RSRP= -121 dBm。 * B（ 650m）RSRP= -119 dBm。 * C（ 795m）RSRP= -129 dBm。 * D（ 855m）RSRP= -118 dBm。 * PLMN / Out of Service。 D1. SmallCell Signal Scope Hsinchu Taichung Tainan 外網 可忽 略 外網 可忽 略 外網 可忽 略 外網 可忽 略
- 14. 14 D2 NCHC Band20 LTE Throughput
- 17. 17 D4. Anomaly Detection alarm by line service return
- 18. 18 Conclusions ■ Implement an efficient mechanism for collecting IoT data that is easy to scale horizontally and can achieve fault tolerance and high availability. ■ Design a presentation method for real-time streaming sensor data that supports multiple charts and alert mechanisms. ■ Inventory and organize current IoT communication standards, usage, and differences.
- 19. Thank You
- 20. 20 Agenda ● A. Introduction ● B. System Architecture ● C. Experiments and Results ● D. Conclusions
- 21. 21 A. Introduction - IoT Applications Ref: grandviewresearch.com https://www.grandviewresearch.com/industry-analysis/iot-market Ref: iot-analytics.com https://iot-analytics.com/iot-market-size/
- 22. 22 A. Introduction - Motivation 安全與隱私問題 效率問題 維護問題
- 23. A. Goals • （i）雲架構 – 我們基於底層為國網中心混合雲的實體架構， 該平台易於橫 向擴展，並連接到公有雲； • （ii）高效益 – 使用發佈/訂閱 框架，並且符合支援大部分物聯感測器的通 用性； • （iii）可認證 – 我們將不同的應用透過 topic 進行獨立，並設定認證機制
- 24. 24 B. Our Works Subscriber MQTT Cluster Subscriber Internet Persistence Transformation Collection IoT Sensor Data Hyper Kylin Cloud VM/Docker Load Balancer DB Cluster Subscriber Cluster Generation Scalable Network Public Cloud Bridging On-demand Computing
- 25. 25 B.1 IoT Transformation Protocals IP ( IPv6 or IPv4 ) TCP UDP AMQP XMPP MQTT DDS CoAP Behavior Publisher/ Subscriber N/A Publisher/ Subscriber Publisher/ Subscriber Request/ Reply Architecture P2P/Broker N/A Broker Global P2P QoS 2 N/A 3 22 2 Performace 1k msg/s 1k msg/s 1k msg/s 100k msg/s 0.1k msg/s Protocal
- 26. 26 B2. NCHC Hyper Kylin Cloud
- 27. 27 C. Experiment ■ C1_ Experiment Environment ■ C2_ Security ■ C3_ Performance
- 28. 28 C1. Environment Setup (Hyper Kylin)
- 29. 29 C1. Environment Setup (Stress Test)
- 30. 30 C2. Security Setup ● User / Password : 每個應用 有獨立的帳號密碼，且僅提 供資料傳輸，而無法用此登 入管理系統。 ● Topic : 每個應用有獨立的 topic，並且包含 read regexp / write regexp 的 permission設 定。
- 31. 31 C3. Experiment Performance 1 x Container Based
- 32. Cluster Mode Based on RabbitMQ
- 33. Cluster Mode Based on RabbitMQ
- 34. 34 D. Conclusions ■ 本篇實作基於混合雲架構的發佈訂閱 IoT 資料平台 （i）基於底層為國網中心混合雲的實體架構， 該平台易於橫向擴展， 並連接到公有雲； （ii）提出了適合於物聯網的一種發佈/訂閱 框架，並且符合支援大部 分物聯感測器的通用性； （iii）對於安全性，我們將不同的應用透過 topic 進行獨立，並設定認 證機制； ■ 未來能以實作的應用來擴展
- 35. 35 B3. Subscription/Publish Method Protocal / Language Community Function Support Note HiveMQ mqtt / java Basic ❖ Pros: 商用口碑佳 ❖ Cons: 社群版不支援管理介面 Mosquitto mqtt / C,python Full ❖ Pros: open source ❖ Cons: 社群版不支援管理介面 ActiveMQ – mqtt amqp / java Full ❖ Pros: Open Source / 管理介面，指令啟動與結束 ❖ Cons: 設定較分散和瑣碎瑣碎，不支援 cli Rabbitmq – mqtt amqp / earlang Full ❖ Pros: 社群版即支援多項功能、管理介面、叢集等，系 統化安裝管理，支援 cli ❖ Cons:不支援Qos2