What we've done so far with mago3D, an open source based 'Digital Twin' platform.
2 likes1,993 views
Mago3D is an open-source platform designed for visualizing large and complex 3D objects, integrating Building Information Modeling (BIM) with 3D Geographic Information Systems (GIS) in a web-based environment. It focuses on overcoming challenges in handling geospatial data through efficient algorithms for reducing file sizes and improving rendering speeds. The platform aims to evolve into a digital twin, allowing for real-time monitoring and analysis across varied applications in construction and urban management.
What we've done so far with mago3D, an open source based 'Digital Twin' platform.
- 1. What we’ve done so far with mago3D, an open source based ‘Digital Twin’ platform Sanghee Shin(shshin@gaia3d.com) 16th April 2019
- 2. GeoBIM
- 5. From Open Source… mago3D
- 6. Introduction – mago3D mago3D is a platform for … Visualizing massive and complex 3D objects including BIM on a web browser 1 Seamless integration of BIM/AEC and 3D GIS in a single space2 Web based collaborative issue/process management4 ‘Digital Twin’ that can create parallel worlds in a virtual reality with numerous IoT, sensor data 3 = GIS + BIM + Open Source
- 7. Introduction – Architecture of mago3D mago3D.JS Cesium/WWW Client internet Web Server WAS F4DStorage mago Content Management DataBase F4D Converter 3 main cores of mago3D
- 8. Introduction – Overall System Components DB Postgresql 9.6 + PostGIS Web Server Nginx 1.12.1 / Apache 2.4 Language Java8 Framework Spring(Springboot) + Mybatis Build Gradle Log Logback/Log4j 2 Security ESAPI Report Jasper/POI View JSP/JSTL UI/UX Jquery Chart Jqplot/Axisj Template Thymeleaf Handlebars Web Map Server GeoServer OS Centos 7.2 WebGL Globe Cesium, WorldWind, … Cache EhCache, Redis Container Docker WAS Tomcat 8.5
- 9. Introduction – Core parts of mago3D F4D Converter mago3D.js mago3D.js 3D GIS Engines Cesium Web World Wind API API service html F4D Converter converts 3D formats(IFC, 3DS, OBJ, DAE, JT) to 3D internet service format F4D. It carries out data size reducing and pre-processing for fast rendering A plug-in composed of pure javascript which enables 3D GIS engines to handle large-sized and highly detailed AEC data F4D Converter F4D .ifc .3ds .obj .dae .gml
- 10. Key Algorithms GeoBIM is too heavy due to so many vertices and triangles in so many objects. This causes two major issues in handling GeoBIM in web browsers. ! Network Traffic Rendering Speed
- 11. Key Algorithms So we introduced 3 concepts to solve these issues. 1. Reducing file size 3. Preprocessing for speed 2. Building rougher LOD making indices used in culling removing duplication
- 12. Key Algorithms Step What is this? Used for 1. Model/Reference A concept of writing 3D data that only one geometry among multiple geometries congruent with each other is written. reducing data size of semantic data(ex. BIM/CAD, 3D data by modeling) 2. NSM(Net Surface Mesh) This is composed of 2 steps. 1. building meshes with regularly gridded vertices on surfaces of raw 3D model. 2. triangle reduction. making rougher LOD ※ 2nd step is separately applied in simplifying targets in case of triangular meshes such like TIN or random-shaped 3D data 3. Visibility/Spatial index Visibility index is for occlusion culling and spatial index is for frustum culling in indoor camera working. carrying out a serial combination of 2 cullings for fast determination of targets to be shown Let’s look into more concretely.
- 13. with 4 geometric meshes - 4 models 23 objects are created. - 23 references Image source : www.vecteezy.com Key Algorithms : F4D, lightweight service format Example of Model-Reference
- 14. 1. Build a triangular mesh based on the grid structure from the original three-dimensional data. Key Algorithms : F4D, lightweight service format
- 15. Key Algorithms : F4D, lightweight service format
- 16. Visibility Index An index describing which inner objects can be seen from selected positions in AEC. This index is used in occlusion culling in run-time visualization of mago3D. Key Algorithms : F4D, lightweight service format
- 17. Spatial Index An index describing which inner objects are in cubes, spatial sub-divisions of AEC. This index is used in frustum culling in run-time visualization of mago3D. Key Algorithms : F4D, lightweight service format
- 18. 1. When a camera position and 2. the viewing direction of it are setup, 3. mago3D does frustum culling on spatial indices 4. and do occlusion culling on the result of the frustum culling. 5. Finally mago3d finds targets to be rendered. (intersection between two indices) → It possible to select targets to be rendered without any complicated geometric operation in run-time. How to use both indices Key Algorithms : F4D, lightweight service format
- 19. mago3D runs on any device Results: Accessible from any device, anytime, anywhere
- 20. Results: BIM(Indoor/Outdoor) Integration Seamless integration of indoor and outdoor space on the same platform Scene from indoor to outdoor through windows Scene from outdoor to indoor through windows
- 21. Results: MEP Integration Integration of large size MEP and 3D GIS on a web browser
- 22. Results: AEC Integration Integration of large size AEC and 3D GIS on a web browser
- 23. Results: Various API supported (OpenAPIs) APIs are supported for developing application systems(currently 29 APIs) moving/rotating a full building moving objects & viewing attributes registration/monitoring/search of issues 24
- 24. Real Cases – KOPRI(Korea Polar Research Institute) • Project Name: King Sejong Research Base Facility Management System https://www.youtube.com/watch?v=ufGz-uGG6vM
- 25. Real Cases – OpenIndoorMap Project
- 26. Real Cases – National Institute of Advanced Industrial Science and Technology, Japan
- 27. Real Cases – Others
- 28. What I’ve learnt from real projects • Visualizing many BIM data on 3D GIS is still challenging • Many clients want to see *PRETTY* picture! • After seeing the pretty picture, many clients want a functionality that can be done through 2D or 2.5D. • 3D analysis, 3D simulation are among wish list that clients want to see on top of full of GeoBIM platform. • It’s still doubtful how 3D gives any material benefits over 2D. • 3D is expensive and BIM is more expensive! • Standards are not widely accepted across industries. 28
- 29. In Future Towards Digital Twin Platform!
- 30. In Future: Digital Twin Digital Twins A digital twin is a virtual representation of a physical object or system across its lifecycle, using real-time data to enable understanding, learning and reasoning.
- 31. Digital Twins Concept: Digital Informational Construct Vision: Create, Test, Build
- 32. Level of Digital Twins Level 1 3D Visualization Level 2 Real-time Monitoring Level 3 Analysis, Prediction Optimization <Source: Use the IoT Platform Reference Model to Plan Your IoT Business Solutions, Gartner>
- 33. <Source: Steve Liang(2016)> Location is the first class citizen for IoT! In Future: Location Technology Evolution 33
- 34. In Future: Location Technology Evolution Size of Space Update Cycle Small 1980 1990 2000 2010 ~ 2020 Large Static Dynamic <Source: Sakong, Hosang(2016), Policy Directions of Spatial Information for Hyper-connected Society> 34
- 35. In Future: GeoSpatial Paradigm Shift Past Future Concept Object Information Context Awareness Data Consumer Prosumer/DIY User Person Things Visualization Real World Cyber Physical Systems Application Base Map Key Factor for Fusion Driving Entity Public Sector Private Sector Space Outdoor Indoor + Outdoor + Update Cycle Static Dynamic <Source: Hosang Sagong(2016), ‘Policy Directions of Spatial Information for Hyper-connected Society’ modified>
- 36. Sensors, sensors, and sensors… Sensory Organ Memories Brain IoT(Internet of Things) Big Data A. I. Smartizen(10Bn) Smart Devices(100Bn) Smart Sensor(100Tn)
- 37. In Future 37 {Indoor, Outdoor} {Static, Dynamic} {Objects, Phenomena} {Overground, Underground} {Multi-Sensor, Multi-Source} mago3D
- 38. In Future: Point Cloud Integration
- 39. In Future: Weather/Climate/Air Pollution/CFD
- 40. Summary Summary of mago3D! • BIM/AEC and 3D GIS integration in a single space • Web based – no need to install additional program • Massive and complex 3D objects rendering • Open source – Apache and AGPL license • Supports industry standard formats(CityGML, IndoorGML, IFC, 3DS, DAE, GLTF…) • In-Browser 3D objects moving/rotation/heading adjustment • Highly extensible architecture • Will be ‘Digital Twin’ plaform! 40
- 41. For more information, please visit http://mago3d.net All the source codes are here: https://github.com/Gaia3D/mago3d Thank you! 33 This research was supported by a grant(number:19NSIP-B080778-06) from National Spatial Information Research Program (NSIP) funded by Ministry of Land, Infrastructure and Transport of Korean government. Sanghee Shin shshin@gaia3d.com