Geospatial Mobile Application for Emergency Response and Management using Google Photorealistic 3D Tiles and Cesium for Unity

Current Students: Andrew Summitt, Archith Sharma, Jason Sha, Aditya

Status: Current (Poster)

The goal of this project is to develop and evaluate a Geospatial Mobile Application for Navigation and Emergency Response using Google Photorealistic 3D Tiles and Cesium for Unity. The Mobile AR Application can be used for navigation and emergency response at UNT campus. Cesium for Unity combines the 3D geospatial capability of Cesium and 3D Tiles with the Unity ecosystem. The following objectives are proposed:

  • Location-based augmented reality (AR) applications using Google Photorealistic 3D Tiles and Cesium for Unity.
    • It should provide more immersive navigation experiences and emergency information to users on campus.
  • Geospatial AR Navigation: Develop AR phone app that makes navigation more intuitive with a 3D model of the user’s location at UNT campus by displaying location-based content and integrating Google Photorealistic 3D Tiles perfectly with the real world.
  • Digital Twin for visualizing geospatial data for UNT campus using Cesium and Unity 3D.
  • Develop a point cloud data visualization in VR or AR using Cesium and Unity 3D for UNT campus by incorporating labeling and annotation.
    • Preserving More Metadata for Point Clouds Using 3D Tiles.
    • Explore with other hardware devices such as HTC Vive, Hololens2, Magic leap 2, Apple Vision Pro, and Meta Quest 3.
    • Adding relevant navigation and evacuation information by including labeling and annotation.
  • Explore Gen AI and chat GPT integration to aid in navigation and emergency response capability.
Geospatial Mobile Application for Navigation and Emergency Response Geospatial Mobile Application Geospatial Mobile Application Geospatial Mobile Application

Cesium

Assembly Points Exits Weather Shelter Locations
Geospatial Mobile Application Demo Geospatial Mobile Application Demo
Point Cloud Annotation v2 with menu Point Cloud Viz in VR Meta Quest Pro
   

Publications

  1. Sharma, S and Pesaladinne R.,"Spatial Analysis and Visual Communication of Emergency Information through Augmented Reality", Journal of Imaging Science & Technology (JIST), JIST, Vol. 67, Issue 6, https://doi.org/10.2352/J.ImagingSci.Technol.2023.67.6.060401, 2023.
  2. Chellatore, M.P., Sharma, S, "Mobile application for identifying anomalous behavior and conducting time series analysis using heterogeneous data", Proceedings of the 26th International Conference on Human-Computer Interaction (HCI International 2024), Thematic Area: Virtual, Augmented and Mixed Reality, Copenhagen, Washington Hilton Hotel, Washington DC, USA, 29 June - 4 July 2024.
  3. Sharma, S., Pesaladinne R., "Spatial analysis and visual communication of emergency information through augmented reality", Proceedings of the IS&T International Symposium on Electronic Imaging (EI 2024) in the Engineering Reality of Virtual Reality Conference, January 21-25, 2024.