Automatic Scene Creation for Augmented Reality Work Instructions Using Generative AI. Siemens. PI. Ming Tang. co-PI: Tianyu Jiang. $25,000. UC. 4/1/2024-12/31/2024
Students: Aayush Kumar, Mikhail Nikolaenko, Dylan Hutson.
Sponsor: Siemens through UC MME Industry 4.0/5.0 Institute
Investigate integration of LLM Gen-AI with Hololens-based training.
Ming Tang, Principal Investigator
Amount: $32,416
Funding: P&G Digital Accelerator.
Gotal: Metaverse technologies for global engagement. Human-Computer Interaction, Digital Human. Immersive visualization.
In Phase 1 of the “Leveraging Metaverse Platforms for Enhanced Global Professional Networking” project, conducted in partnership with P&G, the XR-Lab proposes a pilot study aimed at identifying and analyzing the top five metaverse platforms best suited for professional networking and conferencing. The metaverse has opened unprecedented opportunities for communication, collaboration, and social engagement, offering innovative solutions for professional networking and conferencing. In Phase 1, “Surveying the Current Metaverse Landscape,” the UC team examined the top five metaverse platforms to evaluate their potential for replicating global in-person professional networking experiences and supporting multi-user online conferences.
This phase provided a systematic assessment of the leading platforms suitable for professional networking and conferencing. The team analyzed how these platforms leverage emerging technologies to create immersive experiences, such as hosting online conferences and facilitating discussions with global experts. The Phase 1 final report delivered a comprehensive evaluation of the strengths and limitations of each platform, along with recommendations for platform selection based on specific criteria such as audience size, interactivity, and technical requirements.
Additionally, the UC team demonstrated how platforms such as Mesh and Hyperspace can be customized for specific events, including tailored branding and interactive features designed to enhance professional networking and conferencing. These demonstrations provide valuable insights for P&G, highlighting how metaverse technologies can be strategically developed and adopted to expand global engagement and enable innovative event experiences.
Customized Metaverse Demo developed by the UC Team.
Please reach out to the P&G Team for the final report.
Related Links:
IIOT for legacy and intelligent factory machines with XR and LLM feedback with a Digital Twin demonstration of real-time IOT for architecture/building applications using Omniverse. 
$40,000. UC Industry 4.0/5.0 Institute Consortium Research Project: 01.2024-01.2025
The project centers on the development of a Digital Twin (DT) and a multi-agent Large Language Model (LLM) framework designed to access and interpret real-time and historical data through an Industrial Internet of Things (IIoT) platform. Real-time data is sourced from legacy machines and smart machines, integrating Building Information Modeling (BIM) with environmental sensors. The multi-agent LLM framework comprises specialized agents and supports diverse user interfaces, including screen-based systems, Virtual Reality (VR) environments, and mobile devices, enabling versatile interaction, data visualization, and analysis.
The research evaluates leading DT platforms—Autodesk Tandem, NVIDIA Omniverse, and Unreal Engine—focusing on their capabilities to integrate IoT and BIM data while supporting legacy machine systems. Autodesk Tandem excelled in seamlessly combining BIM metadata with real-time IoT streams for building operations and system scalability. NVIDIA Omniverse demonstrated unmatched rendering fidelity and collaborative features through its Universal Scene Description (USD) framework. Unreal Engine, notable for its immersive visualization, proved superior for LLM integration, leveraging 3D avatars and conversational AI to enhance user interaction.
CVG-HOLO – WAYFINDING HOLOGRAM PROJECT
XR-Lab is working with Cincinnati/Northern Kentucky International Airport (CVG), in collaboration with UC Center for Simulations & Virtual Environments Research, to
The project will apply various methods, including eye-tracking, motion capture, motion tracking, and computer vision.
Hologram. Reference Image from SVG news. 10.2023
Project Client: Josh Edwards, Sr. Manager, Innovation Cincinnati/Northern Kentucky International Airport
UC Team:
concept of hologram in CVG. by students in ARCH 7014. Fall 2023, UC.
Thanks for the support from the UHP Discovery Summer program.
Check out more on the student projects and eye-tracking analysis on CVG renovation. or way-finding research projects and publications at XR-Lab.
The University of Cincinnati, through its Digital Futures complex, will work collaboratively with the UC Center for Simulations & Virtual Environments Research, Lindner College of Business, UC DAAP XR-Lab, and Kao to develop concepts and a minimum viable product for a Jergens virtual tanning experience called the ‘Glowverse.’
KAO-STP-Glowverse VR retail project. GLOWVERSE VIRTUAL SPA (VR) development. UC-SIM + XR-Lab +College of Business. Funded by KAO. PI: Chris Collins. Co-PI: Ming Tang, Noah Van. $52,122. Period: 2.2023-11.2023.
