Digital Twin, LLM & IIOT

IIOT for legacy and intelligent factory machines with XR and LLM feedback with a Digital Twin demonstration of real-time IOT for architecture/building applications using Omniverse.

  • PIs: Sam AnandMing Tang

$40,000. UC Industry 4.0/5.0 Institute Consortium Research Project: 01.2024-01.2025

Environment Sensors for Digital Twin model. XR-Lab and SM-Lab at Digital Futures Building.

Integration of Reality capture, IOT, LLM into a digital twin model.  

 

Digital Twin of Digital Futures Building. 

Primary Objective: To develop a conversational large language modeling system that acquires data from legacy machines, digital machines, environmental data, real-time data, and historical data within an IIoT environment to create a digital twin for assisting in real-time maintenance and assistance (Application Use Case: Digital Future’s Building) 


1. Autodesk DT

Live Demo with Autodesk DT.  Please contact Ming Tang to request a password. 

  


2. Unreal DT

Live demo with pixel stream. This is designed for mobile devices with a touch screen, so users can use two rings on the screen to view and navigate space.


Demonstration videos

 

The original BIM model was provided by GBBN and Messer Construction. Copyright 2024.

Student: Sourabh Deshpande, Anuj Gautam , Manish Raj Aryal, Mikhail Nikolaenko, Aayush Kumar, Eian Bennett, Ahmad Alrefai