GenAI+AR Siemens

Automatic Scene Creation for Augmented Reality Work Instructions Using Generative AI. Siemens. PI. Ming Tang. co-PI: Tianyu Jiang. $25,000. UC. 4/1/2024-12/31/2024

Sponsor: Siemens through UC MME Industry 4.0/5.0 Institute



XR-Lab’s project was selected to join the Undergraduates Pursuing Research in Science and Engineering (UPRISE) Program
May 6 – July 26, 2024


Project title: Reinforcement Learning (RL) system in Game Engine

This project proposes the development of a sophisticated reinforcement learning (RL) system utilizing the robust and versatile environment of Unreal Engine 5 (UE5). The primary objective is to create a flexible and highly realistic simulation platform that can model a multitude of real-life scenarios, ranging from object recognition, urban navigation to emergency response strategies. This platform aims to significantly advance the capabilities of RL algorithms by exposing them to complex, diverse, and dynamically changing environments. Leveraging the advanced graphical and physical simulation capabilities of UE5, the project will focus on creating detailed and varied scenarios in which RL algorithms can be trained and tested. These scenarios will include, but not be limited to, urban traffic systems, natural disaster simulations, and public safety response models. The realism and intricacy of UE5’s environment will provide a challenging and rich training ground for RL models, allowing them to learn and adapt to unpredictable variables akin to those in the real world.

Honors Seminar student projects

“Human-Computer Interaction in the Age of Extended Reality & Metaverse” student projects

Spring. 2024.  UC

Under the guidance of Ming Tang, Director of the XR-Lab at Digital Futures and DAAP, UC, this honors seminar course has propelled students through an immersive journey into the realm of XR. The course encompasses Extended Reality, Metaverse, and Digital Twin technologies, providing a comprehensive platform for theoretical exploration and practical application in XR development.

The coursework showcases an array of student-led research projects that investigate the role of XR in various domains, including medical training, flight simulation, entertainment, tourism, cultural awareness, fitness, and music. Through these projects, students have had the opportunity to not only grasp the intricate theories underpinning future HCI developments but also to apply their skills in creating immersive experiences that hint at the future of human-technology interaction.


 “Human-Computer Interaction in the Age of Extended Reality & Metaverse” is a UC Honors course that delves into the burgeoning field of extended reality (XR) and its confluence with human-computer interaction (HCI), embodying a fusion of scholarly inquiry and innovative practice.

Ming Tang, Professor, Director of XR-Lab, DAAP, University of Cincinnati

Students: Nishanth Chidambaram, Bao Huynh, Caroline McCarthy, Cameron Moreland, Frank Mularcik, Cooper Pflaum, Triet Pham, Brooke Stephenson, Pranav Venkataraman

Thanks for the support from the UC Honors Program and UC Digital Futures.

Digital Twin of Cincinnati

A realtime flythrough demo for Digital Twin of City Cincinnati

Digital Futures Building at the University of Cincinnati

Destroy Alien buildings near the UC campus. Project developed by students Cooper Pflaum and Nishanth Chidambaram. 

Fluid Sim in VR

Fluid Simulation in Virtual Reality. Unreal Engine. Collision test with hand.