Eye Tracking Technology

1. Wearable Eye-tracking technology.


This wearable ET device includes various components, such as illuminators, cameras, and a data collection and processing unit for image detection, 3D eye model, and gaze mapping algorithms. Compared to the screen-based ET device, the most significant differences of the wearable ET device are its binocular coverage, a field of view (FOV) and head tilt that has an impact on the glasses-configured eye-tracker.  Also, it avoids potential experimental bias resulting from the display size or pixel dimensions of the screen. Similar to the screen-based ET, the images captured by the wearable ET camera are used to identify the glints on the cornea and the pupil. This information together with a 3D eye model is then used to estimate the gaze vector and gaze point for each participant.

After standard ET calibration and verification procedure, participants were instructed to walk in a defined space while wearing the glasses. In this case, the TOI was set at 60 seconds, recording a defined start and end events with the visual occurrences over that period. In this case, data was collected for both pre-conscious (first three seconds) and conscious viewing (after 3 seconds).



we also did the screen-based eye-tracking and compared the results.

2. Screen-based Eye-tracking technology

This method was beneficial for informing reviewers how an existing place or a proposed design was performing in terms of user experience. Moreover, while the fundamental visual elements that attract human attention and trigger conscious viewing are well-established and sometimes incorporated into signage design and placement, signs face an additional challenge because they must compete for viewers’ visual attention in the context of the visual elements of the surrounding built and natural environments. As such, tools and methods are needed that can assist “contextually-sensitive” design and placement by assessing how signs in situ capture the attention of their intended viewers.

3. VR-Based Eye-tracking technology

Eye-tracking technology enables new forms of interactions in VR, with benefits to hardware manufacturers, software developers, end users and research professionals.


Tang. M. Analysis of Signage using Eye-Tracking Technology. Interdisciplinary Journal of Signage and Wayfinding. 02. 2020.

Tang, M. and Auffrey, C. “Advanced Digital Tools for Updating Overcrowded Rail Stations: Using Eye Tracking, Virtual Reality, and Crowd Simulation to Support Design Decision-Making.Urban Rail Transit, December 19, 2018.

Magic School Bus project

The AR & VR project for medical model. Animated heart. magic school bus project at the University of Cincinnati.

Eye-tracking analysis for train station

Some test did with Tobii eye tracker for train station design in Beijing. All heatmap here, all gaze cluster here. 15 train stations were design by students and presented through Unreal Game Engine. More information on the train station design is available in the studio website.




Hololens Installation

Two installations using Microsoft Hololens





eye-tracking for way-finding

study on eye-tracking for way-finding. The building on fire is  UC DAAP building. The color represent fixation duration, and gaze count.




UI for mobile devices MSB project

This is a prototype page for UI designed for MSB project usign mobile devices VR and AR. The idea is developing mobile based AR tracking system, similar as Merge Cube or HP Reveal

VR medical model

The VR project for medical model. Animated heart. magic school bus project at the University of Cincinnati.

Virtual Assistant for Boeing is shortlisted for 2018 Crystal Cabin Award

Our project has been shortlisted to for a 2018 Crystal Cabin Award! Students and faculty at the University of Cincinnati and the Live Well Collaborative developed the Virtual Assistant, Boeing Onboard, in the Spring of 2017. Boeing Onboard is a virtual assistant combined with a holographic interface which all passengers have access to onboard planes. Through augmented reality and wearable glasses, Boeing Onboard has the ability to provide passengers with valuable information, such as safety demonstrations, in-flight entertainment, and web browsing. Boeing Onboard is an in-flight concierge service connecting the passenger to all the resources and information the passenger needs for the ultimate travel experience.


Bubble_Hololens Test

Hololens Test. Ming Tang, Mara Marcu. DAAP. UC