ADVANCING SAFETY IN ROADWAY WORK ZONES WITH WORKER-CENTERED AUGMENTED REALITY: ASSESSING THE FEASIBILITY, USABILITY, AND EFFECTIVENESS OF AR-ENABLED WARNING SYSTEMS

Doctoral Candidate Name: 
Sepehr Sabeti
Program: 
Infrastructure and Environmental Systems
Abstract: 
In recent years, there has been a concerning increase in serious injuries and fatalities within highway work zones, deviating from a previously declining trend. While innovative technologies offer potential for improving safety, the specific needs of the highway work zone community have often been overlooked, resulting in a lack of essential information for designing user-centered safety systems. Current safety practices primarily rely on reactive technologies that may not provide timely responses to intrusions and environmental risks. To bridge this gap, there is a need for transformative technologies that integrate real-time predictive safety systems and extensive user research to develop worker-centered Augmented Reality (AR)-based safety systems specifically tailored for highway work zone safety. This dissertation aims to address these challenges and outlines our efforts in designing such a worker-centered AR-based safety system.


Chapter 2 explores the feasibility, requirements, and challenges associated with integrating AI capabilities into AR systems to enhance the safety of highway work zones. This chapter delves into the feasibility, requirements, and challenges associated with incorporating AI capabilities into the AR system to develop a predictive safety system that can proactively identify potential hazards and issue timely warnings to workers. The outcomes of this chapter indicate that the real-time communication latency and AI execution latency meet the tight timing constraints of a real-time safety system. The early user research demonstrates positive reception and acceptance of the proposed safety framework and interface by highway maintenance and operation professionals across multiple states in the US.

Chapter 3 focuses on conducting a mixed-method usability investigation of the proposed AR-based safety system using a high-fidelity prototype. The investigation assesses aspects such as user interface design, interaction patterns, and user feedback to evaluate the overall usability and effectiveness of the technology in enhancing roadway work zone safety. The findings indicate that participants rated the usability of the system above average in both indoor and outdoor settings and perceived a reasonable level of mental effort. Perceived trust was found to be significantly correlated with usability, underscoring its importance in user experience.

Chapter 4 examines the impact of different sensory modalities on worker reaction times in augmented reality warnings within roadway work zones. The analysis of data from experiments provides insights into the effectiveness of various warning modalities, including visual, audiovisual, haptic visual, and combined haptic audiovisual cues, in improving worker response times. The findings indicate that the haptic visual design elicited the fastest response on average among the participants, and its performance was comparable to that of the audio haptic visual design. Furthermore, both of these designs demonstrated significantly faster reaction times compared to visual and audiovisual warnings. The results also indicate that reaction times to augmented reality warnings in real-world outdoor scenarios were generally longer and exhibited greater variability compared to baseline desktop warnings and simulated AR in virtual reality. Surprisingly, VR simulated warnings did not show statistically significant shorter reaction times compared to their real-world counterparts. These observations suggest that simulating AR in virtual reality may not accurately replicate the reaction times observed in real-world situations.

Collectively, the results from these chapters demonstrate the usability, perceived safety benefits, and potential for timely notifications offered by the proposed AR-based safety system. This research also contributes to establishing best practices for designing time-sensitive safety systems, prioritizing situational awareness, and implementing worker-centered design principles in AR safety systems. Ultimately, the findings have the potential to significantly enhance the safety of highway workers and the broader workforce operating in roadway work zones.

Defense Date and Time: 
Friday, July 14, 2023 - 11:30pm
Defense Location: 
https://charlotte-edu.zoom.us/j/91489062502?pwd=eUZpZWdwZjMyOHRkOHVLUU5neGhJZz09
Committee Chair's Name: 
Dr. Omidreza Shoghli
Committee Members: 
Dr. Hamed Tabkhi, Dr. Zachary Wartell, Dr. Nichole Morris, Dr. Mona Azarbayjani