Skip to main content
UNITED STATES DEPARTMENT OF LABOR

Effectiveness of VR-based training on improving construction workers’ knowledge, skills, and safety behavior in robotic teleoperation (Adami et al., 2021)

Review Guidelines

Causal Evidence Guidelines

Absence of conflict of interest.

Citation

Adami, P., Rodrigues, P. B., Woods, P. J., Becerik-Gerber, B., Soibelman, L., Copur-Gencturk, Y., & Lucas, G. (2021). Effectiveness of VR-based training on improving construction workers’ knowledge, skills, and safety behavior in robotic teleoperation. Advanced Engineering Informatics, 50, 1-13. https://doi.org/10.1016/j.aei.2021.101431

Highlights

  • The study's objective was to examine the impact of virtual reality (VR)-based training for the operation of a demolition robot on knowledge acquisition, safety behavior, and operational skills. 
  • The study was a randomized controlled trial that assigned adult construction workers to either VR-based training or an in-person training. Data sources included surveys, knowledge assessments, and trainer ranking and observation data. The authors used statistical analyses to compare the outcomes between the groups. 
  • The study found that workers receiving the VR-based training had significantly higher short-term gains in knowledge, safety behavior and operational skills than workers receiving the in-person training.  
  • This study receives a high evidence rating. This means we are confident that the estimated effects are attributable to virtual reality (VR)-based training and not to other factors.  

Intervention Examined

Virtual Reality (VR)-based Training

Features of the Intervention

Virtual reality (VR) training offers a safe and immersive way for construction workers to gain hands-on experience. The present study examined a VR-based training for construction workers operating a demolition robot. The two-hour training included the use of a remote control, a head-mounted display for full immersion, and a treadmill to navigate a virtual construction site. The VR environment replicates real construction site conditions, such as weather, dust, terrain, and interactions with other workers and objects. This simulation allows workers to receive real-time feedback on their decisions while operating the robot. Seven interactive learning modules were created in English and Spanish. The training was developed using principles of adult learning theory and underwent thorough review by experts.  

Features of the Study

The study was a randomized controlled trial that examined the impact of virtual reality (VR)-based training for the operation of a demolition robot on knowledge acquisition, safety behavior, and operational skills. Fifty construction workers (48 male, 2 female) from on-campus projects at the University of Southern California were recruited to participate. After completion of a baseline survey and pre-training knowledge assessment, the participants were randomly assigned to either receive the VR-based training (treatment group) or the in-person training (control group). The in-person training mirrored the content of the VR-based training, but the format included an instructor demonstration followed by a brief practice session with the robot. After the training, study participants completed a post-training written knowledge assessment and 30-minute performance assessment in which they operated the actual demolition robot and completed a series of tasks. An expert trainer observed and rated their operational skills and safety behavior. 

All study participants were adults over 18, with different levels of experience (44% had less than five years of construction experience and 26% had over 10 years). The group was evenly split between English and Spanish speakers. Approximately one-third were under 30 years old, while 28% were over 50. Nearly half of the participants (48%) had a high school diploma, 38% had less than a high school diploma, and 14% had a college degree. Only one participant had any experience with a demolition robot, and it was not the specific model used in the study. 

Data sources included a demographic survey, pre- and post-knowledge assessments, and expert trainer ranking and observation data from the performance assessment. The authors used statistical analyses to compare the post-training outcomes between the treatment and control group members.  

Findings

Health and safety  

  • The study found that the average gain in short-term knowledge was significantly greater for the VR-trained construction workers (60.2%) than those in the control group (39.6%).  
  • In the performance assessment after the training, the VR-trained construction workers exhibited significantly more safety behaviors (2.6 mean assessment rating) than the control group (2.3 mean assessment rating). 
  • The VR-trained construction workers also displayed significantly more operational skills (2.7 mean assessment rating) than the control group (2.3 mean assessment rating). 

Considerations for Interpreting the Findings

The sample size was small and may have been underpowered to test how age, experience, education, and language influenced the findings.  

Causal Evidence Rating

The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to the VR-based training for operating the demolition robot and not to other factors.

Reviewed by CLEAR

January 2025