Augmented-reality system for training of heavy-equipment operators in surface mining

The mining industry’s commitment to innovation reflects a history of adopting technological advancements to enhance workplace safety, environmental sustainability and vocational training. The objective of this research was to develop an augmented- reality (AR) system for heavy-equipment operators (HEOs) in surface mining. The developed system has the potential to enhance mine safety, training and data-driven decision- making, which presents a significant step toward a more sustainable, effective and technologically driven mining training, contributing to the industry’s evolution and growth. The AR training system leverages Microsoft’s Power Platform and HoloLens 2 capacities to provide operators with detailed and immersive training guides for three mining equipment, including bulldozers, motor graders and haul trucks. AR guides combine speech controls, 3D objects, informative images and explicative videos in the real working conditions to enhance the operator’s learning process. The system has the potential to modify the training structure based on user performance and provides an efficient approach to data collection during training. This project was developed and applied through a case study in a surface mine in the Southern United States.