TunnelSkills – the national specialist training forum for the UK tunnelling industry – specialises in the application of immersive learning and new technology to improve training, learning and recruitment in the sector.

Preparing personnel for working below-ground in tunnelling has always been a challenge for the industry. Exposing learners to training in a live and active work environment can be potentially hazardous. Immersive technology offers total engagement in a simulated environment for deeper understanding and better learning, while removing the need to gain access.

In an increasingly modern world, we are seeing the ways in which technology can continually improve and streamline processes to be faster, safer and smarter. Using immersive learning tools such as Virtual Reality (VR) and Augmented Reality (AR) for training is nothing new. Training for those in potentially hazardous professions such as maintenance crews on offshore oil rigs or airline pilots has included the use of new technologies for many years. However, in recent years, there have been considerable advancements to the technology and, more specifically, the hardware. With the advancement of hardware such as the Oculus Quest virtual reality headset, for example, a full range of interactive motion became possible in what is known as 6DoF (six degrees of freedom). This enables the end user to use both hands for interactions and have a full range of motion within a 360-degree virtual world.

Immersive learning is an experiential training methodology that uses virtual reality and augmented reality to simulate real-world scenarios and train employees in a safe and engaging immersive training environment. It combines a sense of presence with spatial design to improve effectiveness and user engagement, putting learners in an immersive, realistic environment where they can practice spotting hazards and make decisions that are safe. It provides an effective tool for influencing the safe behaviour of team members in a scalable way.

A COLLABORATIVE PROJECT PARTNERSHIP LED BY TUNNELSKILLS

TunnelSkills is the National Specialist Training Forum for the Tunnelling Industry. Formed in 2008, TunnelSkills’ primary objective is to benchmark safety and competence for all in the underground environment by promoting competence via on-site training and assessment leading to recognised accredited qualifications. As a membership-based organisation representing and supporting its members across the UK tunnelling sector, TunnelSkills was keen to explore the potential for immersive learning technology to enhance the quality of tunnelling training.

In 2018, TunnelSkills came up with the idea of investigating the potential for bringing the benefits of immersive learning to the world of tunnelling training. TunnelSkills formed a collaborative partnership including main contractors, with major projects such as Tideway and HS2, and with digital technology companies, Make Real, Pauley and FULmax, to devise a project plan. This collaborative partnership consulted with the Construction Industry Training Board (CITB) and submitted a successful application to the CITB’s Flexible Fund.

Funding support was agreed, which enabled the project to commence in 2019. Tom Lane, Chair of TunnelSkills when the project was conceived, played a major role in seeing it through. He explains why the project is so important for the industry: “In tunnelling, we’re dealing with environments which are hard to understand and visualise, especially when only using presentations, diagrams or photographs. Immersive learning technologies have provided us with a game-changing opportunity to address challenges of sufficiently simulating or recreating the tunnelling environment for workers to develop the behaviours and competencies required to work in such environments.

The resources we are developing will also give those looking at tunnelling as a career a tangible, ‘real-world’ experience of being in a tunnelling environment. The range of immersive assets in development will provide high-quality, freely-available resources to benefit the whole of the tunnelling industry.” Lane then goes on to highlight the benefits and aims of the project, “These resources will give stakeholders a realistic, consistent and safe environment replicating tunnelling environments and equipment. The aim is that these resources will be embedded across a broad range of qualifications and courses associated with tunnelling, delivered to a range of beneficiaries and made freely available to the sector. Research shows that people learn much quicker by doing, and this immersive technology holds the attention for longer and embeds learning  by promoting competence via on-site training and assessment leading to recognised accredited qualifications.

As a membership-based organisation representing and supporting its members across the UK tunnelling sector, TunnelSkills was keen to explore the potential for immersive learning technology to enhance the quality of tunnelling training. In 2018, TunnelSkills came up with the idea of investigating the potential for bringing the benefits of immersive learning to the world of tunnelling training. TunnelSkills formed a collaborative partnership including main contractors, with major projects such more effectively. It allows people to practice real-life scenarios, such as the safe evacuation procedure in the event of a fire in the tunnel.”

INNOVATIVE LEARNING RESOURCES DEVELOPED BY THE PROJECT

The TunnelSkills Immersive Learning Project utilises a mix of VR and AR apps and scenarios across a range of immersive learning teaching resources; these include interactive 360-degree film with a choice of userinterface ‘Explore’ mode or ‘Guided Tour’ mode, digital models, and an introduction to the past and present of tunnelling with insights from professionals within the industry.

On the VR side, there are four VR applications. The apps were developed for the Oculus Quest; Quest and Quest 2 headsets, as well as the FULmax BIM CAVE. Two of the applications take the form of game-like interactive scenarios, while the other two offer more cinematic experiences. All four VR applications have the common goal of promoting awareness of tunnelling environments, the hazards associated with them, and the health and safety considerations you need to be aware of when working underground.

Augmented reality (AR) layers virtual content, such as digital objects or information, onto a real-world image. As AR interacts with physical environments, factors such as lighting and surface detection integrate virtual and actual reality. The overlaid 3D information is a seamless, immersive integration into the real environment. It allows users to view a perception of the real work where they could not normally have access to due to safety, costs, time and access restrictions. It allows for group-based learning and communication where it can foster interest and increase engagement. It enables free movement around environments and objects where it would not be possible in real life. It can be used to complement existing training activities.

The TunnelSkills Immersive Learning AR application is deployed through Microsoft Hololens hardware. The Microsoft HoloLens is a pair of mixed reality smart glasses comprising a head-mounted display that allows the user to place a hologram in the real world where they can view and interact with the hologram via the device.

The AR resources developed through the project include two interactive scenarios covering Safety in Tunnelling and Tunnel Emergencies. The AR app  was designed to promote awareness of tunnelling environments, access arrangements, emergencies and health and safety considerations when working above and below ground. A flavour of the AR resources can be seen in a case study on the Pauley website here 

These AR and VR resources come with downloadable, tailored, user guides to support those embarking on their AR and VR experience. The user guides include brief hardware guides, a description of the scenarios, and support/help topics. There are also individual VR and AR ‘Frequently Asked Questions’ sections to further support users, available on the TunnelSkills website. 

This includes advice on how the apps can be used and how to purchase and manage a larger fleet of headsets: for example, if an organisation wishes to incorporate these resources into project inductions, company inductions or industry behavioural safety training programmes.

INCREASED RESOURCE VERSATILITY – OTHER WAYS TO EXPERIENCE VR AND AR RESOURCES

The original project plan included dissemination activities, including taking the headsets into workplaces to trial the prototype apps; working with training providers of industry-specific training to embed the apps into their programmes; and taking headsets into schools and other educational settings. The Covid pandemic struck mid-way through the project’s two year timeline. The subsequent concerns around touching and sharing of equipment, and the necessary close contact required to support those using the headsets meant that this approach had to be reviewed.

In re-thinking the dissemination and application of the resources, TunnelSkills worked with Make Real, the digital tech partner that developed the VR apps to find a solution. TunnelSkills also linked with Fulcro, which is a multidisciplinary and interdisciplinary technical specialist in 3D technology for the design and build sector, to utilise its FULmax BIM CAVE technology which enables teams to stand inside VR at life-size without wearing head-mounted displays.

The VR apps have been enhanced to develop the original prototypes with  a view to using the 360-degree videos in wider-ranging environments, rather than relying solely on the use of individual headsets. This involved the development of a ‘Guided Tour’ facility, using industry-approved commentary to add to the existing ‘User-Interface’ / ‘Explore’ capability. This guided-tour facility will be incorporated into the 360-degree video and enable the resulting video experiences to be used in the FULmax CUBE. The FULmax CUBE is an immersive, interactive, and collaborative virtual environment without the requirement for individual headsets, so provides a Covid-safe way for teams and learners to interact with the TunnelSkills content and each other.

In addition, web-based versions of some of the AR and VR apps are available to access the resources via monitors or screens. Although the full immersive experience is limited by viewing on a two-dimensional screen, you can still interact with the content on-screen to appreciate the 360-degree environment. This method avoids the use of headsets and enables groups of learners and users to view in a collaborative and shared setting, thereby increasing the versatility of the resources. Two of the tunnelling VR apps are available in web based versions. Readers can view and interact with these versions (Apps 3 and 4) via the links on the VR Resources TunnelSkills webpage here. 

INDUSTRY RESPONSE TO RESOURCES AND FUTURE OF IMMERSIVE LEARNING IN TUNNELLING

The resources developed by the project have been trialled by industry partners to provide evaluation and feedback. Gerry Keigher from Tunnelcraft states: “We used the headsets with several colleagues at Tunnelcraft – all seasoned tunnelling professionals, and they expressed their surprise at the exceptional immersive experience. The emergency response scenario generated the most praise for its realism. The advancement of this technology is an exciting and beneficial step for our industry.” Tunnelcraft has decided to invest in its own fleet of headsets to incorporate the resources into its underground and tunnelling training programme.

Tunnelling contractors on some of the largest current projects in the UK are starting to see the value in the use of these resources, using them not only with staff who may be unfamiliar with the below-ground tunnelling environment, but also within their work-experience programmes. Local schools and future apprentices are being supported to get a taste for a career underground.

There is also the intention to incorporate the resources into inhouse delivery of tunnel safety and other training. Immersive learning provides remarkable capabilities for collaboration, training, learning and sharing experiences as a team, despite distance. In the construction sector, this capability is still in its infancy. There will be many companies that will be able to develop further VR and AR uses and content to meet their needs at project, joint venture or individual company levels. Neil Hancox, current Chair of TunnelSkills, is positive about the benefits for the tunnelling industry: “This project is a fantastic springboard to embrace new technology within our sector to improve and progress. With this set of ready-made resources, organisations can make use of the materials to enhance their existing training and outreach activities, assess the value and make informed decisions about how they can use these new technologies moving forward. In the three years since the conception and commencement of the TunnelSkills project, technology has continued to advance and now with new cameras, headsets and other hardware, this makes it increasingly cost effective and efficient to create and showcase more and more immersive collateral. TunnelSkills is keen to engage with those interested in learning more and we can offer advice and support with the resources.”

FURTHER INFORMATION