With XR solutions to comprehensive learning success
To better integrate the learning experience into the training participants' environment, the ZVE team is working with TNO on XR-based solutions - such as real-time volumetric communication. This involves recording the training staff with a depth sensor camera. This live recording is rendered in the training participants' environment using an XR device such as an iPad Pro or Hololens 2. At the same time, the training participants are recorded with a normal, high-resolution webcam and played back on the trainer's TV screen. Audio on both sides is recorded via a speakerphone. The technology not only enables direct face-to-face interaction, which is experienced as very close to reality, but also helps the training participants to concentrate completely on the instructed activities instead of on the computer.
Another essential aspect is to monitor and ensure the safety of the training participants remotely. To this end, a multimodal sensor system is to be integrated into the mobile soldering station to monitor the learning environment. After evaluation of the acquired data, information and, in dangerous situations, a warning are to be projected into the field of vision of the instructor and the trainees.
The activities are funded within the framework of the High Performance Center »Secure Intelligent Systems« (LZSiS).