Advanced Adaptive Spatial Augmented Reality utilizing Dynamic in-situ Projection in Industrial Site Assembly

Abstract

An Adaptive Spatial Augmented Reality system with dynamic in-situ projection of work instructions and information guidance already shows benefits in the field of industrial site assembly of aircraft components. Furthermore, the user-adaptive gesture control offers advantages for a human-centered and natural interaction directly in the assembly process. This paper presents results of enhancing dynamic in-situ projection, information guidance and user-adaptive gesture interaction in an advanced assembly process of large-sized toy building bricks. For this purpose, the dynamic projection system displays the location of the bricks in the material provision area as well as the accurate mounting position and dynamically guides the operator through the assembly process. Furthermore, the optimized gesture interaction with YOLO and an optimized synthetic dataset creation process for site assembly, indicate strong intentions for user-adaptive interaction with the projection system. An evaluation in the TU Wien pilot factory demonstrates benefits in terms of time savings in locating parts, usability and cognitive workload.