Development of AR-based scanning support system for 3D model reconstruction of work sites

原園 友規*; 石井 裕剛*; 下田 宏*; 樽田 泰宜   ; 香田 有哉 

Harazono, Yuki*; Ishii, Hirotake*; Shimoda, Hiroshi*; Taruta, Yasuyoshi; Koda, Yuya

Three-dimensional (3D) reconstruction models are useful for many situations in maintenance and decommissioning work at nuclear power plants (NPPs). For construction of 3D reconstruction models, it is desirable that they be constructed from images obtained by scanning work sites with a camera because such scanning is easier and less costly than with other devices such as laser scanner. Nevertheless, when scanning with a camera, it is difficult for users to scan with being conscious of the appropriate scanning techniques and unscanned areas. Users who have no knowledge about scanning with a camera therefore have difficulty scanning work sites and capturing enough images to construct accurate 3D reconstruction models of them. In this study, we aim to develop a scanning support system using augmented reality (AR). The system enables users to construct 3D reconstruction models with few unscanned areas, even in very complicated environments such as work sites at NPPs. Moreover, this system detects and visualizes the current scanning status to remind and encourage users to scan as few unscanned areas as possible. For this study, we evaluated the scanning support system effectiveness. We asked many beginner users to use the developed system and the scanning system with no support (non-support system) to scan an indoor environment and compared the performance of these two systems. Results demonstrated that the developed system can scan larger areas and that it can capture more useful images to construct 3D reconstruction models than the non-support system. We also conducted an evaluation experiment at an actual NPP work site to ascertain whether the scanning support system is effective, even at an actual work site at an NPP. For this evaluation experiment, we asked NPP workers to scan the work site with the developed system and the non-support system. Results showed that the developed system can scan larger areas, even at an actual work site.