Image selection method from image sequence to improve computational efficiency of 3D reconstruction; Application of fixed threshold to remove redundant images

Hanari, Toshihide; Nakamura, Keita*; Imabuchi, Takashi; Kawabata, Kuniaki

Journal of Robotics and Mechatronics, 36(6), p.1537 - 1549, 2024/12

https://doi.org/10.20965/jrm.2024.p1537

This paper describes three-dimensional (3D) reconstruction processes introducing the image selection method for efficiently generating a 3D model from an image sequence. To obtain suitable images for efficient 3D reconstruction, we tried to apply the image selection method to remove the redundant images in the image sequence. By the proposed method, the suitable images were selected from the image sequence based on optical flow measures and a fixed threshold. As a result, the proposed method can reduce the computational cost for the 3D reconstruction processes based on the image sequence acquired by the camera. We confirmed that the computational cost of the 3D reconstruction processes can reduce while keeping the 3D reconstruction accuracy at a constant level.

Integration of multiple dense point clouds based on estimated parameters in photogrammetry with QR code for reducing computation time

Nakamura, Keita*; Baba, Keita*; Watanobe, Yutaka*; Hanari, Toshihide; Matsumoto, Taku*; Imabuchi, Takashi; Kawabata, Kuniaki

Artificial Life and Robotics, 29(4), p.546 - 556, 2024/09

https://doi.org/10.1007/s10015-024-00966-3

Investigation of the influence of the magnitude of camera vibration on 3D reconstruction results by photogrammetry based on simulation

Nakamura, Keita*; Hanari, Toshihide; Imabuchi, Takashi; Kawabata, Kuniaki

Proceedings of 2024 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2024), p.7 - 8, 2024/07

Photogrammetry is a technique for 3D reconstruction of target objects from multiple images shot of the object. In the case of actual photography, the object may not be reconstructed due to the inability to shoot images suitable for photogrammetry because of vibration in the camera's angle of view of the object. Therefore, we implement this vibration by using random numbers and verify the influence of the magnitude of the vibration on the reconstruction result obtained by photogrammetry. The verification results show the relationship between the magnitude of the vibration and the success rate of 3D reconstruction.

Rail DRAGON: Long-reach Bendable Modularized Rail Structure for Constant Observation inside PCV

Yokomura, Ryota*; Goto, Masataka*; Yoshida, Takehito*; Warisawa, Shinichi*; Hanari, Toshihide; Kawabata, Kuniaki; Fukui, Rui*

IEEE Robotics and Automation Letters (Internet), 9(4), p.3275 - 3282, 2024/04

https://doi.org/10.1109/LRA.2024.3366022

To reduce errors in the remote control of robots during decommissioning, we developed a Rail DRAGON, which enables continuous observation of the work environment. The Rail DRAGON is constructed by assembling and pushing a long rail structure inside the primary containment vessel (PCV), and then repeatedly deploying several monitoring robots on the rails to enable constant observation in a high-radiation environment. In particular, we have developed the following components of Rail DRAGON: bendable rail modules, straight rail modules, a basement unit, and monitoring robots. Concretely, this research proposes and demonstrates a method to realize an ultralong articulated structure with high portability and workability. In addition, it proposes and verifies the feasibility of a method for deploying observation equipment that can be easily deployed and replaced, while considering disposal.

A Study on the effects of photogrammetry by the camera angle of view using computer simulation

Nakamura, Keita; Hanari, Toshihide; Matsumoto, Taku; Kawabata, Kuniaki; Yashiro, Hiroshi*

Journal of Robotics and Mechatronics, 36(1), p.115 - 124, 2024/02

https://doi.org/10.20965/jrm.2024.p0115

Integration of multiple partial point clouds based on estimated parameters in photogrammetry with QR codes

Baba, Keita*; Watanobe, Yutaka*; Nakamura, Keita*; Matsumoto, Taku; Hanari, Toshihide; Kawabata, Kuniaki

Proceedings of 29th International Symposium on Artificial Life and Robotics (AROB 29th 2024) (Internet), p.751 - 756, 2024/01

Automatic system for sequential reconstruction from image sequences acquired from a camera by SfM-MVS

Matsumoto, Taku; Hanari, Toshihide; Kawabata, Kuniaki; Yashiro, Hiroshi*; Nakamura, Keita*

Proceedings of 2023 IEEE International Conference on Robotics and Biomimetics (IEEE ROBIO 2023) (Internet), 7 Pages, 2023/12

https://doi.org/10.1109/ROBIO58561.2023.10354841

Development of performance evaluation method for nuclear emergency response robot

Yamada, Taichi; Watanabe, Kaho; Suzuki, Soichiro; Kawabata, Kuniaki

Automation Systems, 39(464), p.88 - 92, 2023/09

In Fukushima Daiichi Nuclear Power Station (FDNPS) emergency response and decommissioning, high radiation or unknown environments significantly restrict human workers' activity. Thus, a remotely controlled robot is essential to operate in such an environment instead of human workers. However, remote robot operation is not easy, and it is required to understand the robot's capability, that is, what/how the robot can do on the site. Therefore, robot evaluation method development is important for remote robot operation in disaster sites. We survey the required capabilities for a remotely controlled robot from the remote operation cases in FDNPS and develop test methods to evaluate the capabilities. This paper introduces the survey of FDNPS remote operation cases and the test method development.

Integration of 3D environment models generated from the sections of the image sequence based on the consistency of the estimated camera trajectories

Matsumoto, Taku; Hanari, Toshihide; Kawabata, Kuniaki; Yashiro, Hiroshi*; Nakamura, Keita*

Proceedings of 22nd World Congress of the International Federation of Automatic Control (IFAC 2023) (Internet) , p.12107 - 12112, 2023/07

Development of test method for evaluation of UAS mobility capability in GNSS-denied environment

Yamada, Taichi; Abe, Hiroyuki*; Ogane, Katsuji*; Kawabata, Kuniaki

ROBOMECH Journal (Internet), 10, p.13_1 - 13_8, 2023/06

https://doi.org/10.1186/s40648-023-00251-1

Although Unmanned Aircraft System (UAS) has significant industrial potential, it is not easy to discuss how well UAS performs in places and situations where the UAS is deployed. Therefore, we designed the approach for UAS evaluation and developed the evaluation methods that make it possible to compare the UAS performances in easy-to-understand for UAS users, people without technical knowledge focusing on GNSS-denied environments. The development proceeded with the demonstration and discussion with UAS manufacturers and users, and we repeatedly improved the evaluation methods with their opinions. Finally, we confirm that the evaluation methods can describe the difference between the UAS's performance by an experiment.