Deep learning-based bubble detection with Swin Transformer

Uesawa, Shinichiro; Yoshida, Hiroyuki

Journal of Nuclear Science and Technology, 61(11), p.1438 - 1452, 2024/11

https://doi.org/10.1080/00223131.2024.2348023

We developed a deep learning-based bubble detector with a Shifted window Transformer (Swin Transformer) to detect and segment individual bubbles among overlapping bubbles. To verify the performance of the detector, we calculated its average precision (AP) with different number of training images. The mask AP increased with the increase in the number of training images when there were less than 50 images but remained constant when there were more than 50 images. It was observed that the AP for the Swin Transformer and ResNet were almost the same when there were more than 50 images; however, when few training images were used, the AP of the Swin Transformer were higher than that of the ResNet. Furthermore, with regard to the increase in void fraction, the AP of the Swin Transformer showed a decrease similar to that in the case of the ResNet; however, for few training images, the AP of the Swin Transformer was higher than that of the ResNet in all void fractions. Moreover, we confirmed the detector trained with synthetic bubble images was able to segment overlapping bubbles and deformed bubbles in a bubbly flow experiment. Thus, we verified that the new bubble detector with Swin Transformer provided higher AP than the detector with ResNet for fewer training images.

Development of a surrogate system of a plant dynamics simulation model and an abnormal situation identification system for nuclear power plants using deep neural networks

Seki, Akiyuki; Yoshikawa, Masanori; Nishinomiya, Ryota*; Okita, Shoichiro; Takaya, Shigeru; Yan, X.

Nuclear Technology, 210(6), p.1003 - 1014, 2024/06

https://doi.org/10.1080/00295450.2023.2273566

Two types of deep neural network (DNN) systems have been constructed with the intent to assist safety operation of a nuclear power plant. One is a surrogate system (SS) that can estimate physical quantities of a nuclear power plant in a computational time of several orders less than a physical simulation model. The other is an abnormal situation identification system (ASIS) that can estimate the state of the disturbance causing an anomaly from physical quantities of a nuclear power plant. Both systems are trained and tested using data obtained from the analytical code for incore and plant dynamics (ACCORD), which reproduces the steady and dynamic behavior of the actual high Temperature engineering test reactor (HTTR) under various scenarios. The DNN models are built by adjusting, the main hyperparameters. Through these procedures, these systems are shown able to perform with a high degree of accuracy.

Attention-based time series analysis for data-driven anomaly detection in nuclear power plants

Dong, F.*; Chen, S.*; Demachi, Kazuyuki*; Yoshikawa, Masanori; Seki, Akiyuki; Takaya, Shigeru

Nuclear Engineering and Design, 404, p.112161_1 - 112161_15, 2023/04

https://doi.org/10.1016/j.nucengdes.2023.112161

Automatic object recognition using deep learning for legacy waste treatment

Yoshida, Yukihiko

IL Nuovo Cimento, 46(2), p.33_1 - 33_8, 2023/03

https://doi.org/10.1393/ncc/i2023-23033-x

Multi-resolution steady flow prediction with convolutional neural networks

Asahi, Yuichi; Hatayama, Sora*; Shimokawabe, Takashi*; Onodera, Naoyuki; Hasegawa, Yuta; Idomura, Yasuhiro

Keisan Kogaku Koenkai Rombunshu (CD-ROM), 26, 4 Pages, 2021/05

We develop a convolutional neural network model to predict the multi-resolution steady flow. Based on the state-of-the-art image-to-image translation model Pix2PixHD, our model can predict the high resolution flow field from the signed distance function. By patching the high resolution data, the memory requirements in our model is suppressed compared to Pix2PixHD.

Development of a GUI-based operation system for building a 3D point cloud classifier

Tanifuji, Yuta; Kawabata, Kuniaki; Hanari, Toshihide

Proceedings of 2019 IEEE Region Ten Conference (TENCON 2019) (Internet), p.36 - 40, 2019/10

Developing data driven analysis methods for extreme scale numerical simulations

Asahi, Yuichi; Maeyama, Shinya*; Bigot, J.*; Garbet, X.*; Grandgirard, V.*; Fujii, Keisuke*; Shimokawabe, Takashi*; Watanabe, Tomohiko*; Idomura, Yasuhiro; Onodera, Naoyuki; et al.

no journal, , 

We have established an in-situ data analysis method for large scale fluid simulation data and developed deep learning based surrogate models to predict fluid simulation results. Firstly, we have developed an in-situ data processing approach, which loosely couples the MPI application and python scripts. It has been shown that this approach is simple and efficient which offers the speedup of 2.7 compared to post hoc data processing. Secondly, we have developed a deep learning model for predicting multiresolution steady flow fields. The deep learning model can give reasonably accurate predictions of simulation results with orders of magnitude faster compared to simulations.

Development of AI system to support safety operation of nuclear power plants

Seki, Akiyuki; Yoshikawa, Masanori; Okita, Shoichiro; Takaya, Shigeru; Yan, X.

no journal, , 

Predicting plume concentrations in the urban area using a deep learning model

Asahi, Yuichi; Onodera, Naoyuki; Hasegawa, Yuta; Idomura, Yasuhiro

no journal, , 

We have developed a convolutional neural network (CNN) model to predict the plume concentrations in the urbanarea under uniform flow condition. By combining the Transformer or Multilayer Perceptron (MLP) layers with CNN model, our model can predict the plume concentrations from the building shapes, release points of plumeand time series data at observation stations.

Development of a deep learning model for predicting plume concentrations in the urban area

Asahi, Yuichi; Onodera, Naoyuki; Hasegawa, Yuta; Idomura, Yasuhiro

no journal, , 

We have developed a convolutional neural network (CNN) model to predict the plume concentrations in the urban area under uniform flow condition. By combining the Transformer or Multilayer Perceptron (MLP) layers with CNN model, our model can predict the plume concentrations from the building shapes, release points of plume and time series data at observation stations. It is also shown that the exactly same model can be applied to predict the source location, which also gives reasonable prediction accuracy.

Generating observation guided ensembles for data assimilation with denosing diffusion probabilistic model

Asahi, Yuichi; Hasegawa, Yuta; Onodera, Naoyuki; Shimokawabe, Takashi*; Shiba, Hayato*; Idomura, Yasuhiro

no journal, , 

This paper presents a data assimilation (DA) method using the pseudo ensembles generated by denoising diffusion probabilistic model. Since the model is trained against noisy and sparse observation data, this method can produce reasonable ensembles consistent with observations. This method displays better performance than well-established DA method when the simulation model is imperfect.