Initialising ...
Initialising ...
Initialising ...
Initialising ...
Initialising ...
Initialising ...
Initialising ...
Nakayama, Hiromasa; Onodera, Naoyuki; Satoh, Daiki; Nagai, Haruyasu; Hasegawa, Yuta; Idomura, Yasuhiro
Journal of Nuclear Science and Technology, 16 Pages, 2022/03
We developed a local-scale high-resolution atmospheric dispersion and dose assessment system (LHADDAS) for safety and consequence assessment of nuclear facilities and emergency response to nuclear accidents or deliberate releases of radioactive materials in built-up urban areas. This system is composed of pre-processing of input files, main calculation by local-scale high-resolution atmospheric dispersion model using large-eddy simulation (LOHDIM-LES) and real-time urban dispersion simulation model based on a lattice Boltzmann method (CityLBM), and post-processing of dose-calculation by simulation code powered by lattice dose-response functions (SIBYL). LHADDAS has a broad utility and offers superior performance in (1) simulating turbulent flows, plume dispersion, and dry deposition under realistic meteorological conditions, (2) performing real-time tracer dispersion simulations using a locally mesh-refined lattice Boltzmann method, and (3) estimating air dose rates of radionuclides from air concentrations and surface deposition in consideration of the influence of individual buildings and structures. This system is promising for safety assessment of nuclear facilities as an alternative to wind tunnel experiments, detailed pre/post-analyses of a local-scale radioactive plume dispersion in case of nuclear accidents, and quick response to emergency situations resulting from deliberate release of radioactive materials by a terrorist attack in an urban central district area.
Onodera, Naoyuki; Idomura, Yasuhiro; Hasegawa, Yuta; Nakayama, Hiromasa
Dai-35-Kai Suchi Ryutai Rikigaku Shimpojiumu Koen Rombunshu (Internet), 3 Pages, 2021/12
A detailed wind simulation is very important for designing smart cities. Since a lot of tall buildings and complex structures make the air flow turbulent in urban cities, large-scale CFD simulations are needed. We develop a GPU-based CFD code based on a Lattice Boltzmann Method (LBM) with a block-based Adaptive Mesh Refinement (AMR) method. In order to reproduce real wind conditions, the wind condition and ground temperature of the mesoscale weather forecasting model are given as boundary conditions. In this research, a surface heat flux model based on the Monin-Obukhov similarity theory was introduced to improve the calculation accuracy. We conducted a detailed wind simulation in Oklahoma City. By executing this computation, wind conditions in the urban area were reproduced with good accuracy.
Hasegawa, Yuta; Aoki, Takayuki*; Kobayashi, Hiromichi*; Idomura, Yasuhiro; Onodera, Naoyuki
Parallel Computing, 108, p.102851_1 - 102851_12, 2021/12
The aerodynamics simulation code based on the lattice Boltzmann method (LBM) using forest-of-octrees-based block-structured local mesh refinement (LMR) was implemented, and its performance was evaluated on GPU-based supercomputers. We found that the conventional Space-Filling-Curve-based (SFC) domain partitioning algorithm results in costly halo communication in our aerodynamics simulations. Our new tree cutting approach improved the locality and the topology of the partitioned sub-domains and reduced the communication cost to one-third or one-fourth of the original SFC approach. In the strong scaling test, the code achieved maximum 
speedup at the performance of 2207 MLUPS (mega- lattice update per second) on 128 GPUs. In the weak scaling test, the code achieved 9620 MLUPS at 128 GPUs with 4.473 billion grid points, while the parallel efficiency was 93.4% from 8 to 128 GPUs.
Asahi, Yuichi; Hatayama, Sora*; Shimokawabe, Takashi*; Onodera, Naoyuki; Hasegawa, Yuta; Idomura, Yasuhiro
Proceedings of 2021 IEEE International Conference on Cluster Computing (IEEE Cluster 2021) (Internet), p.686 - 691, 2021/10
We develop a convolutional neural network model to predict the multi-resolution steady flow. Based on the state-of-the-art image-to-image translation model pix2pixHD, our model can predict the high resolution flow field from the set of patched signed distance functions. By patching the high resolution data, the memory requirements in our model is suppressed compared to pix2pixHD.
Onodera, Naoyuki; Idomura, Yasuhiro; Hasegawa, Yuta; Nakayama, Hiromasa; Shimokawabe, Takashi*; Aoki, Takayuki*
Boundary-Layer Meteorology, 179(2), p.187 - 208, 2021/05
Times Cited Count：2 Percentile：87.32(Meteorology & Atmospheric Sciences)A plume dispersion simulation code named CityLBM enables a real time simulation for several km by applying adaptive mesh refinement (AMR) method on GPU supercomputers. We assess plume dispersion problems in the complex urban environment of Oklahoma City (JU2003). Realistic mesoscale wind boundary conditions of JU2003 produced by a Weather Research and Forecasting Model (WRF), building structures, and a plant canopy model are introduced to CityLBM. Ensemble calculations are performed to reduce turbulence uncertainties. The statistics of the plume dispersion field, mean and max concentrations show that ensemble calculations improve the accuracy of the estimation, and the ensemble-averaged concentration values in the simulations over 4 km areas with 2-m resolution satisfied factor 2 agreements for 70% of 24 target measurement points and periods in JU2003.
Hasegawa, Yuta; Aoki, Takayuki*; Kobayashi, Hiromichi*; Idomura, Yasuhiro; Onodera, Naoyuki
Keisan Kogaku Koenkai Rombunshu (CD-ROM), 26, 6 Pages, 2021/05
We introduce an improved domain partitioning method called "tree cutting approach" for the aerodynamics simulation code based on the lattice Boltzmann method (LBM) with the forest-of-octrees-based local mesh refinement (LMR). The conventional domain partitioning algorithm based on the space-filling curve (SFC), which is widely used in LMR, caused a costly halo data communication which became a bottleneck of our aerodynamics simulation on the GPU-based supercomputers. Our tree cutting approach adopts a hybrid domain partitioning with the coarse structured block decomposition and the SFC partitioning in each block. This hybrid approach improved the locality and the topology of the partitioned sub-domains and reduced the amount of the halo communication to one-third of the original SFC approach. The code achieved 
speedup on 8 GPUs, and achieved 
speedup at the performance of 2207 MLUPS (mega-lattice update per second) on 128 GPUs with strong scaling test.
Onodera, Naoyuki; Idomura, Yasuhiro; Hasegawa, Yuta; Shimokawabe, Takashi*; Aoki, Takayuki*
Keisan Kogaku Koenkai Rombunshu (CD-ROM), 26, 3 Pages, 2021/05
We develop a mixed-precision preconditioner for the pressure Poisson equation in a two-phase flow CFD code JUPITER-AMR. The multi-grid (MG) preconditioner is constructed based on the geometric MG method with a three- stage V-cycle, and a cache-reuse SOR (CR-SOR) method at each stage. The numerical experiments are conducted for two-phase flows in a fuel bundle of a nuclear reactor. The MG-CG solver in single-precision shows the same convergence histories as double-precision, which is about 75% of the computational time in double-precision. In the strong scaling test, the MG-CG solver in single-precision is accelerated by 1.88 times between 32 and 96 GPUs.
Asahi, Yuichi; Hatayama, Sora*; Shimokawabe, Takashi*; Onodera, Naoyuki; Hasegawa, Yuta; Idomura, Yasuhiro
Keisan Kogaku Koenkai Rombunshu (CD-ROM), 26, 4 Pages, 2021/05
We develop a convolutional neural network model to predict the multi-resolution steady flow. Based on the state-of-the-art image-to-image translation model Pix2PixHD, our model can predict the high resolution flow field from the signed distance function. By patching the high resolution data, the memory requirements in our model is suppressed compared to Pix2PixHD.
Onodera, Naoyuki; Idomura, Yasuhiro; Hasegawa, Yuta; Yamashita, Susumu; Shimokawabe, Takashi*; Aoki, Takayuki*
Proceedings of International Conference on High Performance Computing in Asia-Pacific Region (HPC Asia 2021) (Internet), p.120 - 128, 2021/01
Times Cited Count：0 Percentile：0.01We develop a multigrid preconditioned conjugate gradient (MG-CG) solver for the pressure Poisson equation in a two-phase flow CFD code JUPITER. The MG preconditioner is constructed based on the geometric MG method with a three-stage V-cycle, and a RB-SOR smoother and its variant with cache-reuse optimization (CR-SOR) are applied at each stage. The numerical experiments are conducted for two-phase flows in a fuel bundle of a nuclear reactor. The MG-CG solvers with the RB-SOR and CR-SOR smoothers reduce the number of iterations to less than 15% and 9% of the original preconditioned CG method, leading to 3.1- and 5.9-times speedups, respectively. The obtained performance indicates that the MG-CG solver designed for the block-structured grid is highly efficient and enables large-scale simulations of two-phase flows on GPU based supercomputers.
Hasegawa, Yuta; Onodera, Naoyuki; Idomura, Yasuhiro
Dai-34-Kai Suchi Ryutai Rikigaku Shimpojiumu Koen Rombunshu (Internet), 3 Pages, 2020/12
We developed a real-time ensemble simulation code for analyzing urban wind conditions and plume dispersion using a locally mesh-refined lattice Boltzmann method. We validated the developed code against the wind tunnel experiment by AIST, and against the field experiment JU2003 in Oklahoma City. In the case of the wind tunnel experiment, the wind condition showed a good agreement with the experiment, and 61.2% of the tracer gas concentration data observed on the ground satisfied the FACTOR2 condition, that is an accuracy criterion given by the environmental assessment guideline. In the case of the field experiment JU2003, the instantaneous wind speed showed a good agreement with the experiment, while the wind direction showed a difference up to 100
. The means of the tracer gas concentration satisfied the FACTOR2 condition at all observation interval. These results demonstrate that the developed code is accurate enough for the environmental assessment.
Onodera, Naoyuki; Idomura, Yasuhiro; Asahi, Yuichi; Hasegawa, Yuta; Shimokawabe, Takashi*; Aoki, Takayuki*
Dai-34-Kai Suchi Ryutai Rikigaku Shimpojiumu Koen Rombunshu (Internet), 2 Pages, 2020/12
We develop a multigrid preconditioned conjugate gradient (MG-CG) solver for the pressure Poisson equation in a two-phase flow CFD code JUPITER. The code is written in C++ and CUDA to keep the portability on multi-platforms. The main kernels of the CG solver achieve reasonable performance as 0.4 
0.75 of the roofline performances, and the performances of the MG-preconditioner are also reasonable on NVIDIA GPU and Intel CPU. However, the performance degradation of the SpMV kernel on ARM is significant. It is confirmed that the optimization does not work if any functions are included in the loop.
Kawamura, Takuma; Hasegawa, Yuta; Idomura, Yasuhiro
Proceedings of Joint International Conference on Supercomputing in Nuclear Applications + Monte Carlo 2020 (SNA + MC 2020), p.187 - 192, 2020/10
In order to realize the atmospheric dispersion prediction of pollutants, a fluid simulation by adaptive mesh refinement (AMR) optimized for GPU supercomputer has been developed, and interactive visualization and parameter steering of the simulation results are needed. In this study, we extend particle-based in-situ visualization method for structured grids into AMR, and enables in-situ steering of the simulation parameters by utilizing an in-situ control mechanism via files. By combining the developed method with plume dispersion simulation in urban areas running on a GPU platform, it was shown that human-in-the-loop pollution source search is possible without enormous parameter scanning.
Hasegawa, Yuta; Onodera, Naoyuki; Idomura, Yasuhiro
Proceedings of Joint International Conference on Supercomputing in Nuclear Applications + Monte Carlo 2020 (SNA + MC 2020), p.236 - 242, 2020/10
The wind condition and the plume dispersion in urban areas are strongly affected by buildings and plants, which are hardly described in the conventional mesoscale simulations. To resolve this issue, we developed a GPU-based CFD code using a mesh-refined lattice Boltzmann method (LBM), which enables real-time plume dispersion simulations with a resolution of several meters. However, such high resolution simulations are highly turbulent and the time histories of the results are sensitive to various simulations conditions. In order to improve the reliability of such chaotic simulations, we developed an ensemble simulation approach, which enables a statistical estimation of the uncertainty. We examined the developed code against the field experiment JU2003 in Oklahoma City. In the comparison, the wind conditions showed good agreements, and the average values of the tracer gas concentration satisfied the factor 2 agreements between the ensemble simulation data and the experiment.
Itoi, Hiroyuki*; Ninomiya, Takeru*; Hasegawa, Hideyuki*; Maki, Shintaro*; Sakakibara, Akihiro*; Suzuki, Ryutaro*; Kasai, Yuto*; Iwata, Hiroyuki*; Matsumura, Daiju; Owada, Mao*; et al.
Journal of Physical Chemistry C, 124(28), p.15205 - 15215, 2020/07
Times Cited Count：4 Percentile：61.86(Chemistry, Physical)Hasegawa, Yuta; Onodera, Naoyuki; Idomura, Yasuhiro
Keisan Kogaku Koenkai Rombunshu (CD-ROM), 25, 4 Pages, 2020/06
We developed a GPU-based CFD code using a mesh-refined lattice Boltzmann method (LBM), which enables ensemble simulations for wind and plume dispersion in urban cities. The code is tuned for Pascal or Volta GPU architectures, and is able to perform real-time wind simulations with several kilometers square region and several meters of grid resolution. We examined the developed code against the field experiment JU2003 in Oklahoma City. In the comparison, wind conditions showed good agreements, and the ensemble-averaged and maximum values of tracer concentration satisfied the factor 2 agreements.
Aoki, Takayuki*; Hasegawa, Yuta
Jidosha Gijutsu, 74(4), p.18 - 23, 2020/04
Aerodynamics studies for bicycle racings have been carried out by using a CFD simulation based on LES model. For running of alone cyclist and 2-4 cyclists groups, the computational drags are in good agreement with the wind-tunnel experiments. Different shapes of group running and competing two teams are studied. A large-scale computation for a group of 72 cyclists has been performed by using 2.23 billion meshes on a GPU supercomputer.
Sako, Hiroyuki; Sugimura, Hitoshi; Ahn, J. K.*; Han, Y.*; Hasegawa, Shoichi; Hwang, S. H.*; Ichikawa, Yudai; Imai, Kenichi; Kiuchi, Ryuta*; Ozawa, Kyoichiro; et al.
Nuclear Instruments and Methods in Physics Research A, 763, p.65 - 81, 2014/11
Times Cited Count：5 Percentile：43.74(Instruments & Instrumentation)We developed a prototype TPC for an H-dibaryon search experiment at J-PARC. To investigate its performance, we conducted tests with Ar-CH
(90:10) and Ar-CF (95:5), where the former is mainly used. The detection efficiency was measured to be 98% at the beam rate up to 
cps/cm
, and 90% at the rate of 
cps/cm. Based on the measured horizontal resolution of 0.19-0.46 mm at the drift length of 5-20 cm, the position resolution of better than 0.3 mm is estimated in 1 T magnetic field. The ion backflow fraction was measured to be 5% and reduced up to 3% at the gain of 
. The horizontal position distortion due to ion backflow in the gate operation was suppressed within 
mm at the beam rates up to cps/cm. On the other hand, the distortion with the gate open was measured to be 
mm. The distortion in the final experiment is estimated to be 
mm.
Sako, Hiroyuki; Ahn, J. K.*; Baek, K. H.*; Bassalleck, B.*; Fujioka, H.*; Guo, L.*; Hasegawa, Shoichi; Hicks, K.*; Honda, R.*; Hwang, S. H.*; et al.
Journal of Instrumentation (Internet), 9(4), p.C04009_1 - C04009_10, 2014/04
Times Cited Count：3 Percentile：18.85(Instruments & Instrumentation)A TPC has been developed for J-PARC E42 experiment to search for H-dibaryon in (
, 
) reaction. An event with 2 
and 2 protons decaying from H-dibaryon is searched for inside the TPC. The TPC has octagonal prism shape drift volume with about 50 cm diameter with 55 cm drift length filled with Ar-CH (90:10) gas. At the end of the drift volume, 3-layer GEMs are equipped. In order to analyze momenta of produced particles, the TPC is applied with 1 T dipole magnetic field parallel to the drift electric field with a superconducting Helmholz magnet. In order to maximize the acceptance of H-dibaryon events, a diamond target is installed inside the TPC drift volume, in a cylindrical hole opened from the top to the middle of the drift volume. Since extremely high-rate beam is directly injected into the TPC drift volume to the target, a gating grid and GEMs are adopted to suppress positive-ion feedback.
H hypernucleus by the 
Li(
) reaction at 
- = 1.2 GeV/
Sugimura, Hitoshi; Imai, Kenichi; Sako, Hiroyuki; Sato, Susumu; Kiuchi, Ryuta; Ichikawa, Yudai; Hwang, S. H.*; Hasegawa, Shoichi; Tanida, Kiyoshi; J-PARC E10 Collaboration*
Physics Letters B, 729, p.39 - 44, 2014/02
Times Cited Count：28 Percentile：88.47(Astronomy & Astrophysics)We have carried out an experiment to search for a neutron-rich hypernucleus, 
H, by the Li(
,K
) reaction at p
= 1.2 GeV/c. The obtained missing-mass spectrum with an estimated energy resolution of 3.2 MeV (FWHM) showed no peak structure corresponding to the H hypernucleus neither below nor above the 
H+2n particle decay threshold. An upper limit of the production cross section for the bound H hypernucleus was estimated to be 1.2 nb/sr at 90% confidence level.
Shibanuma, Kiyoshi; Arai, Takashi; Hasegawa, Koichi; Hoshi, Ryo; Kamiya, Koji; Kawashima, Hisato; Kubo, Hirotaka; Masaki, Kei; Saeki, Hisashi; Sakurai, Shinji; et al.
Fusion Engineering and Design, 88(6-8), p.705 - 710, 2013/10
Times Cited Count：8 Percentile：59.34(Nuclear Science & Technology)