Microscopic origin of the spin-reorientation transition in the kagome topological magnet TbMnSn

Huang, Z.*; Wang, W.*; Ye, H.*; Bao, S.*; Shangguan, Y.*; Liao, J.*; Cao, S.*; Kajimoto, Ryoichi  ; Ikeuchi, Kazuhiko*; Deng, G.*; Smidman, M.*; Song, Y.*; Yu, S.-L.*; Li, J.-X.*; Wen, J.*

TbMnSn is a correlated topological magnet with a Mn-based kagome lattice, in which a Chern gap opens at the Dirac point at low temperatures. The magnetic moment direction of the ferrimagnetic order changes from in the kagome plane to the out-of-plane upon cooling, which is essential for generating the Chern gap, but the underlying mechanism for the spin reorientation remains elusive. Here, we investigate the spin-reorientation transition in TbMnSn using neutron scattering. We provide direct evidence for the spin-reorientation transition and unveil the coexistence of two Tb modes at 200 K. To account for these results, we put forward a model based on SU(N) spin-wave theory, in which there is a temperature evolution of the ground state Tb orbitals, driven by the crystalline electric field, single-ion anisotropy, and exchange interactions between Tb and Mn ions. Our findings shed light on the complex magnetism of TbMnSn, despite its relatively simple ground state magnetic structure, and provide insights into the mechanisms for tuning magnetic topological materials.