The excited state dynamics is always an important and challenging problem in condensed matter physics. The dynamics of excited carriers can have different relaxation channels, in which the complicated interactions between different quasi-particles come into play collectively. To understand such ultrafast processes, the ab initio investigations are essential. Combining the real-time time-dependent density functional theory with fewest switches surface hopping scheme, we develop time-dependent ab initio nonadiabatic molecular dynamics (NAMD) code Hefei-NAMD to simulate the excited carrier dynamics in condensed matter systems. Using this method, we investigate the interfacial charge transfer dynamics, the electron–hole recombination dynamics, and the excited spin-polarized hole dynamics in different condensed matter systems. Moreover, we combine ab initio nonadiabatic molecular dynamics with GW plus real-time Bethe-Salpeter equation for the spin-resolved exciton dynamics. We use it to study the spin-valley exciton dynamics in MoS₂. It provides a powerful tool for exciton dynamics in solid systems. The state-of-the-art NAMD studies provide a unique insight into a understanding of the ultrafast dynamics of the excited carriers in different condensed matter systems on an atomic scale.