Layered semiconductor CrSBr has drawn much attention due to its two-dimensional magnetic orders and strong multiphysics couplings. Herein, the electron dynamics of CrSBr (few layers to tens of nanometers) is investigated by time-resolved photoemission electron microscopy with various photoexciting conditions. The valence electrons around the Γ point are considered to be excited along the Γ-Y direction and scattered with phonons along the nearly flat conduction band in the Γ-X direction. The relaxation lifetime of photoelectrons decreases from ∼11 ps at 100 K to ∼2 ps at room temperature, presenting strong electron–phonon coupling in CrSBr. The lifetime is also found to be independent of pump polarization, which implies that the excited-state electrons follow the identical relaxation channel, although CrSBr possesses great anisotropy.