Constrained spherical deconvolution can quantify white matter fiber orientation distribution information from diffusion magnetic resonance imaging data. But this method is only applicable to single shell diffusion magnetic resonance imaging data and will provide wrong fiber orientation information in white matter tissue which contains isotropic diffusion signals. To solve these problems, this paper proposes a constrained spherical deconvolution method based on multi-model response function. Multi-shell data can improve the stability of fiber orientation, and multi-model response function can attenuate isotropic diffusion signals in white matter, providing more accurate fiber orientation information. Synthetic data and real brain data from public database were used to verify the effectiveness of this algorithm. The results demonstrate that the proposed algorithm can attenuate isotropic diffusion signals in white matter and overcome the influence of partial volume effect on fiber direction estimation, thus estimate fiber direction more accurately. The reconstructed fiber direction distribution is stable, the false peaks are less, and the recognition ability of cross fiber is stronger, which lays a foundation for the further research of fiber bundle tracking technology.