By exploiting the non-Kolmogorov model and Rytov approximation theory, a propagation model of Bessel–Gaussian vortex beams (BGVB) propagating in a subway tunnel is derived. Based on the propagation model, a model of orbital angular momentum (OAM) mode probability distribution is established to evaluate the propagation performance when the beam propagates along both longitudinal and transverse directions in the subway tunnel. By numerical simulations and experimental verifications, the influences of the various parameters of BGVB and turbulence on the OAM mode probability distribution are evaluated, and the results of simulations are consistent with the experimental statistics. The results verify that the middle area of turbulence is more beneficial for the vortex beam propagation than the edge; when the BGVB propagates along the longitudinal direction in the subway tunnel, the effects of turbulence on the OAM mode probability distribution can be decreased by selecting a larger anisotropy parameter, smaller coherence length, larger non-Kolmogorov power spectrum coefficient, smaller topological charge number, deeper subway tunnel, lower train speed, and longer wavelength. When the BGVB propagates along the transverse direction, the influences can be also mitigated by adopting a larger topological charge number, less non-Kolmogorov power spectrum coefficient, smaller refractive structure index, shorter wavelength, and shorter propagation distance.