The dielectric relaxation spectra of dilute electrolyte solutions in solvents of small dielectric constants are investigated both theoretically and experimentally. The theoretical calculation in our previous work [T. Yamaguchi, T. Matsuoka, and S. Koda, J. Chem. Phys. 135, 164511 (2011)] is reanalyzed, and it is shown that the dielectric relaxation spectra are composed of three components, namely, the relaxation of ionic atmosphere, the reorientational relaxation of ion pairs, and the collision between ions. The relaxation frequency of the slowest one increases with increasing the concentration, and the slower two relaxations, those of ionic atmosphere and ion pairs, merge into one at the concentration where the Debye length is comparable to the size of ions. Experimentally, the dielectric relaxation spectra of some electrolytes in two solvents, tetrahydrofuran and tetraglyme, are determined at frequencies from 300 kHz to 200 MHz, and the presence of the slower two relaxations was confirmed. The concentration dependence of the relaxation frequency is also in harmony with the theoretical calculation. The relationship between the dielectric relaxation spectra and the concentration dependence of the ionic conductivity is discussed.