As an important feed source for ruminants, alfalfa's rational and efficient utilization is of great significance for the production and economic benefits of pastures. This study focuses on Sanhe dairy cows and includes a control group (CON group, alfalfa in the diet is hay) and an experimental group (AS group, alfalfa silage partially replaces alfalfa hay of equal dry weight). The feeding experiment lasted for 60 days. The results revealed that, compared with the CON group, the AS group exhibited increased milk yield, milk protein, and milk fat. There were no significant differences in apparent digestibility, serum biochemical indicators, and volatile fatty acid (VFA) levels between the two groups. However, the microbial composition of the rumen differed significantly between the two groups of cows based on β-diversity. On the genus level, compared with the CON group, the relative abundance of Erysipelatoclostridium, Pseudoflavonifractor, and Candidatus Saccharimonas in the AS group was significantly reduced. In summary, partially replacing alfalfa hay with alfalfa silage feed is beneficial for improving the production performance of cows and changing rumen microbial diversity. These findings provide a basis for the effective utilization of alfalfa.