The androgens and androgen receptor (AR) play key roles in the prostate cancer (PCa) development and progression via epithelium-stroma cross talk. Prostate cancer-associated fibroblasts (CAFs) are dominant components in PCa stroma and are essential in the malignant progression by supporting tumorigenesis and metastasis. However, the AR roles in CAFs are still obscure. We isolated and immortalized the CAFs from human PCa tissues and found the CAFs are AR positive. We then knocked down their AR with siRNA and co-cultured the resultant CAFs with PCa cell line PC3. The MTT, invasion, and colony formation assays were performed to study the PC3 biological behavior. The results showed that the PCa epithelial growth, invasion, and colony formation abilities decreased when knocking down the CAFs AR. By using the real-time quantitative polymerase chain reaction, we found the IGF1, FGF7, FGF10, SDF1, HGF, and TGFb2 expression levels decreased in the AR knocked down CAFs. These results suggested that the AR in CAFs promoted PCa epithelial growth and invasion via regulating a series of growth factors. Targeting the AR in CAFs might be a potential therapeutic option for PCa in future.