BACKGROUND The aim of this study was to investigate near-infrared fluorescence (NIRF) imaging as a novel imaging modality that allows for early detection of cancer and real-time monitoring to acquire related information. IR-780 iodide, a lipophilic dye, accumulates selectively in breast cancer cells and drug-resistant human lung cancer cells, with a peak emission at 780 nm that can be easily detected by the NIRF imaging system. The application of IR-780 for prostate cancer imaging was thoroughly investigated to further expand its clinical value. METHODS The impact of IR-780 on the survival of prostate cancer cells PC-3 and LNCaP as well as normal prostate epithelial cells RWPE-1 was determined. Duration of IR-780 dye staining was optimized in PC-3 cells. The involvement of specific OATP1B3 inhibitor in the selective accumulation of IR-780 was investigated. IR-780 for prostate cancer imaging was carried out in athymic nude mouse models and, acute toxicity of IR-780 was evaluated. RESULTS IR-780 incubation resulted in a dose-dependent inhibition to cell proliferation. Mean fluorescence intensity of prostate cancer cells peaked at 20-min IR-780 incubation. Specific uptake of IR-780 dye in prostate cancer cells was mainly through the function of OATP1B3. We also demonstrated that NIRF dye effectively identified the subcutaneous prostate cancer xenografts, subsequently confirmed by histological examination. There was no significant impact on the physical activity, weight, and tissue histology of BABL/C mice with 10-fold imaging dose of 1-month IR-780 dye administration. CONCLUSIONS NIRF imaging using IR-780 dye is a feasible and practicable method for prostate cancer detection, with potential tumor-killing ability, although more investigations are needed before clinical translation.