Poly(vinylpyrrolidone) (PVP) was used as both a modifier and reductant to in situ deposit silver nanoparticles (denoted Ag NPs) on the surface of silica nanospheres (nanosilica or nano-SiO2), affording Ag-decorated nanosilica (denoted SiO2@Ag). The as-obtained SiO2@Ag composite can form silver nanoparticle-decorated silica nanosphere arrays (denoted SiO2@Ag arrays) via evaporation-induced self-assembly. The as-prepared SiO2@Ag composite and SiO2@Ag array were used as the SERS substrates to measure the Raman signals of the dilute solutions of rhodamine 6G (denoted R6G), an organic dye that is a potential pollutant to the environment. The findings indicate that the as-prepared SiO2@Ag composite and SiO2@Ag array as potential SERS substrates simultaneously exhibit a high degree of metal coverage and small size of Ag NPs as well as good stability and abundant "hot spots", which contributes to their desired Raman enhancement capacities. For the detection of trace R6G, they provide a limit of detection of as low as 10-9-10-11 M as well as good reproducibility, showing promising potential for monitoring chemical and biological molecules.