Thermoresponsive materials are generating significant interest on account of the sharp and tunable temperature deswelling transition of the polymer chain. Such materials have shown promise in drug delivery devices, sensing systems, and self-assembly. Incorporation of nanoparticles (NPs), typically through covalent attachment of the polymer chains to the NP surface, can add additional functionality and tunability to such hybrid materials. The versatility of these thermoresponsive polymer/nanoparticle materials has been shown previously; however, significant and important differences exist in the published literature between virtually identical materials. Here we use poly(N-isopropylacrylamide) (PNIPAm)-AuNPs as a model system to understand the aggregation behavior of thermoresponsive polymer-coated nanoparticles in pure water, made by either grafting-to or grafting-from methods. We show that, contrary to popular belief, the aggregation of PNIPAm-coated AuNPs, and likely other such materials, relies on the size and concentration of unbound "free" PNIPAm in solution. It is this unbound polymer that also leads to an increase in solution turbidity, a characteristic that is typically used to prove nanoparticle aggregation. The size of PNIPAm used to coat the AuNPs, as well as the concentration of the resultant polymer-AuNP composites, is shown to have little effect on aggregation. Without free PNIPAm, contraction of the polymer corona in response to increasing temperature is observed, instead of nanoparticle aggregation, and is accompanied by no change in solution turbidity or color. We develop an alternative method for removing all traces of excess free polymer and develop an approach for analyzing the aggregation behavior of such materials, which truly allows for heat-triggered aggregation to be studied.