This essay examines the aims, labor regime, and workers of the St. Vincent botanic garden to highlight differences in the infrastructure of government-funded botany across the British empire. It argues that slavery was a foundational element of society and natural history in the Anglo-Caribbean, and the St. Vincent botanic garden was both put into the service of slavery and transformed by it. When viewed from the Caribbean context and the perspective of enslaved workers, the St. Vincent garden's affiliation with imperial improvement becomes less salient than its support of the status quo of slavery as a system and labor regime. The garden was dependent on enslaved laborers, yet the conditions of work and contemporary prejudices led superintendents to see them as undifferentiated labor. The politics of the archive make it impossible for historians to reconstruct the experiences of the garden's enslaved workers as individuals, including the specific labor that they performed or skills that they possessed. Plantation slavery's appropriation of and influence on the infrastructure of colonial botany through the St. Vincent botanic garden suggests that historians should center the local logics of the societies where scientific knowledge making took place to reveal the many meanings of science.