Spatial relations between objects can be represented either categorically or coordinately. The metric, coordinate representation is associated with predominant right hemisphere activity, while the abstract, qualitative categorical representation is thought to be processed more in the left hemisphere [Kosslyn, S. M. (1987). Seeing and imagining in the cerebral hemispheres: A computational analysis. Psychological Review, 94, 148-175]. This hypothesized lateralization effect has been found in a number of studies, along with indications that specific task demands can be crucial for these outcomes. In the current experiment a new visual half field task was used which explores these hemispheric differences and their time course by means of a match-to-sample design. Within retention intervals that were brief (500 ms), intermediate (2000 ms), or long (5000 ms), the processing of categorical and coordinate representations was studied. In the 500 ms interval, the hemispheric effect suggested by Kosslyn (1987) was found, but in the longer intervals it was absent. This pattern of the lateralization effect is proposed to be caused by the differential effect the retention interval has on coordinate and categorical representations. Coordinate spatial relations appear susceptible to changes in retention interval and decay very quickly over time, congruent with previous findings about accurate location memory. The processing of categorical spatial relations showed less decay and only between 2000 ms and 5000 ms. Qualitative self reports suggest that the decay found for categorical relations might be caused by a switch from a visual to a more verbal memorization strategy.