Behavioral research has led to the view that items in short-term memory can be parsed into two categories: a single item in the focus of attention that is available for immediate cognitive processing and a small set of other items that are in a heightened state of activation but require retrieval for further use. We examined this distinction by using an item-recognition task. The results show that the item in the focus of attention is represented by increased activation in inferior temporal representational cortices relative to other information in short-term memory. Functional connectivity analyses suggest that activation of these inferior temporal regions is maintained via frontal- and posterior-parietal contributions. By contrast, other items in short-term memory demand retrieval mechanisms that are represented by increased activation in the medial temporal lobe and left mid-ventrolateral prefrontal cortex. These results show that there are two distinctly different sorts of access to information in short-term memory, and that access by retrieval operations makes use of neural machinery similar to that used in long-term memory retrieval.