Peritonsillar abscess (PTA) is the most common deep neck space infection and a frequent cause for otolaryngology consultation. Patients often undergo computed tomography (CT) scan for confirmation in addition to physical examination. Our aims were to determine whether patients unnecessarily undergo CT scans in the emergency department (ED) when presenting with sore throat and identify physical examination characteristics that predict PTA. The electronic medical records of all patients (>18 years) presenting to an ED between June 2014 and June 2015 with a primary diagnosis of acute pharyngitis, acute tonsillitis, or PTA were reviewed for presenting symptoms and diagnostic imaging use. Four hundred eight patients met inclusion criteria; 21 were diagnosed with PTA, including 13 based on history and physical alone. A total of 21 CT scans were ordered, 11 (52.3%) of which did not demonstrate abscess. Soft palatal fullness, uvular deviation, drooling, and muffled voice were all significantly associated with increased CT usage (all P values <.02). Rising subjective pain scores were associated with increased use of CT imaging (P = .029). Multivariable analyses revealed that soft palatal fullness, uvular deviation, and drooling were all significant predictors of PTA (all P values <.001). Patients with severe symptoms of PTA, including uvular deviation, drooling, and soft palatal fullness, were most likely to undergo CT imaging. Given the high likelihood of PTA, patients presenting with these symptoms could forego CT imaging, reducing exposure to ionizing radiation.