Since prognosis and treatment of pancreatic endocrine tumors (pNET) are based on tumor grade, contrast-enhanced multidetector computed tomography (MDCT) features of solid non-functioning pNETs were studied and correlated with pathology tumor grading. MDCTs of diagnosed pNETs were reviewed retrospectively. Each tumor was analyzed for location, size, homogeneity, margins, arterial and venous phase enhancement, main pancreatic duct diameter, calcifications, vascular invasion, lymph-nodes enlargement, and liver metastases. Of 154 pNETs presenting between January 2000 and May 2016 with available histology from resected specimen or biopsy, there were 65 G1, 72 G2 and 17 G3 pNETs. Tumor diameter varied significantly between the three groups. Tumors >20 mm were more frequently malignant and non-homogeneous than smaller tumors. G1 tumors were more commonly hypervascular and G3 tumors more often non-hypervascular in the arterial phase. Arterial phase non-hyperdensity and tumor non-homogeneity had a higher rate of metastatic lesions. Vascular invasion correlated with presence of metastases and histological grade. G3 tumors were all >20 mm (p = 0.007), more often non-hypervascular in the arterial phase (p = 0.0025), and non-hyperdense in the venous phase (p = 0.009), and showed more often vascular invasion (p = 0.0198). CT correlated with tumor grade; differentiating low-grade and high-grade pNETs through routine CT imaging might improve patient management.