Patients with hypertensive intracerebral hemorrhage (ICH) have a high hematoma expansion (HE) incidence. Noninvasive prediction HE helps doctors take effective measures to prevent accidents. This study retrospectively analyzed 253 cases of hypertensive intraparenchymal hematoma. Baseline non-contrast-enhanced CT scans (NECTs) were collected at admission and compared with subsequent CTs to determine the presence of HE. An end-to-end deep learning method based on CT was proposed to automatically segment the hematoma region, region of interest (ROI) feature extraction, and HE prediction. A variety of algorithms were employed for comparison. U-Net with attention performs best in the task of segmenting hematomas, with the mean Intersection overUnion (mIoU) of 0.9025. ResNet-34 achieves the most robust generalization capability in HE prediction, with an area under the receiver operating characteristic curve (AUC) of 0.9267, an accuracy of 0.8827, and an F1 score of 0.8644. The proposed method is superior to other mainstream models, which will facilitate accurate, efficient, and automated HE prediction.