Cardiac arrhythmia is a leading cause of cardiovascular disease, with a high fatality rate worldwide. The timely diagnosis of cardiac arrhythmias, determined by irregular and fast heart rate, may help lower the risk of strokes. Electrocardiogram signals have been widely used to identify arrhythmias due to their non-invasive approach. However, the manual process is error-prone and time-consuming. A better alternative is to utilize deep learning models for early automatic identification of cardiac arrhythmia, thereby enhancing diagnosis and treatment. In this article, a novel deep learning model, combining convolutional neural network and bi-directional long short-term memory, is proposed for arrhythmia classification. Specifically, the classification comprises five different classes: non-ectopic (N), supraventricular ectopic (S), ventricular ectopic (V), fusion (F), and unknown (Q) beats. The proposed model is trained, validated, and tested using MIT-BIH and St-Petersburg data sets separately. Also, the performance was measured in terms of precision, accuracy, recall, specificity, and f1-score. The results show that the proposed model achieves training, validation, and testing accuracies of 100%, 98%, and 98%, respectively with the MIT-BIH data set. Lower accuracies were shown for the St-Petersburg data set. The performance of the proposed model based on the MIT-BIH data set is also compared with the performance of existing models based on the MIT-BIH data set.