The document presents a new ensemble learning approach for recognizing Arabic handwritten characters that combines decision fusion of machine learning classifiers with feature extraction. It achieves state-of-the-art accuracy of 97.97% on the IFHCDB dataset and 92.91% on the AIA9K dataset, outperforming individual machine learning classifiers and deep learning networks. The approach first applies a grayscale skeletonization technique to extract structural and statistical features from images. It then builds a model that fuses the results of support vector machines, K-nearest neighbors, and random forest classifiers to take advantage of each algorithm.