ADASYN-Based Multiclass Support Vector Machine for Village Development Index Classification in North Maluku Province

Support Vector Machine Multikelas Berbasis ADASYN untuk Klasifikasi Indeks Pembangunan Desa di Provinsi Maluku Utara

Abstract

Class imbalance is a significant constraint that can diminish the performance of classification models. This study implements the integration of Adaptive Synthetic Sampling (ADASYN) and Multiclass Support Vector Machine (SVM) to classify the 2024 Village Development Index (IDM) in North Maluku Province. The dataset comprises 684 villages, utilizing the Social Resilience Index (IKS), Economic Resilience Index (IKE), and Environmental Resilience Index (IKL) as predictor variables. The data was partitioned using a ratio of 80% for training and 20% for testing. An extreme imbalance was identified in the "independent village" category (0.88%); therefore, ADASYN was applied to the training data to generate 862 synthetic samples to balance the class distribution. The optimal model yielded by the process was a linear kernel SVM with a Cost value of 100, yielding an accuracy of 98.54%, precision of 98.26%, recall of 99.4%, and an F1-score of 98.83%. Of the total 137 villages evaluated, only two villages were misclassified: Salimuli Village and Dowongimaiti Village. These findings demonstrate the effectiveness of the ADASYN-SVM combination in producing accurate classifications to support village development policies in island regions.