Journal's Facebook pageClass Probability Distribution Based Maximum Entropy Model for Classification of Datasets with Sparse Instances
- Department of Computing, Coimbatore Institute of Technology
Coimbatore, Tamil Nadu, India
a.saravanan21@gmail.com, anandhi.cit@gmail.com, msrividya2013@gmail.com
Abstract
Due to the digital revolution, the amount of data to be processed is growing every day. One of the more common functions used to process these data is classification. However, the results obtained by most existing classifiers are not satisfactory, as they often depend on the number and type of attributes within the datasets. In this paper, a maximum entropy model based on class probability distribution is proposed for classifying data in sparse datasets with fewer attributes and instances. Moreover, a new idea of using Lagrange multipliers is suggested for estimating class probabilities in the process of class label prediction. Experimental analysis indicates that the proposed model has an average accuracy of 89.9% and 86.93% with 17 and 36 datasets. Besides, statistical analysis of the results indicates that the proposed model offers greater classification accuracy for over 50% of datasets with fewer attributes and instances than other competitors.
Key words
classification, fewer attributes and instances, Lagrange multipliers, class probability distribution, relative gain, maximum entropy
Digital Object Identifier (DOI)
https://doi.org/10.2298/CSIS211030001S
Publication information
Volume 20, Issue 3 (June 2023)
Year of Publication: 2023
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium
Full text
Available in PDF
Portable Document Format
How to cite
Saravanan, A., Anandhi, D., Srividya, M.: Class Probability Distribution Based Maximum Entropy Model for Classification of Datasets with Sparse Instances. Computer Science and Information Systems, Vol. 20, No. 3, 949–976. (2023), https://doi.org/10.2298/CSIS211030001S
