Using extreme prior probabilities on the Naive Credal Classifier

• Published in: Knowledge-based systems 2022-02, Vol.237, p.107707, Article 107707
• Main Authors: Moral-García, Serafín, Castellano, Javier G., Mantas, Carlos J., Abellán, Joaquín
• Format: Article
• Language: English
• Subjects: Algorithms; Classification; Classifiers; Decision trees; Extreme Prior Naive Credal Classifier; Imprecise Classification; Lower and upper prior probabilities; Naive Credal Classifier; Non-dominated states set
• ISSN: 0950-7051; 1872-7409
• DOI: 10.1016/j.knosys.2021.107707

The Naive Credal Classifier (NCC) was the first method proposed for Imprecise Classification. It starts from the known Naive Bayes algorithm (NB), which assumes that the attributes are independent given the class variable. Despite this unrealistic assumption, NB and NCC have been successfully used in practical applications. In this work, we propose a new version of NCC, called Extreme Prior Naive Credal Classifier (EP-NCC). Unlike NCC, EP-NCC takes into consideration the lower and upper prior probabilities of the class variable in the estimation of the lower and upper conditional probabilities. We demonstrate that, with our proposed EP-NCC, the predictions are more informative than with NCC without increasing the risk of making erroneous predictions. An experimental analysis carried out in this work shows that EP-NCC significantly outperforms NCC and obtains statistically equivalent results to the algorithm proposed so far for Imprecise Classification based on decision trees, even though EP-NCC is computationally simpler. Therefore, EP-NCC is more suitable to be applied to large datasets for Imprecise Classification than the methods proposed so far in this field. This is an important issue in favor of our proposal due to the increasing amount of data in every area. •We propose a new version of the Naive Credal Classifier (NCC).•Our proposal uses the prior probabilities to estimate conditional probabilities.•The predictions made by our proposed method are more informative.•The new version of NCC performs significantly better than the original one.