Imprecise probability models for learning multinomial distributions from data. Applications to learning credal networks

• Published in: International journal of approximate reasoning 2014-10, Vol.55 (7), p.1548-1569
• Main Authors: Masegosa, Andrés R., Moral, Serafín
• Format: Article
• Language: English
• Subjects: Approximation; Bayesian analysis; Construction; Credal networks; Criteria; Dirichlet problem; Ignorance; Imprecise prior models; Imprecise probability; Learning; Mathematical models; Networks
• ISSN: 0888-613X; 1873-4731
• DOI: 10.1016/j.ijar.2013.09.019

This paper considers the problem of learning multinomial distributions from a sample of independent observations. The Bayesian approach usually assumes a prior Dirichlet distribution about the probabilities of the different possible values. However, there is no consensus on the parameters of this Dirichlet distribution. Here, it will be shown that this is not a simple problem, providing examples in which different selection criteria are reasonable. To solve it the Imprecise Dirichlet Model (IDM) was introduced. But this model has important drawbacks, as the problems associated to learning from indirect observations. As an alternative approach, the Imprecise Sample Size Dirichlet Model (ISSDM) is introduced and its properties are studied. The prior distribution over the parameters of a multinomial distribution is the basis to learn Bayesian networks using Bayesian scores. Here, we will show that the ISSDM can be used to learn imprecise Bayesian networks, also called credal networks when all the distributions share a common graphical structure. Some experiments are reported on the use of the ISSDM to learn the structure of a graphical model and to build supervised classifiers. •We examine imprecise models for estimating multinomial probabilities.•The selection of the equivalent sample size in a Dirichlet density is not simple.•An imprecise model can be considered by being imprecise in the equivalent sample size.•Imprecise sample size is useful to learn credal networks with imprecise structure.