Optimization of the Maximum Likelihood Estimator for Determining the Intrinsic Dimensionality of High–Dimensional Data

• Published in: International journal of applied mathematics and computer science 2015-12, Vol.25 (4), p.895-913
• Main Authors: Karbauskaitė, Rasa, Dzemyda, Gintautas
• Format: Article
• Language: English
• Subjects: image understanding; intrinsic dimensionality; manifold learning methods; maximum likelihood estimator; multidimensional data
• ISSN: 2083-8492; 1641-876X; 2083-8492
• DOI: 10.1515/amcs-2015-0064

One of the problems in the analysis of the set of images of a moving object is to evaluate the degree of freedom of motion and the angle of rotation. Here the intrinsic dimensionality of multidimensional data, characterizing the set of images, can be used. Usually, the image may be represented by a high-dimensional point whose dimensionality depends on the number of pixels in the image. The knowledge of the intrinsic dimensionality of a data set is very useful information in exploratory data analysis, because it is possible to reduce the dimensionality of the data without losing much information. In this paper, the maximum likelihood estimator (MLE) of the intrinsic dimensionality is explored experimentally. In contrast to the previous works, the radius of a hypersphere, which covers neighbours of the analysed points, is fixed instead of the number of the nearest neighbours in the MLE. A way of choosing the radius in this method is proposed. We explore which metric—Euclidean or geodesic—must be evaluated in the MLE algorithm in order to get the true estimate of the intrinsic dimensionality. The MLE method is examined using a number of artificial and real (images) data sets.