Exploratory functional data analysis of multivariate densities for the identification of agricultural soil contamination by risk elements

Geochemical mapping of risk element concentrations in soils is performed in countries around the world. It results in large datasets of high analytical quality, which can be used to identify soils that violate individual legislative limits for safe food production. However, there is a lack of advanc...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-11
Main Authors: Tomáš Matys Grygar, Radojičić, Una, Pavlů, Ivana, Greven, Sonja, Johanna Genest Nešlehová, Tůmová, Štěpánka, Hron, Karel
Format: Article
Language:English
Subjects:
Anomalies
Big Data
Clustering
Composition
Data analysis
Data mining
Datasets
Empirical analysis
Functionals
Geochemistry
Legislation
Mapping
Mathematical analysis
Multivariate analysis
Probability density functions
Soil contamination
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Geochemical mapping of risk element concentrations in soils is performed in countries around the world. It results in large datasets of high analytical quality, which can be used to identify soils that violate individual legislative limits for safe food production. However, there is a lack of advanced data mining tools that would be suitable for sensitive exploratory data analysis of big data while respecting the natural variability of soil composition. To distinguish anthropogenic contamination from natural variation, the analysis of the entire data distributions for smaller sub-areas is key. In this article, we propose a new data mining method for geochemical mapping data based on functional data analysis of probability density functions in the framework of Bayes spaces after post-stratification of a big dataset to smaller districts. Proposed tools allow us to analyse the entire distribution, going beyond a superficial detection of extreme concentration anomalies. We illustrate the proposed methodology on a dataset gathered according to the Czech national legislation (1990--2009). Taking into account specific properties of probability density functions and recent results for orthogonal decomposition of multivariate densities enabled us to reveal real contamination patterns that were so far only suspected in Czech agricultural soils. We process the above Czech soil composition dataset by first compartmentalising it into spatial units, in particular the districts, and by subsequently clustering these districts according to diagnostic features of their uni- and multivariate distributions at high concentration ends. Comparison between compartments is key to the reliable distinction of diffuse contamination. In this work, we used soil contamination by Cu-bearing pesticides as an example for empirical testing of the proposed data mining approach.
ISSN:2331-8422