Multimodal sequential cross-modal transformer for predicting plant available water capacity (PAWC) from time series of weather and crop biological data

Deep learning (DL) and machine learning (ML) have been applied widely to satellite data of vegetation indices to infer indirect features associated with soil characteristics that affect crop performance in rain-fed environments. In this paper, we propose a DL model for prediction of plant available...

Full description

Saved in:
Bibliographic Details
Published in:Agricultural water management 2025-02, Vol.307, p.109124, Article 109124
Main Authors: Nguyen, Dung, de Voil, Peter, Potgieter, Andries, Dang, Yash P., Orton, Thomas G., Nguyen, Duc Thanh, Nguyen, Thanh Thi, Chapman, Scott C.
Format: Article
Language:English
Subjects:
APSIM
available water capacity
biomass
Cross-modal attention
data collection
leaf area index
Machine learning
Plant
plant available water
Plant available water content
prediction
remote sensing
Soil
time series analysis
Transformer
vegetation
water management
weather
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Deep learning (DL) and machine learning (ML) have been applied widely to satellite data of vegetation indices to infer indirect features associated with soil characteristics that affect crop performance in rain-fed environments. In this paper, we propose a DL model for prediction of plant available water capacity (PAWC) of the soil from sequential multi-modal data including time series of biomass, leaf area index (LAI), normalised difference vegetation index (NDVI), and cumulative weather variables. By initiating large numbers of simulations with different soil PAWC, weather and management parameters, we explore combinations of the simulation outputs and the weather to estimate the PAWC and to determine the factors that impede the accuracy of the prediction model. Experimental results demonstrate the significant potential of our method compared with traditional ML methods. Specifically, our method increases the prediction accuracy in situations where each PAWC profile is grouped into two or five classes of PAWC. For more classes (10 classes), the model achieves more than 60% for the overall accuracy and performs well on the lowest five PAWC classes. The utilisation of sequential multi-modal data to predict soil water level provides a direction for future work to translate onto empirical datasets and also to explore the boundaries of the prediction ability of DL models.
ISSN:0378-3774
1873-2283
DOI:10.1016/j.agwat.2024.109124