Mapping integrated crop-livestock systems in Brazil with planetscope time series and deep learning

• Published in: Remote sensing of environment 2023-12, Vol.299, p.113886, Article 113886
• Main Authors: Bueno, Inacio T., Antunes, João F.G., Dos Reis, Aliny A., Werner, João P.S., Toro, Ana P.S.G.D.D., Figueiredo, Gleyce K.D.A., Esquerdo, Júlio C.D.M., Lamparelli, Rubens A.C., Coutinho, Alexandre C., Magalhães, Paulo S.G.
• Format: Article
• Language: English
• Subjects: Crop classification; OBIA; Shapley additive exPlanations; Sustainable agriculture; Temporal generalization
• ISSN: 0034-4257; 1879-0704
• DOI: 10.1016/j.rse.2023.113886

Accurate mapping of crops with high spatiotemporal resolution plays a critical role in achieving the Sustainable Development Goals (SDGs), especially in the context of integrated crop-livestock systems (ICLS). Stakeholders can make informed decisions and implement targeted strategies to achieve multiple SDGs related to agriculture, rural development, and sustainable livelihoods by understanding the spatial dynamics of these systems. Accurate information on the extent of ICLS derived from multitemporal remote sensing and emerging map techniques such as deep learning can help in the implementation of sustainable agricultural practices. However, far too little attention has been paid to ICLS map accuracy because it may not be at the forefront of research agendas compared to those of other agricultural practices. This paper aims to map ICLS using high spatiotemporal resolution imagery and deep learning neural network classifiers at two different sites located in Brazil. The pipeline involves four interpretation approaches based on the ICLS class: evaluating deep neural network classifiers with different image composition intervals, explaining commission and omission errors, evaluating the temporal transferability of the method, and evaluating the influence of variables. The study area consists of two locations in São Paulo (study site 1, SS1) and Mato Grosso state (study site 2, SS2), Brazil. We derived nine spectral variables from PlanetScope (PS) images and four metrics through object-based image analysis (OBIA) using two time intervals, 10 and 15 days, to generate the image compositions. These input variables were used in three deep neural network classifiers: convolutional neural network in one dimension (Conv1D), long short-term memory (LSTM), and LSTM with a fully convolutional network (LSTM-FCN). Our results showed that mapping dynamic land use such as ICLS is possible by using high-spatiotemporal-resolution imagery and deep neural network classifiers. The 15-day LSTM-FCN classifier returned the highest map accuracies for both sites, with the following class-level accuracies: producer accuracy (PA) = 97.0% and user accuracy (UA) = 97.0% for SS1 and PA = 82.0% and UA = 96.5% for SS2. Meanwhile, we found map uncertainties arising from the diverse crop calendars and spectro-temporal similarities between ICLS and other land use. The best approaches revealed that temporal generalization was suitable for mapping ICLS, but some classifiers could not generalize