Hyperspectral imaging and convolutional neural networks for augmented documentation of ancient Egyptian artefacts

• Published in: Heritage science 2024-03, Vol.12 (1), p.75-15, Article 75
• Main Authors: Cucci, Costanza, Guidi, Tommaso, Picollo, Marcello, Stefani, Lorenzo, Python, Lorenzo, Argenti, Fabrizio, Barucci, Andrea
• Format: Article
• Language: English
• Subjects: Ancient Egyptian hieroglyphs; Artificial neural networks; Chemistry and Materials Science; Color imagery; Convolutional neural networks; Data acquisition; Degradation; Egyptian civilization; Hyperspectral imaging; Image enhancement; Image segmentation; Materials Science; Near infrared radiation; Neural networks; Segmentation; Symbols; Text recognition; The Future of Heritage Science and Technologies: Papers from Florence Heri-Tech 2022; Vis-NIR reflectance hyperspectral imaging
• ISSN: 2050-7445; 2050-7445
• DOI: 10.1186/s40494-024-01182-9

The study aims at investigating the use of reflectance Hyperspectral Imaging (HSI) in the Visible (Vis) and Near Infrared (NIR) range in combination with Deep Convolutional Neural Networks (CNN) to address the tasks related to ancient Egyptian hieroglyphs recognition. Recently, well-established CNN architectures trained to address segmentation of objects within images have been successfully tested also for trial sets of hieroglyphs. In real conditions, however, the surfaces of the artefacts can be highly degraded, featuring corrupted and scarcely readable inscriptions which highly reduce the CNNs capabilities in automated recognition of symbols. In this study, the use of HSI technique in the extended Vis-NIR range is proposed to retrieve readability of degraded symbols by exploiting spectral images. Using different algorithmic chains, HSI data are processed to obtain enhanced images to be fed to the CNN architectures. In this pilot study, an ancient Egyptian coffin (XXV Dynasty), featuring a degraded hieroglyphic inscription, was used as a benchmark to test, in real conditions, the proposed methodological approaches. A set of Vis-NIR HSI data acquired on-site, in the framework of a non-invasive diagnostic campaign, was used in combination with CNN architectures to perform hieroglyphs segmentation. The outcomes of the different methodological approaches are presented and compared to each other and to the results obtained using standard RGB images.