Forensic analysis of microtraces using image recognition through machine learning

• Published in: Microchemical journal 2024-12, Vol.207, p.111780, Article 111780
• Main Authors: Rodrigues, Caio Henrique Pinke, Sousa, Milena Dantas da Cruz, dos Santos, Michele Avila, Filho, Percio Almeida Fistarol, Velho, Jesus Antonio, Leite, Vitor Barbanti Pereira, Bruni, Aline Thais
• Format: Article
• Language: English
• Subjects: Computer vision; Convolutional Neural Network; Evidence; Forensic Science; Statistical analysis
• ISSN: 0026-265X
• DOI: 10.1016/j.microc.2024.111780

[Display omitted] •We analyzed four types of silver tape brands using microscopy and chemometric methods to create a database.•We use two approaches to create comparative models, one using computer vision and the other using pixel density.•We use chemometric methods to classify tape fragments found at crime scenes.•The results indicate that both approaches aid in decision-making for forensic cases.•The study promoted an approach for classifying similarity between materials of forensic interest. Traces found at a crime scene can be interpreted as vectors of information that help describe the possible dynamics of the crime. However, some analyses show that pattern recognition, especially in materials, is subjective, as it depends on the analyst’s references. Based on this problem, the work aimed to use different statistical methods to establish pattern recognition in silver tapes. For this, two approaches were used, one based on deep learning (convolutional neural networks) and the other using a different method (Pearson’s correlation, distance metrics, and Principal Component Analysis). The dataset comprised four brands of silver-tape available in the retail market in the crime scene region, and fragments of tape originating after the detonation of a handmade explosive device. These materials were analyzed using a Leica DVM6 microscope. In both approaches, it was possible to recognize patterns. In deep learning, it was possible to establish that the fragments came from a common origin. The best model demonstrated that 92.1 % of the real materials questioned were the same silver-tape, with a confidence level of 0.94. By combining the methods, it was possible to observe a trend among the results. These responses demonstrated that using images in a computer vision context could remove the subjectivity of forensic analysis and correlate the microtraces found at a crime scene. In this way, these techniques can open new perspectives for the forensic area, making the interpretation more objective and transparent in its responses to society.