Towards a temporospatial framework for measurements of disorganization in speech using semantic vectors

• Published in: Schizophrenia research 2023-09, Vol.259, p.71-79
• Main Authors: Holmlund, Terje B., Chandler, Chelsea, Foltz, Peter W., Diaz-Asper, Catherine, Cohen, Alex S., Rodriguez, Zachary, Elvevåg, Brita
• Format: Article
• Language: English
• Subjects: Coherence; Language analysis; Schizophrenia; Speech; Visualizations; Word vectors
• ISSN: 0920-9964; 1573-2509; 1573-2509
• DOI: 10.1016/j.schres.2022.09.020

Incoherent speech in schizophrenia has long been described as the mind making “leaps” of large distances between thoughts and ideas. Such a view seems intuitive, and for almost two decades, attempts to operationalize these conceptual “leaps” in spoken word meanings have used language-based embedding spaces. An embedding space represents meaning of words as numerical vectors where a greater proximity between word vectors represents more shared meaning. However, there are limitations with word vector-based operationalizations of coherence which can limit their appeal and utility in clinical practice. First, the use of esoteric word embeddings can be conceptually hard to grasp, and this is complicated by several different operationalizations of incoherent speech. This problem can be overcome by a better visualization of methods. Second, temporal information from the act of speaking has been largely neglected since models have been built using written text, yet speech is spoken in real time. This issue can be resolved by leveraging time stamped transcripts of speech. Third, contextual information - namely the situation of where something is spoken - has often only been inferred and never explicitly modeled. Addressing this situational issue opens up new possibilities for models with increased temporal resolution and contextual relevance. In this paper, direct visualizations of semantic distances are used to enable the inspection of examples of incoherent speech. Some common operationalizations of incoherence are illustrated, and suggestions are made for how temporal and spatial contextual information can be integrated in future implementations of measures of incoherence.