Validating and constructing behavioral models for simulation and projection using automated knowledge extraction

• Published in: Information sciences 2024-03, Vol.662, p.120232, Article 120232
• Main Authors: Sonnenschein, Tabea S., de Wit, G. Ardine, den Braver, Nicolette R., Vermeulen, Roel C.H., Scheider, Simon
• Format: Article
• Language: English
• Subjects: Behavior modeling; BERT; Knowledge extraction; Knowledge graph; Knowledge synthesis; Named-entity recognition; Ontology; Simulation; Validation
• ISSN: 0020-0255; 1872-6291
• DOI: 10.1016/j.ins.2024.120232

Human behavior may be one of the most challenging phenomena to model and validate. This paper proposes a method for automatically extracting and compiling evidence on human behavior determinants into a knowledge graph. The method (1) extracts associations of behavior determinants and choice options in relation to study groups and moderators from published studies using Natural Language Processing and Deep Learning, (2) synthesizes the extracted evidence into a knowledge graph, and (3) sub-selects the model components and relationships that are relevant and robust. The method can be used to either (4a) construct a structurally valid simulation model before proceeding with calibration or (4b) to validate the structure of existing simulation models. To demonstrate the feasibility of the method, we discuss an example implementation with mode of transport as behavior choice. We find that including non-frequently studied significant behavior determinants drastically improves the model's explanatory power in comparison to only including frequently studied variables. The paper serves as a proof-of-concept which can be reused, extended or adapted for various purposes. •The structure of behavior models should be validated using existing evidence.•Deep Learning can help automatize behavior evidence extraction and synthesis.•Infrequently studied significant variables improve model performance drastically.