Informing Makerspace Outcomes Through a Linguistic Analysis of Written and Video-Recorded Project Assessments

• Published in: International journal of science and mathematics education 2021-02, Vol.19 (2), p.333-354
• Main Authors: Oliver, Kevin M., Houchins, Jennifer K., Moore, Robert L., Wang, Chuang
• Format: Article
• Language: English
• Subjects: Assessments; Data Collection; Data mining; Discourse Analysis; Education; Learning Analytics; Linguistics; Logical Thinking; Makerspaces; Mathematical analysis; Mathematics Education; Outcomes of Education; Program Evaluation; Psychological Patterns; Reflection; Scaffolding; Science Education; Scores; Shared Resources and Services; Video Technology; Written Language
• ISSN: 1571-0068; 1573-1774
• DOI: 10.1007/s10763-020-10060-2

A growing body of research focuses on what outcomes to assess in makerspaces, and appropriate formats for capturing those outcomes (e.g. reflections, surveys, and portfolios). Linguistic analysis as a data mining technique holds promise for revealing different dimensions of learning exhibited by students in makerspaces. In this study, student reflections on makerspace projects were gathered in 2 formats over 2 years: private written assessments captured in the 3D GameLab gamification platform, and semi-public video-recorded assessments posted in the more social FlipGrid platform. Transcripts of student assessments were analyzed using Linguistic Inquiry Word Count (LIWC) to generate 4 summary variables thought to inform makerspace outcomes of interest (i.e. analytical thinking, authenticity, clout, and emotional tone). Comparative findings indicate that written assessments may elicit more analytical thinking about maker projects compared with less analytical conversation in videos, while video assessments may elicit somewhat higher clout scores as evidence of social scaffolding along with a much more positive emotional tone. Recommendations are provided for layering assessment approaches to maximize the potential benefits of each format, including reflective writing for social spaces, in social groups, and about design processes and procedures.