The Effect of the Level of Data Presentation on Visual Analysts' Decisions

• Published in: School psychology 2024-11, Vol.39 (6), p.572-578
• Main Authors: Radley, Keith C., Dart, Evan H.
• Format: Article
• Language: English
• Subjects: Adult; Curriculum Based Assessment; Data Collection; Data Visualization; Decision Making; Design techniques; Female; Graph theory; Human; Humans; Intervention; Male; Predominantly White Institutions; Progress Monitoring; Quantitative analysis; Research Design; School Based Intervention; School Psychologists; Single-Case Experimental Design; Test Construction; Visual Displays; Young Adult
• ISSN: 2578-4218; 2578-4226; 2578-4226
• DOI: 10.1037/spq0000656

Single-case design (SCD) is frequently utilized in research and applied settings to evaluate the effect of an intervention over time. Once collected, single-case data are typically graphed and analyzed visually in both research and practice contexts. Despite the ubiquity of visual analysis in SCD, this analytic framework has often been critiqued due to findings of limited reliability across visual analysts. Recent research has identified that the way a graph is constructed may contribute to the limitations of visual analysis. The present study sought to evaluate the effect of visually representing multiple measurement occasions as a single data point (e.g., combining measurements taken daily into a weekly composite data point) on visual analysts' decisions regarding the magnitude of an intervention effect. Eleven participants viewed identical data sets, plotted to show different numbers of measurement occasions combined as a single data point, and provided ratings regarding the magnitude of intervention effect depicted within the graph. Results indicated a significant main effect, with data sets with higher levels of data combination being rated as demonstrating significantly larger intervention effects. The results of the study provide additional support for standardization of data presentation and graph construction within SCD in both research and practice contexts. Impact and Implications The manner in which a single-case graph is presented has an impact on rater interpretation of intervention effectiveness. Practitioners and researchers are encouraged to avoid combining multiple measurement occasions into single data points when doing so obscures or alters data characteristics such as trend and level changes of data.