The Benefits of Synchronous Collaborative Information Visualization: Evidence from an Experimental Evaluation

• Published in: IEEE transactions on visualization and computer graphics 2009-11, Vol.15 (6), p.1073-1080
• Main Authors: Bresciani, S., Eppler, M.J.
• Format: Article
• Language: English
• Subjects: Collaboration; Collaborative and Distributed Visualization; Collaborative work; Data analysis; Data visualization; Empirical analysis; experiment; Gain; group work; Information analysis; Interactive; Knowledge management; knowledge sharing; Laboratory Studies; Optimal control; Optimization; Particle measurements; Productivity; Statistical analysis; Studies; Synchronous; synchronous situated collaboration; Tasks; Visual Knowledge Representation; Visualization
• ISSN: 1077-2626; 1941-0506
• DOI: 10.1109/TVCG.2009.188

A great corpus of studies reports empirical evidence of how information visualization supports comprehension and analysis of data. The benefits of visualization for synchronous group knowledge work, however, have not been addressed extensively. Anecdotal evidence and use cases illustrate the benefits of synchronous collaborative information visualization, but very few empirical studies have rigorously examined the impact of visualization on group knowledge work. We have consequently designed and conducted an experiment in which we have analyzed the impact of visualization on knowledge sharing in situated work groups. Our experimental study consists of evaluating the performance of 131 subjects (all experienced managers) in groups of 5 (for a total of 26 groups), working together on a real-life knowledge sharing task. We compare (1) the control condition (no visualization provided), with two visualization supports: (2) optimal and (3) suboptimal visualization (based on a previous survey). The facilitator of each group was asked to populate the provided interactive visual template with insights from the group, and to organize the contributions according to the group consensus. We have evaluated the results through both objective and subjective measures. Our statistical analysis clearly shows that interactive visualization has a statistically significant, objective and positive impact on the outcomes of knowledge sharing, but that the subjects seem not to be aware of this. In particular, groups supported by visualization achieved higher productivity, higher quality of outcome and greater knowledge gains. No statistically significant results could be found between an optimal and a suboptimal visualization though (as classified by the pre-experiment survey). Subjects also did not seem to be aware of the benefits that the visualizations provided as no difference between the visualization and the control conditions was found for the self-reported measures of satisfaction and participation. An implication of our study for information visualization applications is to extend them by using real-time group annotation functionalities that aid in the group sense making process of the represented data.