Expert judgement of collaborative cloud classroom quality and its criteria using the many-facets rasch model

• Published in: Heliyon 2023-10, Vol.9 (10), p.e20596-e20596, Article e20596
• Main Authors: Ramadhani, Rahmi, Syahputra, Edi, Simamora, Elmanani, Soeharto, Soeharto
• Format: Article
• Language: English
• Subjects: Collaborative cloud classroom; Expert judgement; Many-facet rasch model; Multi-rater assessment
• ISSN: 2405-8440; 2405-8440
• DOI: 10.1016/j.heliyon.2023.e20596

Collaborative Cloud Classroom (3CR) is an educational application that provides flexibility in the learning process. This specialized tool is designed to improve analytical and teambuilding skills, as well as enable students to document ideas, which are subsequently developed into bubble diagrams and text outlines. This study aims to assess and analyze the menu qualities possessed by the 3CR application using the Many-Facet Rasch Model (MFRM) analysis using 5 raters and 6 menus. A rating assessment was applied to 5 criteria, namely usability, functionality, visual communication, learning design, and security. In this case, a total of 135 from 150 data points were coded into FACETS software. The results showed that the six menus in the 3CR application were valid and reliable, as well as met the quality standards of learning tools. Security criteria were also the most difficult standards for raters to measure in all the application menus. The study also found that Rater A was more severe, and Rater E was more lenient in rating the 3CR menu. Rater B has overfitting and detected bias between rater gender and 3CR's menu (Discussion Forum and Learning Reflection menu) based on MFRM analysis.