Validation of the Child Behavior Rating Scale (CBRS) Using Multilevel Factor Analysis

• Published in: Psychological assessment 2021-11, Vol.33 (11), p.1138-1151
• Main Authors: Chan, Wei Teng, Bull, Rebecca, Ng, Ee Lynn, Waschl, Nicolette, Poon, Kenneth K.
• Format: Article
• Language: English
• Subjects: Behavior; Behavior rating scales; Child Behavior; Children & youth; Classrooms; Factor Analysis; Factor Structure; Female; Human; Learning; Male; Rating Scales; Teacher Report; Teachers; Test Validity
• ISSN: 1040-3590; 1939-134X
• DOI: 10.1037/pas0001075

Behavioral regulation supports children to control their cognitive and emotional skills and participate fully in classroom learning and interactions. Teacher ratings are frequently used to collect data but are highly susceptible to the teacher's response bias, meaning much child level variance is attributable to the teacher level. Multilevel modeling techniques are commonly used to assess the psychometric properties of measures at different levels by disaggregating within- and between-teacher variation in student behaviors. In this study, we attempt to identify the factor structure at each level using teacher ratings on the Child Behavior Rating Scale (CBRS). The sample of 1,375 preschool children (49.2% males) was drawn from a longitudinal study in Singapore. The teacher ratings of these children were collected at three time points (average age at Time 1 was 58.5 months, Time 2 was 69.8 months, and Time 3 was 80.9 months). Using multilevel exploratory and confirmatory factor analyses, a three-factor model at the within level and a two-factor model at the between level best fit the data. At the within level, the three factors were identified as basic interpersonal skills, advanced interpersonal skills, and learning-related social skills. The three factors showed good internal consistency and differential correlates. The two factors at the between level may be related to teacher and classroom characteristics. This study provides empirical support for (a) differential factor structures of CBRS at the within and between levels; and (b) two distinct interpersonal skills. Future studies should aim at exploring the sources of between level variability. Public Significance Statement This present study provides information regarding validity and reliability of the Child Behavior Rating Scale (CBRS), a measure assessing children's interpersonal and learning-related social skills in the classroom. Results indicate that children's interpersonal social skills can be manifested into two types (i.e., basic and advanced). The findings also indicate that teacher characteristics and practices could influence teacher ratings of children's social behavior in the classroom.