Algorithmic group formation and group work evaluation in a learning analytics-enhanced environment: implementation study in a Japanese junior high school

Abstract

In-class group work activities are found to promote the interpersonal skills of learners. To support the teachers in facilitating such activities, we designed a learning analytics-enhanced technology framework, Group Learning Orchestration Based on Evidence (GLOBE) using data-driven approaches. In this study, we implemented the algorithmic group formation and group work evaluation systems in a Japanese junior high school context. Data from a series of 12 collaborative learning activities were used to validate the difference in the measured heterogeneity of the formed homogeneous and heterogeneous groups compared to random grouping. Further, the peer rating and self-perception of the group work were compared for comparative reading and idea exchange tasks. We found algorithmically formed groups, considering the learner model data, either heterogeneously or homogeneously performed better than random grouping. Specifically, students in groups created by the homogeneous algorithm received higher peer ratings and more positive self-perception of group work in the idea exchange group tasks. We did not find significant differences in the comparative reading tasks. Along with the empirical findings, this work presents a paradigm of continuous data-driven group learning support by incorporating the peer and teacher evaluation scores as an input to the subsequent algorithmic grouping.