Current models for assessing response accuracy and response times in testing environments typically overlook variations in speed and ability within individuals. Instead, they often treat these as residual variances, missing the dynamic changes in individual performance throughout a test. Additionally, the influence of item position and the ordinal nature of response accuracy remain underexplored. This paper introduces a comprehensive modelling framework that integrates item responses, response times, and item position to better understand skill acquisition and latent speed changes. Our approach uses the Bivariate Generalised Linear Item Response Theory (B-GLIRT) model, capturing the dual impact of ability on response accuracy and the interplay between ability and speed on response times. We extend this model by incorporating random effects for item and individual-specific variations. The proposed model further explores how item positioning affects test performance and provides diagnostic insights into individual differences. The paper also discusses parameter estimation, model identification, and applications to real-world data, illustrating the practical implications of our findings in computer-based learning assessments.

A unified framework for jointly modeling response times and item position effects in computer-based learning assessments / Silvia Bacci, R.F.. - In: MULTIVARIATE BEHAVIORAL RESEARCH. - ISSN 1532-7906. - ELETTRONICO. - (2026), pp. 1-26. [10.1080/00273171.2026.2684069]

A unified framework for jointly modeling response times and item position effects in computer-based learning assessments

Silvia Bacci;
2026

Abstract

Current models for assessing response accuracy and response times in testing environments typically overlook variations in speed and ability within individuals. Instead, they often treat these as residual variances, missing the dynamic changes in individual performance throughout a test. Additionally, the influence of item position and the ordinal nature of response accuracy remain underexplored. This paper introduces a comprehensive modelling framework that integrates item responses, response times, and item position to better understand skill acquisition and latent speed changes. Our approach uses the Bivariate Generalised Linear Item Response Theory (B-GLIRT) model, capturing the dual impact of ability on response accuracy and the interplay between ability and speed on response times. We extend this model by incorporating random effects for item and individual-specific variations. The proposed model further explores how item positioning affects test performance and provides diagnostic insights into individual differences. The paper also discusses parameter estimation, model identification, and applications to real-world data, illustrating the practical implications of our findings in computer-based learning assessments.
2026
1
26
Goal 4: Quality education
Silvia Bacci, Rosa Fabbricatore, Maria Iannario
File in questo prodotto:
File Dimensione Formato  
Bacci_etal(2026)_MBR_online.pdf

accesso aperto

Tipologia: Pdf editoriale (Version of record)
Licenza: Open Access
Dimensione 2.78 MB
Formato Adobe PDF
2.78 MB Adobe PDF

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1477514
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact