In large-scale assessments, students' ability is usually evaluated using multiple test forms, which require the use of several items. In this context, calibrating items before the official tests can be difficult for different reasons. A solution is to calibrate items during the first test administration and then use these estimates in the subsequent ones. However, this approach does not consider that the populations could be significantly different in terms of average ability, which is particularly problematic when the final output of this process is a merit ranking. Our findings show that, on one side, calibrating item parameters on populations with differences in ability does not affect the final merit ranking and, on the other side, the differences in item parameter estimates are significant.

Test equating with evolving latent ability / Silvia Bacci, Bruno Bertaccini, Carla Galluccio, Leonardo Grilli, Carla Rampichini. - ELETTRONICO. - (2023), pp. 54-57. (Intervento presentato al convegno 14th Scientific Meeting of Classification and Data Analysis Group tenutosi a Salerno nel 11-13 September 2023).

Test equating with evolving latent ability

Silvia Bacci;Bruno Bertaccini;Carla Galluccio;Leonardo Grilli;Carla Rampichini
2023

Abstract

In large-scale assessments, students' ability is usually evaluated using multiple test forms, which require the use of several items. In this context, calibrating items before the official tests can be difficult for different reasons. A solution is to calibrate items during the first test administration and then use these estimates in the subsequent ones. However, this approach does not consider that the populations could be significantly different in terms of average ability, which is particularly problematic when the final output of this process is a merit ranking. Our findings show that, on one side, calibrating item parameters on populations with differences in ability does not affect the final merit ranking and, on the other side, the differences in item parameter estimates are significant.
2023
Cladag 2023. Book of abstracts and short papers
14th Scientific Meeting of Classification and Data Analysis Group
Salerno
11-13 September 2023
Silvia Bacci, Bruno Bertaccini, Carla Galluccio, Leonardo Grilli, Carla Rampichini
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1341731
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact