The School of Economics and Management of the University of Florence uses a self-evaluation test as an instrument to assess the competencies of candidates who want to enrol in the three-year degree program. The aim of this study is to assess if the selfevaluation test scores give a gain in predicting the student performance when added to available student characteristics, such as the high school career. The student performance is measured by three binary indicators based on the number of credits gained after one year. For each binary outcome, the prediction is carried out using both logistic regression and random forest, using two alternative sets of predictors: (i) student characteristics; (ii) student characteristics and test scores. The predictive ability is assessed using 10-fold cross-validation. The main finding of the analysis, which refers to the academic year 2014/2015, is that the self-evaluation test scores do not help in predicting student performance once student characteristics are properly exploited.

Analysis of the prediction ability of a university self-evaluation test: statistical learning methods for predicting student performance / leonardo grilli. - In: STATISTICA APPLICATA. - ISSN 1125-1964. - STAMPA. - 31:(2019), pp. 201-213. [10.26398/IJAS.0031-011]

Analysis of the prediction ability of a university self-evaluation test: statistical learning methods for predicting student performance

leonardo grilli
2019

Abstract

The School of Economics and Management of the University of Florence uses a self-evaluation test as an instrument to assess the competencies of candidates who want to enrol in the three-year degree program. The aim of this study is to assess if the selfevaluation test scores give a gain in predicting the student performance when added to available student characteristics, such as the high school career. The student performance is measured by three binary indicators based on the number of credits gained after one year. For each binary outcome, the prediction is carried out using both logistic regression and random forest, using two alternative sets of predictors: (i) student characteristics; (ii) student characteristics and test scores. The predictive ability is assessed using 10-fold cross-validation. The main finding of the analysis, which refers to the academic year 2014/2015, is that the self-evaluation test scores do not help in predicting student performance once student characteristics are properly exploited.
2019
31
201
213
leonardo grilli
File in questo prodotto:
File Dimensione Formato  
Hasa Grilli 2019 prediction student - IJAS printed.pdf

accesso aperto

Tipologia: Pdf editoriale (Version of record)
Licenza: Tutti i diritti riservati
Dimensione 95.95 kB
Formato Adobe PDF
95.95 kB Adobe PDF

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1185557
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact