elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Measurement and structural invariance of cognitive ability tests after computer-based training

Hermes, Michael and Albers, Frank and Böhnke, Jan Rasmus and Huelmann, Gerrit and Maier, Julia and Stelling, Dirk (2019) Measurement and structural invariance of cognitive ability tests after computer-based training. Computers in Human Behavior, 93, pp. 370-378. Elsevier. DOI: 10.1016/j.chb.2018.11.040 ISSN 0747-5632

[img] PDF - Registered users only
325kB

Abstract

Ability tests are core elements in performance research as well as in applied contexts and are increasingly carried out using computer-based versions. In the last few decades a whole training and coaching industry has developed to prepare individuals for computer-based assessments. Evidence suggests that such commercial training programs can result in score gains in ability tests, thereby creating an advantage for those who can afford it and challenging the fairness of ability assessment. As a consequence, several authors recommended freely offering training software to all participants to increase measurement fairness. However, it is still an open question whether the unsupervised use of training software could have an impact on the measurement properties of ability tests. The goal of the present study is to fill this gap by examining the subjects’ ability scores for measurement and structural invariance across different amounts of computer-based training. Structural equation modeling was employed in a sample of 15,752 applicants who participated in high-stakes assessments with computer-based ability tests. Across different training amounts, our analyses supported measurement and structural invariance of ability scores. In conclusion, free training software is a means that provides fair preparation opportunities without changing the measurement properties of the tests.

Item URL in elib:https://elib.dlr.de/126047/
Document Type:Article
Title:Measurement and structural invariance of cognitive ability tests after computer-based training
Authors:
AuthorsInstitution or Email of AuthorsAuthors ORCID iD
Hermes, MichaelMichael.Hermes (at) dlr.dehttps://orcid.org/0000-0001-6565-6957
Albers, Frankfrank.albers (at) dlr.deUNSPECIFIED
Böhnke, Jan RasmusUNSPECIFIEDUNSPECIFIED
Huelmann, Gerritgerrit.huelmann (at) dlr.deUNSPECIFIED
Maier, JuliaJulia.Maier (at) dlr.dehttps://orcid.org/0000-0003-1387-7939
Stelling, Dirkdirk.stelling (at) dlr.deUNSPECIFIED
Date:2019
Journal or Publication Title:Computers in Human Behavior
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In SCOPUS:Yes
In ISI Web of Science:Yes
Volume:93
DOI :10.1016/j.chb.2018.11.040
Page Range:pp. 370-378
Publisher:Elsevier
ISSN:0747-5632
Status:Published
Keywords:computer-based training, computer-based testing, cognitive ability, measurement invariance, test fairness
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Aeronautics
HGF - Program Themes:air traffic management and operations
DLR - Research area:Aeronautics
DLR - Program:L AO - Air Traffic Management and Operation
DLR - Research theme (Project):L - Human factors and safety in Aeronautics
Location: Hamburg
Institutes and Institutions:Institute of Aerospace Medicine
Deposited By: Hermes, Michael
Deposited On:21 Jan 2019 11:05
Last Modified:21 Jan 2019 11:05

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.