NEPS / National Educational Panel Study

The TBA project of the DIPF is in charge of two tasks within the national NEPS consortium:

• In preparation of the test on an electronic basis, equivalence studies are conducted for identifying possible differences between pen-and-paper tests and computer-based assessments (DIF-analyses) and that allow for a linking with paper-based outcomes.
• The software development for a data warehouse that allows for a quick access to the data by taking data protection into account.

The Mode Effect Studies consist of testing the comparability (equivalence) of paper-based assessments (PBA) and computer-based assessments (CBA) by means of different criteria. The data warehouse is set up with the aim of creating a unified database for the complete NEPS study and of delivering appropriate instruments for filtering and reporting.

The Mode Effect Studies are carried out in addition to the paper-based assessment conducted in pillar 1 (competence development in the life course) and in the NEPS system, they represent a second, slimmer competence pillar using computer-based assessment procedures for selected areas of competence, by applying established methods,  for selected starting cohorts. The group of university students is an exception heer as the CBA method will be used for the regular assessment here.

Data Warehouse: Three continuous processes develop in parallel from the requirements throughout the duration of the project:

(1) Implementation, optimisation and further development of the databases,
(2) Implementation, optimisation and further development of ETL- and reporting tools,
(3) Implementation, optimisation and further development of the web portal.

Practical use of the findings

Mode Effect Studies: An important contribution is made to delivering empirical data that are well documented and easily accessible for empirical educational research, and which are indispensible to planning further NEPS cycles with regard to psychometric appropriateness, aspects of fairness and the technological feasibility of CBA.

Data Warehouse: the data gained from the four rounds of assessment as well as the tools for filtering and generating reports will be available to all of the research community once the project is completed.

The project is funded by the Federal Ministry of Education and Research (BMBF).