-
-
Autor*innen: Upsing, Britta; Goldhammer, Frank; Schnitzler, Maya; Baumann, Robert; Johannes, Roland; Barkow, Ingo; Rölke, Heiko; Jars, Isabelle; Latour, Thibaud; Plichart, Patrick; Jadoul, Raynald; Henry, Christopher; Wagner, Mike
Titel: Development of the Cognitive Items
Aus: Organisation for Economic Co-Operation and Development (Hrsg.): Technical Report of the Survey of Adult Skills (PIAAC), Paris: OECD Publishing, 2013 , S. 148-156
URL: https://www.oecd.org/skills/piaac/_Technical Report_17OCT13.pdf#page=148
Dokumenttyp: 4. Beiträge in Sammelwerken; Sammelband (keine besondere Kategorie)
Sprache: Englisch
Abstract: The implementation of the cognitive items for PIAAC faced several challenges. [...] PIAAC was the first international large-scale study to be conducted entirely on the computer. Therefore, existing link items from prior studies like IALS and ALL had to be converted from paper to computer. In addition, new items had to be developed both in literacy and numeracy to take advantage of the new possibilities of computer-based assessment. Further, an entirely new assessment domain, problem solving in technology-rich environments, was defined and items had to be developed. This was all done under a short timeframe in collaboration with participating countries that developed items on their own, as well as by combining item development teams from different countries.
To cope with these challenges, a multifaceted approach was taken, reusing existing item development and test delivery software to the extend possible and developing easy-to-use new software to fill in the gaps.
As a basis, the assessment software TAO was used. In the so-called electronic reading assessment (ERA) option of the PISA 2009 study, TAO was used with the Hypertext Builder, a graphical authoring tool for complex items. This approach was reused and extended for PIAAC, resulting in a completely new version called the CBA (Computer-Based Assessment) ItemBuilder. All in all, the following combination was used: * Test definition, item, sequencing, item questions: TAO * Literacy linking items/stimuli: ItemBuilder * New literacy items/stimuli: ItemBuilder * Numeracy linking items/stimuli: ItemBuilder * New numberacy items /stimuli: ItemBuilder * Problem solving in technology-rich environments: TAO (new item type).
The software and the procedures to produce the items are described in more detail below. (DIPF/Orig.)
DIPF-Abteilung: Bildungsqualität und Evaluation; Informationszentrum Bildung