Ergebnis der Suche in der DIPF Publikationendatenbank

Ihre Abfrage:

(Schlagwörter: "Analyse")

Zu viele Suchergebnisse: Es werden maximal 500 Treffer angezeigt. Bitte grenzen Sie ihre Abfrage in der erweiterten Suche. weiter ein.

Development and evaluation of a framework for the performance-based testing of ICT skills Engelhardt, Lena; Naumann, Johannes; Goldhammer, Frank; Frey, Andreas; Horz, Holger; Hartig, Katja; […] Zeitschriftenbeitrag | In: Frontiers in Education | 2021 41203 Endnote: Autor*innen: Engelhardt, Lena; Naumann, Johannes; Goldhammer, Frank; Frey, Andreas; Horz, Holger; Hartig, Katja; Wenzel, S. Franziska C.
Titel: Development and evaluation of a framework for the performance-based testing of ICT skills
In: Frontiers in Education, (2021) , S. 6:668860
DOI: 10.3389/feduc.2021.668860
URL: https://www.frontiersin.org/articles/10.3389/feduc.2021.668860/full
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Englisch
Schlagwörter: Informations- und Kommunikationstechnologie; Praktische Fertigkeit; Wissen; Problemlösen; Textverständnis; Bildverstehen; Bewertung; Modell; Item; Entwicklung; Testvalidität; Itemanalyse; Rasch-Modell; Implementation; Evaluation; Test; Testverhalten; Schüler; Sekundarstufe I; Baden-Württemberg; Rheinland-Pfalz; Deutschland
Abstract (english): This paper addresses the development of performance-based assessment items for ICT skills, skills in dealing with information and communication technologies, a construct which is rather broadly and only operationally defined. Item development followed a construct-driven approach to ensure that test scores could be interpreted as intended. Specifically, ICT-specific knowledge as well as problem-solving and the comprehension of text and graphics were defined as components of ICT skills and cognitive ICT tasks (i.e., accessing, managing, integrating, evaluating, creating). In order to capture the construct in a valid way, design principles for constructing the simulation environment and response format were formulated. To empirically evaluate the very heterogeneous items and detect malfunctioning items, item difficulties were analyzed and behavior-related indicators with item-specific thresholds were developed and applied. The 69 item's difficulty scores from the Rasch model fell within a comparable range for each cognitive task. Process indicators addressing time use and test-taker interactions were used to analyze whether most test-takers executed the intended processes, exhibited disengagement, or got lost among the items. Most items were capable of eliciting the intended behavior; for the few exceptions, conclusions for item revisions were drawn. The results affirm the utility of the proposed framework for developing and implementing performance-based items to assess ICT skills. (DIPF/Orig.)
DIPF-Abteilung: Lehr und Lernqualität in Bildungseinrichtungen

From byproduct to design factor. On validating the interpretation of process indicators based on […] Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian Zeitschriftenbeitrag | In: Large-scale Assessments in Education | 2021 41612 Endnote: Autor*innen: Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian
Titel: From byproduct to design factor. On validating the interpretation of process indicators based on log data
In: Large-scale Assessments in Education, (2021) , S. 9:20
DOI: 10.1186/s40536-021-00113-5
URN: urn:nbn:de:0111-pedocs-250050
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-250050
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Englisch
Schlagwörter: Leistungstest; Logdatei; PISA <Programme for International Student Assessment>; PIAAC <Programme for the International Assessment of Adult Competencies>; Datenanalyse; Interpretation; Leistungsmessung; Messverfahren; Indikator; Typologie; Testkonstruktion; Testtheorie
Abstract (english): International large-scale assessments such as PISA or PIAAC have started to provide public or scientific use files for log data; that is, events, event-related attributes and timestamps of test-takers' interactions with the assessment system. Log data and the process indicators derived from it can be used for many purposes. However, the intended uses and interpretations of process indicators require validation, which here means a theoretical and/or empirical justification that inferences about (latent) attributes of the test-taker's work process are valid. This article reviews and synthesizes measurement concepts from various areas, including the standard assessment paradigm, the continuous assessment approach, the evidence-centered design (ECD) framework, and test validation. Based on this synthesis, we address the questions of how to ensure the valid interpretation of process indicators by means of an evidence-centered design of the task situation, and how to empirically challenge the intended interpretation of process indicators by developing and implementing correlational and/or experimental validation strategies. For this purpose, we explicate the process of reasoning from log data to low-level features and process indicators as the outcome of evidence identification. In this process, contextualizing information from log data is essential in order to reduce interpretative ambiguities regarding the derived process indicators. Finally, we show that empirical validation strategies can be adapted from classical approaches investigating the nomothetic span and construct representation. Two worked examples illustrate possible validation strategies for the design phase of measurements and their empirical evaluation. (DIPF/Orig.)
DIPF-Abteilung: Lehr und Lernqualität in Bildungseinrichtungen

Are questionnaire scales which measure non-cognitive constructs suitable as school effectiveness […] Grützmacher, Luisa; Vieluf, Svenja; Hartig, Johannes Zeitschriftenbeitrag | In: School Effectiveness and School Improvement | 2021 41472 Endnote: Autor*innen: Grützmacher, Luisa; Vieluf, Svenja; Hartig, Johannes
Titel: Are questionnaire scales which measure non-cognitive constructs suitable as school effectiveness criteria? A measurement invariance analysis
In: School Effectiveness and School Improvement, 32 (2021) 3, S. 430-447
DOI: 10.1080/09243453.2021.1903511
URL: https://www.tandfonline.com/doi/full/10.1080/09243453.2021.1903511
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Englisch
Schlagwörter: Schule; Effektivität; Messverfahren; Fragebogen; Reliabilität; Validität; Schüler; Sekundarbereich; Deutschunterricht; Lesen; Einstellung <Psy>; Mathematikunterricht; Interesse; Selbstkonzept; Mitarbeit; Längsschnittuntersuchung; Datenanalyse; Hamburg; Deutschland
Abstract (english): This study aimed at examining the suitability of questionnaire instruments commonly used in large-scale assessments for measuring non-cognitive school effectiveness criteria. It focused on questions of reliability and validity for capturing changes in students within schools across time and the instruments' sensitivity to school effects. The aim was also to propose an approach for analyzing measurement invariance across levels and time simultaneously. The study used longitudinal data from the KESS (Kompetenzen und Einstellungen von Schülerinnen und Schülern [competencies and attitudes of students]) study, conducted in Hamburg, Germany. The sample is comprised of 17,926 students in 189 secondary schools. Data were collected three or four times. The results of the analyses show that all investigated scales are suitable in terms of reliability and validity. However, only the scale interest in mathematics is sensitive to school effects and therefore suitable as a school effectiveness criterion. (DIPF/Orig.)
DIPF-Abteilung: Lehr und Lernqualität in Bildungseinrichtungen

Changes in school alienation profiles among secondary school students and the role of teaching […] Hadjar, Andreas; Grecu, Alyssa; Scharf, Jan; de Moll, Frederick; Morinaj, Julia; Hascher, Tina Zeitschriftenbeitrag | In: International Journal of Educational Research | 2021 40769 Endnote: Autor*innen: Hadjar, Andreas; Grecu, Alyssa; Scharf, Jan; de Moll, Frederick; Morinaj, Julia; Hascher, Tina
Titel: Changes in school alienation profiles among secondary school students and the role of teaching style. Results from a longitudinal study in Luxembourg and Switzerland
In: International Journal of Educational Research, 105 (2021) , S. 101697
DOI: 10.1016/j.ijer.2020.101697
URN: urn:nbn:de:0111-pedocs-238927
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-238927
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Englisch
Schlagwörter: Schüler; Schule; Entfremdung; Musterbildung; Sekundarstufe I; Übergang; Unterrichtsstil; Längsschnittuntersuchung; Profilanalyse; Sekundäranalyse; Internationaler Vergleich; Luxemburg; Schweiz
Abstract (english): What students think about school has a major impact on learning and academic achievement. The multi-domain concept of school alienation distinguishes between alienation from learning, from teachers and from classmates. We aim to study a) alienation patterns among secondary school students, b) how school alienation profiles change from year 7 to year 9 and how secondary school students transition between profiles, and c) the role of teaching style for transitions between school alienation profiles. We draw on panel data of secondary school students from Luxembourg and Switzerland. Results of latent profile/latent transition analyses reveal distinct school alienation profiles, country differences and support for the idea that student-oriented, supportive teaching styles might prevent students from transitioning towards more-highly alienated profiles.
DIPF-Abteilung: Struktur und Steuerung des Bildungswesens

Automated and controlled processes in comprehending multiple documents Hahnel, Carolin; Goldhammer, Frank; Kroehne, Ulf; Mahlow, Nina; Artelt, Cordula; Schoor, Cornelia Zeitschriftenbeitrag | In: Studies in Higher Education | 2021 41420 Endnote: Autor*innen: Hahnel, Carolin; Goldhammer, Frank; Kroehne, Ulf; Mahlow, Nina; Artelt, Cordula; Schoor, Cornelia
Titel: Automated and controlled processes in comprehending multiple documents
In: Studies in Higher Education, 46 (2021) 10, S. 2074-2086
DOI: 10.1080/03075079.2021.1953333
URN: urn:nbn:de:0111-pedocs-243880
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-243880
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Sprache: Englisch
Schlagwörter: Student; Lesen; Dokument; Vielfalt; Informationsverarbeitung; Verhalten; Lesegeschwindigkeit; Kognitive Prozesse; Arbeitsgedächtnis; Leseverstehen; Kognitive Kompetenz; Test; Computerunterstütztes Verfahren; Datenanalyse; Empirische Untersuchung; Deutschland
Abstract: The study investigates automated and controlled cognitive processes that occur when university students read multiple documents (MDs). We examined data of 401 students dealing with two MD sets in a digital environment. Performance was assessed through several comprehension questions. Recorded log data gave indications about students' time allocation, corroboration, and sourcing. Independent measures were used for reading speed to tap the effects of automatic processing and for working memory and single-text reading comprehension to tap effects of controlled processing, with working memory considered the mental capacity for performing controlled processing. We found that faster readers completed the MD tasks faster and showed more corroboration behavior. At the same time, students skilled in comprehension allocated more time to processing MD tasks and were more likely to show MD-specific behaviors of corroboration and sourcing. Students' success in MD tasks was predicted by reading speed and working memory, with the effect of working memory being mediated by single-text comprehension. Behavioral indicators contributed independently in predicting students' MD comprehension. Results suggest that reading MDs resembles a problem-solving situation where students need to engage in controlled, non-routine processing to build up a comprehensive representation of MDs and benefit from highly automated, lower-level reading processes. (DIPF/Orig.)
DIPF-Abteilung: Lehr und Lernqualität in Bildungseinrichtungen

Integrating information from multiple texts relates to pre-service teachers' epistemic products for […] Hartmann, Ulrike; Kindlinger, Marcus; Trempler, Kati Zeitschriftenbeitrag | In: Teaching and Teacher Education | 2021 40622 Endnote: Autor*innen: Hartmann, Ulrike; Kindlinger, Marcus; Trempler, Kati
Titel: Integrating information from multiple texts relates to pre-service teachers' epistemic products for reflective teaching practice.
In: Teaching and Teacher Education, 97 (2021) 1, S. 103205
DOI: 10.1016/j.tate.2020.103205
URL: https://www.sciencedirect.com/science/article/pii/S0742051X20313962?via%3Dihub
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Englisch
Schlagwörter: Lehrerausbildung; Referendariat; Text; Quelle; Integration; Reflexion <Phil>; Referendar; Kompetenz; Unterrichtsvorbereitung; Experte; Bewertung; Qualitative Forschung; Inhaltsanalyse
Abstract (english): Integrating information from multiple texts is a core aspect of pre-service teachers' preparation for reflective teaching practice. This study connects research on multiple text use with teachers' epistemic reflexivity. Using qualitative content analysis, we investigate how information is integrated to explain real pedagogical situations in essays by 87 pre-service teachers. Competent text integration was related to a higher number of reflexive statements. These analyses are supplemented with an expert rating, showing that essays with competent text integration were rated higher on the quality of their conclusions for professional teaching practice than those without substantial text integration.
DIPF-Abteilung: Bildungsqualität und Evaluation

Erfassung des Potenzials zur kognitiven Aktivierung über Unterrichtsmaterialien im […] Herbert, Benjamin; Schweig, Jonathan Zeitschriftenbeitrag | In: Zeitschrift für Erziehungswissenschaft | 2021 41454 Endnote: Autor*innen: Herbert, Benjamin; Schweig, Jonathan
Titel: Erfassung des Potenzials zur kognitiven Aktivierung über Unterrichtsmaterialien im Mathematikunterricht
In: Zeitschrift für Erziehungswissenschaft, 24 (2021) 4, S. 955-983
DOI: 10.1007/s11618-021-01020-9
URL: https://link.springer.com/article/10.1007%2Fs11618-021-01020-9
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Deutsch
Schlagwörter: Unterrichtsforschung; Unterricht; Qualität; Erhebungsinstrument; Mathematikunterricht; Unterrichtsmaterial; Auswertung; Analyse; Videoaufzeichnung; Messung; Vergleich; Schuljahr 08; Schuljahr 09; Faktorenanalyse; Korrelationsanalyse; Empirische Untersuchung; Deutschland
Abstract: Eine zentrale Voraussetzung der Unterrichtsforschung besteht darin, Unterrichtsmerkmale angemessen zu erfassen. Die Einschätzung des (gefilmten) Unterrichts durch geschulte Rater*innen gilt dabei als Königsweg, ist jedoch mit einem hohen organisatorischen und zeitlichen Aufwand verbunden. Im Rahmen dieses Artikels wird ein neu entwickeltes Erhebungsinstrument für das Unterrichtsqualitätsmerkmal des Potenzials zur kognitiven Aktivierung (PKA) vorgestellt. Das Instrument wurde für Mathematikunterricht zum Thema Quadratische Gleichungen entwickelt, basiert auf der gemeinsamen Auswertung aller Unterrichtsmaterialien einer Stunde durch geschulte Rater*innen und erfasst die von der Lehrperson schriftlich in den Unterricht getragenen Potenziale für kognitive Aktivierung. Die Validität der intendierten Interpretation als Indikator für das schriftlich in den Unterricht eingebrachte PKA einer Unterrichtstunde wird über einen argumentationsbasierten Ansatz untersucht und kann über verschiedene Evidenzen gestützt werden: Beispielsweise zeigt eine D Studie, dass das Instrument bereits von einer einzigen Rater*in zuverlässig erfasst werden kann. Zudem korreliert es substanziell mit einer auf Videoratings basierenden Messung des PKA. (DIPF/Orig.)
Abstract (english): A central challenge of instructional research is to measure teaching characteristics appropriately. The assessment of (filmed) instruction by trained raters is regarded as the best way to achieve this, but is associated with high organizational and time costs. In this paper, we present a newly developed instrument for assessing the teaching quality characteristic potential for cognitive activation (PCA). The instrument was developed for mathematics lessons on the topic of quadratic equations. It is based on the joint evaluation of all instructional artifacts of a lesson (lesson plans, student assignments, assessments, etc.) by trained raters and measures the potential for cognitive activation brought into the classroom by the teacher in writing. The validity of the intended interpretation as an indicator for the written PCA of a lesson is examined by an argument-based approach and can be supported by various pieces of evidence: For example, a decision study shows that the instrument can already be reliably assessed by a single rater. Furthermore, it correlates substantially with a measurement of the PCA based on video ratings. (DIPF/Orig.)
DIPF-Abteilung: Lehr und Lernqualität in Bildungseinrichtungen

Evaluating QualiCO. An ontology to facilitate qualitative methods sharing to support open science Hocker, Julian; Bipat, Taryn; McDonald, David W.; Zachry, Marc Zeitschriftenbeitrag | In: Journal of Internet Services and Applications | 2021 41442 Endnote: Autor*innen: Hocker, Julian; Bipat, Taryn; McDonald, David W.; Zachry, Marc
Titel: Evaluating QualiCO. An ontology to facilitate qualitative methods sharing to support open science
In: Journal of Internet Services and Applications, (2021) , S. 12:5
DOI: 10.1186/s13174-021-00135-w
URL: https://jisajournal.springeropen.com/articles/10.1186/s13174-021-00135-w
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Englisch
Schlagwörter: Ontologie; qualitative Forschung; Methode; Codierung; Open Science; Forschungsdaten; Metadaten; Datenaustausch; Student; Forscher; Benutzerfreundlichkeit; Evaluation; Leitfadeninterview; Inhaltsanalyse; USA
Abstract (english): Qualitative science methods have largely been omitted from discussions of open science. Platforms focused on qualitative science that support open science data and method sharing are rare. Sharing and exchanging coding schemas has great potential for supporting traceability in qualitative research as well as for facilitating the reuse of coding schemas. In this study, we present and evaluate QualiCO, an ontology to describe qualitative coding schemas. Twenty qualitative researchers used QualiCO to complete two coding tasks. In our findings, we present task performance and interview data that focus participants' attention on the ontology. Participants used QualiCO to complete the coding tasks, decreasing time on task, while improving accuracy, signifying that QualiCO enabled the reuse of qualitative coding schemas. Our discussion elaborates some issues that participants had and highlights how conceptual and prior practice frames their interpretation of how QualiCO can be used. (DIPF/Orig.)
DIPF-Abteilung: Informationszentrum Bildung

Examining the contribution of RAN components to reading fluency, reading comprehension, and […] Huschka, Sina Simone; Georgiou, George K.; Brandenburg, Janin; Ehm, Jan-Henning; Hasselhorn, Marcus Zeitschriftenbeitrag | In: Reading and Writing | 2021 41177 Endnote: Autor*innen: Huschka, Sina Simone; Georgiou, George K.; Brandenburg, Janin; Ehm, Jan-Henning; Hasselhorn, Marcus
Titel: Examining the contribution of RAN components to reading fluency, reading comprehension, and spelling in German
In: Reading and Writing, 34 (2021) 9, S. 2317-2336
DOI: 10.1007/s11145-021-10145-6
URL: https://link.springer.com/article/10.1007/s11145-021-10145-6
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Englisch
Schlagwörter: Benennung; Geschwindigkeit; Lesefertigkeit; Leseverstehen; Rechtschreibung; Fonologische Bewusstheit; Buchstabe; Wissen; Fonologie; Kurzzeitgedächtnis; Kindergartenkind; Grundschule; Schüler; Schuljahr 01; Regressionsanalyse; Frankfurt <Main>; Deutschland
Abstract (english): We examined the contribution of rapid automatized naming (RAN) components (articulation time, pause time, and pause time consistency) to reading fluency, reading comprehension, and spelling in a sample of 257 German children (139 boys, 118 girls; Mage = 5.60 years, SD = 0.31) followed from kindergarten to Grade 1. In kindergarten, children were assessed on measures of RAN (colors and objects), phonological awareness, letter-sound knowledge, phonological short-term memory, and paired-associate learning. Reading fluency, reading comprehension, and spelling were assessed at the end of Grade 1. Hierarchical regression analyses revealed that pause time and pause time consistency continued to predict reading fluency, but not reading comprehension or spelling, after controlling for the effects of the other cognitive skills assessed in kindergarten. Articulation time did not add to the prediction of any literacy skills. These findings support previous research suggesting that, during the early phases of learning to read, pause time holds the key in the relation between RAN and reading fluency. (DIPF/Orig,)
DIPF-Abteilung: Bildung und Entwicklung

"Das ist jammerschade" Vom Unterricht in Abwesenheit wegen pandemiebedingter Schulschließungen Jornitz, Sieglinde; Mayer, Ben Zeitschriftenbeitrag | In: Pädagogische Korrespondenz | 2021 42242 Endnote: Autor*innen: Jornitz, Sieglinde; Mayer, Ben
Titel: "Das ist jammerschade" Vom Unterricht in Abwesenheit wegen pandemiebedingter Schulschließungen
In: Pädagogische Korrespondenz, 63 (2021) , S. 66-84
Dokumenttyp: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Sprache: Deutsch
Schlagwörter: Schule; Pandemie; Unterricht; Distanz; Veränderung; Krise; Pädagogisches Handeln; Lernplattform; Digitale Medien; Tool; Unterrichtsmaterial; Aufgabenstellung; Organisation; Lehrer; Fallbeispiel; Interview; Analyse; Bremen; Frankfurt a.M.; Deutschland
Abstract: Die Autor*innen analysieren zwei Interviews mit zwei Lehrkräften, die sie während der ersten Schulschließungen in Deutschland im Frühjahr 2021 aufgrund der Covid-19-Pandemie veranlasst wurden. Es zeigt sich, dass die Lehrer*innen entgegen der politischen Maßgabe, weiter zu unterrichten, dies nicht aufgrund diverser Gründe, die im Interview dargelegt werden, nicht geschah. (DIPF/Autor)
DIPF-Abteilung: Informationszentrum Bildung

Ergebnis der Suche in der DIPF Publikationendatenbank

Zu viele Suchergebnisse