Search results in the DIPF database of publications

Your query:

(Schlagwörter: "Indikator")

Caught in the lifelong learning maze. Helping People with Learning analytics and chatbots to find […] Ahmad, Atezaz; Kiesler, Natalie; Schiffner, Daniel; Schneider, Jan; Wollny, Sebastian Journal Article | In: International Journal of Information and Education Technology | 2023 43534 Endnote: Author(s): Ahmad, Atezaz; Kiesler, Natalie; Schiffner, Daniel; Schneider, Jan; Wollny, Sebastian
Title: Caught in the lifelong learning maze. Helping People with Learning analytics and chatbots to find personal career paths
In: International Journal of Information and Education Technology, 13 (2023) 3, S. 423-429
DOI: 10.18178/ijiet.2023.13.3.1822
URL: http://www.ijiet.org/show-186-2416-1.html
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Analyse; Beratung; Chat; Deutschland; E-Learning; Erwachsenenbildung; Fragebogenerhebung; Indikator; Kurs; Learning Analytics; Lebenslanges Lernen; Lernplattform; Metadaten; Neue Technologien; Nutzer; Software; Sprachverarbeitung; Technologieunterstütztes Lernen; Textverarbeitung; Workshop
Abstract (english): Current lifelong learning platforms offer users a query option to select a wide variety of courses. However, finding a suitable course among the seemingly endless catalogs of options presented by the platforms is not straightforward. We argue that digital counseling can enhance this process. In this paper, we present a set of three formative studies where we explored the main aspects that can provide the counseling needed. The methods comprise an analysis of user profile characteristics and learning analytics indicators (e.g., learning progress/self-regulation) by means of an expert workshop, evaluating the feasibility of current technologies (e.g., natural language processing) for automatically assessing users' competencies, and a survey on the use of Chatbots as the interaction interface between the users and the lifelong learning portals. The analysis resulted in the extraction of basic requirements for digital counseling. We conclude the paper by presenting a system design derived from these studies. (DIPF/Orig.)
DIPF-Departments: Informationszentrum Bildung

A trusted learning analytics dashboard for displaying OER Ahmad, Atezaz; Yordanov, Ivaylo Ivanov; Yau, Jane; Schneider, Jan; Drachsler, Hendrik Book Chapter | Aus: Otto, Daniel; Scharnberg, Gianna; Kerres, Michael; Zawacki-Richter, Olaf (Hrsg.): Distributed learning ecosystems: Concepts, resources, and repositories | Wiesbaden: Springer | 2023 43376 Endnote: Author(s): Ahmad, Atezaz; Yordanov, Ivaylo Ivanov; Yau, Jane; Schneider, Jan; Drachsler, Hendrik
Title: A trusted learning analytics dashboard for displaying OER
In: Otto, Daniel; Scharnberg, Gianna; Kerres, Michael; Zawacki-Richter, Olaf (Hrsg.): Distributed learning ecosystems: Concepts, resources, and repositories, Wiesbaden: Springer, 2023 , S. 279-303
DOI: 10.1007/978-3-658-38703-7_15
URL: https://link.springer.com/chapter/10.1007/978-3-658-38703-7_15
Publication Type: 4. Beiträge in Sammelbänden; Sammelband (keine besondere Kategorie)
Language: Englisch
Keywords: Datenanalyse; Datenerfassung; Indikator; Internetplattform; Learning Analytics; Lernplattform; Literaturbericht; Open Educational Resources; Technologie
Abstract: Learning Analytics (LA) consists of miscellaneous steps that include data harvesting, storing, cleaning, anonymisation, mining, analysis, and visualisation so that the vast amount of educational data is comprehensible and ethically utilisable by educators or instructors to obtain the advantages and benefits that LA can bring to the educational scene. These include the potential to increase learning experiences and reduce dropout rates. In this chapter, we shed light on OER repositories, LA, and LA dashboards and present an implementation of a research-driven LA dashboard for displaying OER and their repositories that allows the visualisation of educational data in an understandable way for both educators and learners. Moreover, we present an LA dashboard for displaying OER that shows information about the existing German OER repositories as part of our EduArc project located in Germany. The LA dashboard consists of multiple adopted indicators and metrics such as the number of reading sessions, duration of reading sessions, number of reading interruptions, number of learning activities, student attendance, and student grades. The details of the research methodology, including a literature review to create this dashboard, as well as the display items of the dashboard are presented and further elaborated. (DIPF/Autor)
DIPF-Departments: Informationszentrum Bildung

Nutzung. Individuelle Zugänge zu und Beteiligung an kultureller Bildung Belet, Margot; Stelter, Yannick; Kühne, Stefan Book Chapter | Aus: Kühne, Stefan; Maaz, Kai (Hrsg.): Indikatorenentwicklung im Feld der kulturellen Bildung (InKuBi): Konzeptionelle Grundlagen und erste Befunde | Bielefeld: wbv Media | 2023 43834 Endnote: Author(s): Belet, Margot; Stelter, Yannick; Kühne, Stefan
Title: Nutzung. Individuelle Zugänge zu und Beteiligung an kultureller Bildung
In: Kühne, Stefan; Maaz, Kai (Hrsg.): Indikatorenentwicklung im Feld der kulturellen Bildung (InKuBi): Konzeptionelle Grundlagen und erste Befunde, Bielefeld: wbv Media, 2023 , S. 51-68
URL: https://www.wbv.de/shop/Indikatorenentwicklung-im-Feld-der-kulturellen-Bildung-InKuBi-6004954w
Publication Type: 4. Beiträge in Sammelbänden; Sammelband (keine besondere Kategorie)
Language: Deutsch
Keywords: Außerschulischer Lernort; Ausstattung; Bildungsangebot; Bildungsbericht; Bildungsbeteiligung; Bildungseinrichtung; Bildungsmonitoring; Daten; Datenanalyse; Deutschland; Formale Bildung; Indikator; Information; Informelle Bildung; Kompetenzentwicklung; Kulturelle Bildung; Kulturelles Leben; Kunst; Literatur; Musik; Non-formale Bildung; Nutzung; Partizipation; Personal; Persönlichkeitsentwicklung; Politisches Bewusstsein; Schule; Sekundäranalyse; Soziale Partizipation; Soziodemografie; Unterrichtszeit; Verfügbarkeit; Wirkung; Zeitbudget; Zugang
Abstract: Der nachfolgende Teil dieses Berichts soll zunächst einen Überblick darüber geben, wie Jugendliche sich in unterschiedlichen Lernkontexten an kultureller Bildung beteiligen (C1). […] Anschließend werden zentrale Ergebnisse über die besser erfassten kulturellen Freizeitaktivitäten von Kindern und Jugendlichen aufgezeigt (C2). […] Wie Individuen überhaupt mit kulturellen Bildungsoptionen in Berührung kommen (können), wird in einem eigenständigen Indikator thematisiert (C3). C4 zeigt am Beispiel des Musizierens in der Freizeit, wie die in C1-C3 beschriebenen Aktivitäten anhand von drei soziodemographischen Merkmalen - Sozialstatus, Geschlecht und Migrationshintergrund - vertieft werden können. Diese Analyseperspektive sollte zukünftig breiter erfolgen als hier im Bericht, der sich nur auf eine Aktivität (Musizieren) aus einer künstlerischen Sparte (Musik) in einem Lernkontext (Freizeit) bezieht. […] Als zweite querliegende Analyseperspektive neben den sozialen Disparitäten gilt es […] auch aus spartenspezifischer Perspektive zu konkretisieren und zu vertiefen. Dies erfolgt in C5 am Beispiel der verhältnismäßig gut erfassten Sparte Musik. (DIPF/Orig.)
DIPF-Departments: Struktur und Steuerung des Bildungswesens

Die Erfassung von Publikationen aus der Datennutzung. Verfahren, Herausforderungen und Nutzen. Ein […] Daniel, Andreas; Jakowatz, Stefan; Jung, Nadeshda; Kleine, Lydia; Kocaj, Aleksander; […] Working Papers | 2023 43678 Endnote: Author(s): Daniel, Andreas; Jakowatz, Stefan; Jung, Nadeshda; Kleine, Lydia; Kocaj, Aleksander; Meyermann, Alexia; Mozygemba, Kati; Schuster, Alexander
Title: Die Erfassung von Publikationen aus der Datennutzung. Verfahren, Herausforderungen und Nutzen. Ein Erfahrungsbericht von Forschungsdatenzentren
Published: Berlin: Rat für Sozial- und Wirtschaftsdaten, 2023
DOI: 10.17620/02671.80
URL: https://www.konsortswd.de/aktuelles/publikation/publikationserfassung/
Publication Type: 5. Arbeits- und Diskussionspapiere; weitere Arbeits- und Diskussionspapiere
Language: Deutsch
Keywords: Angebot; Bibliografie; Datenerfassung; Evaluation; Forschungsdaten; Leistungsindikator; Nutzung; Publikation; Sekundäranalyse
Abstract: Publikationen sind im Wissenschaftssystem das wesentliche Medium zur Kommunikation von Erkenntnissen und werden häufig als Indikator für wissenschaftliche Leistung herangezogen. Für Forschungsdatenzentren (FDZ) erfüllen Publikationen weitere Funktionen: Verknüpft mit den zugrundeliegenden Forschungsdaten dienen sie als wichtige Informationsquelle für potentielle Datennutzer:innen. Zudem wird die Anzahl der auf Basis von Nachnutzungen entstandenen Publikationen als ein Evaluationskriterium für die Datendienste der FDZ herangezogen und das, obwohl die Erfassung dieser Publikationen mit einer Reihe von Herausforderungen verbunden ist. Der vorliegende Artikel beschreibt die verschiedenen Vorgehensweisen von FDZ bei der Erfassung von Publikationen, die aus der Nutzung von Forschungsdaten entstehen, und diskutiert damit einhergehende Probleme der Fehl-, Über- und Untererfassung. Es zeigt sich, dass die verschiedenen Verfahren der Erfassung mit je unterschiedlichen Schwierigkeiten behaftet sind, die ihre Verwendung als Leistungsindikator relativieren. Einen Königsweg gibt es derzeit nicht; stattdessen wird eine Kombination aus unterschiedlichen Vorgehensweisen empfohlen, die auch in Abhängigkeit von der jeweiligen Größe des Datenbestands eines FDZ und den jeweiligen Nutzer:innen zu bewerten ist. (DIPF/Orig.)
DIPF-Departments: Informationszentrum Bildung

From byproduct to design factor. On validating the interpretation of process indicators based on […] Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian Journal Article | In: Large-scale Assessments in Education | 2021 41612 Endnote: Author(s): Goldhammer, Frank; Hahnel, Carolin; Kroehne, Ulf; Zehner, Fabian
Title: From byproduct to design factor. On validating the interpretation of process indicators based on log data
In: Large-scale Assessments in Education, 9 (2021) , S. 20
DOI: 10.1186/s40536-021-00113-5
URN: urn:nbn:de:0111-pedocs-250050
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-250050
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Leistungstest; Logdatei; PISA <Programme for International Student Assessment>; PIAAC <Programme for the International Assessment of Adult Competencies>; Datenanalyse; Interpretation; Leistungsmessung; Messverfahren; Indikator; Typologie; Testkonstruktion; Testtheorie
Abstract (english): International large-scale assessments such as PISA or PIAAC have started to provide public or scientific use files for log data; that is, events, event-related attributes and timestamps of test-takers' interactions with the assessment system. Log data and the process indicators derived from it can be used for many purposes. However, the intended uses and interpretations of process indicators require validation, which here means a theoretical and/or empirical justification that inferences about (latent) attributes of the test-taker's work process are valid. This article reviews and synthesizes measurement concepts from various areas, including the standard assessment paradigm, the continuous assessment approach, the evidence-centered design (ECD) framework, and test validation. Based on this synthesis, we address the questions of how to ensure the valid interpretation of process indicators by means of an evidence-centered design of the task situation, and how to empirically challenge the intended interpretation of process indicators by developing and implementing correlational and/or experimental validation strategies. For this purpose, we explicate the process of reasoning from log data to low-level features and process indicators as the outcome of evidence identification. In this process, contextualizing information from log data is essential in order to reduce interpretative ambiguities regarding the derived process indicators. Finally, we show that empirical validation strategies can be adapted from classical approaches investigating the nomothetic span and construct representation. Two worked examples illustrate possible validation strategies for the design phase of measurements and their empirical evaluation. (DIPF/Orig.)
DIPF-Departments: Lehr und Lernqualität in Bildungseinrichtungen

Literature review on co-located collaboration modeling using multimodal learning analytics. Can we […] Praharaj, Sambit; Scheffel, Maren; Drachsler, Hendrik; Specht, Marcus Journal Article | In: IEEE Transactions on Learning Technologies | 2021 41441 Endnote: Author(s): Praharaj, Sambit; Scheffel, Maren; Drachsler, Hendrik; Specht, Marcus
Title: Literature review on co-located collaboration modeling using multimodal learning analytics. Can we go the whole nine yards?
In: IEEE Transactions on Learning Technologies, 14 (2021) 3, S. 367-385
DOI: 10.1109/TLT.2021.3097766
URL: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9490371
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Learning Analytics; Modell; Kooperation; Gruppenarbeit; Qualität; Indikator; Einflussfaktor; Situation; Soziale Interaktion; Verhalten; Kommunikation; Nonverbale Kommunikation; Raum; Systematic Review
Abstract: Collaboration is one of the important 21st-century skills. It can take place in remote or co-located settings. Co-located collaboration (CC) is a very complex process that involves subtle human interactions that can be described with indicators like eye gaze, speaking time, pitch, and social skills from different modalities. With the advent of sensors, multimodal learning analytics has gained momentum to detect CC quality. Indicators (or low-level events) can be used to detect CC quality with the help of measurable markers (i.e., indexes composed of one or more indicators) which give the high-level collaboration process definition. However, this understanding is incomplete without considering the scenarios (such as problem solving or meetings) of CC. The scenario of CC affects the set of indicators considered: for instance, in collaborative programming, grabbing the mouse from the partner is an indicator of collaboration; whereas in collaborative meetings, eye gaze, and audio level are indicators of collaboration. This can be a result of the differing goals and fundamental parameters (such as group behavior, interaction, or composition) in each scenario. In this review, we present our work on profiles of indicators on the basis of a scenario-driven prioritization, the parameters in different CC scenarios are mapped onto the indicators and the available indexes. This defines the conceptual model to support the design of a CC quality detection and prediction system. (DIPF/Orig.)
DIPF-Departments: Informationszentrum Bildung

Personality across the lifespan. Exploring measurement invariance of a short Big Five inventory […] Brandt, Naemi D.; Becker, Michael; Tetzner, Julia; Brunner, Martin; Kuhl, Poldi; Maaz, Kai Journal Article | In: European Journal of Psychological Assessment | 2020 40322 Endnote: Author(s): Brandt, Naemi D.; Becker, Michael; Tetzner, Julia; Brunner, Martin; Kuhl, Poldi; Maaz, Kai
Title: Personality across the lifespan. Exploring measurement invariance of a short Big Five inventory from ages 11 to 84
In: European Journal of Psychological Assessment, 36 (2020) 1, S. 162-173
DOI: 10.1027/1015-5759/a000490
URL: https://econtent.hogrefe.com/doi/10.1027/1015-5759/a000490
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Deutschland; Persönlichkeit; Persönlichkeitsmerkmal; Lebensalter; Kindheit; Jugendalter; Erwachsener; Alter; Einflussfaktor; Indikator; Validität; Erhebungsinstrument; Temperament; Messverfahren; Vergleich; Faktorenanalyse; Strukturgleichungsmodell
Abstract: Personality is a relevant predictor for important life outcomes across the entire lifespan. Although previous studies have suggested the comparability of the measurement of the Big Five personality traits across adulthood, the generalizability to childhood is largely unknown. The present study investigated the structure of the Big Five personality traits assessed with the Big Five Inventory-SOEP Version (BFI-S; SOEP = Socio-Economic Panel) across a broad age range spanning 11-84 years. We used two samples of N = 1,090 children (52% female, Mage = 11.87) and N = 18,789 adults (53% female, Mage = 51.09), estimating a multigroup CFA analysis across four age groups (late childhood: 11-14 years; early adulthood: 17-30 years; middle adulthood: 31-60 years; late adulthood: 61-84 years). Our results indicated the comparability of the personality trait metric in terms of general factor structure, loading patterns, and the majority of intercepts across all age groups. Therefore, the findings suggest both a reliable assessment of the Big Five personality traits with the BFI-S even in late childhood and a vastly comparable metric across age groups. (DIPF/Orig.)
DIPF-Departments: Struktur und Steuerung des Bildungswesens

Personality across the lifespan. Exploring measurement invariance of a short big five inventory […] Brandt, Naemi; Becker, Michael; Tetzner, Julia; Brunner, Martin; Kuhl, Poldi; Maaz, Kai Journal Article | In: European Journal of Psychological Assessment. | 2020 38867 Endnote: Author(s): Brandt, Naemi; Becker, Michael; Tetzner, Julia; Brunner, Martin; Kuhl, Poldi; Maaz, Kai
Title: Personality across the lifespan. Exploring measurement invariance of a short big five inventory from ages 11 to 84
In: European Journal of Psychological Assessment., 36 (2020) 1, S. 162-173
DOI: 10.1027/1015-5759/a000490
URL: https://econtent.hogrefe.com/doi/10.1027/1015-5759/a000490
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: Altersgruppe; Vergleich; Validität; Reliabilität; Persönlichkeit; Messung; Indikator; Lebensalter; Erhebungsinstrument; Persönlichkeitsmerkmal; Kind; Grundschulalter; Erwachsener; Alter Mensch;
Abstract: Personality is a relevant predictor for important life outcomes across the entire lifespan. Although previous studies have suggested the comparability of the measurement of the Big Five personality traits across adulthood, the generalizability to childhood is largely unknown. The present study investigated the structure of the Big Five personality traits assessed with the Big Five Inventory-SOEP Version (BFI-S; SOEP = Socio-Economic Panel) across a broad age range spanning 11-84 years. We used two samples of N = 1,090 children (52% female, Mage = 11.87) and N = 18,789 adults (53% female, Mage = 51.09), estimating a multigroup CFA analysis across four age groups (late childhood: 11-14 years; early adulthood: 17-30 years; middle adulthood: 31-60 years; late adulthood: 61-84 years). Our results indicated the comparability of the personality trait metric in terms of general factor structure, loading patterns, and the majority of intercepts across all age groups. Therefore, the findings suggest both a reliable assessment of the Big Five personality traits with the BFI-S even in late childhood and a vastly comparable metric across age groups. (DIPF/Orig.)
DIPF-Departments: Struktur und Steuerung des Bildungswesens

Using process data to explain group differences in complex problem solving Eichmann, Beate; Goldhammer, Frank; Greiff, Samuel; Brandhuber, Liene; Naumann, Johannes Journal Article | In: Journal of Educational Psychology | 2020 39868 Endnote: Author(s): Eichmann, Beate; Goldhammer, Frank; Greiff, Samuel; Brandhuber, Liene; Naumann, Johannes
Title: Using process data to explain group differences in complex problem solving
In: Journal of Educational Psychology, 112 (2020) 8, S. 1546-1562
DOI: 10.1037/edu0000446
URN: urn:nbn:de:0111-pedocs-232721
URL: https://nbn-resolving.org/urn:nbn:de:0111-pedocs-232721
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Aufsatz (keine besondere Kategorie)
Language: Englisch
Keywords: PISA <Programme for International Student Assessment>; Problemlösen; Schülerleistung; Leistungsmessung; Geschlechtsspezifischer Unterschied; Migrationshintergrund; Computerunterstütztes Verfahren; Logdatei; Interaktion; Exploration; Verhalten; Vorwissen; Wirkung; Indikator; Leistung; Unterschied; Messverfahren; OECD-Länder
Abstract: In large-scale assessments, performance differences across different groups are regularly found. These group differences (e.g., gender differences) are often relevant for educational policy decisions and measures. However, the formation of these group differences usually remains unclear. We propose an approach for investigating this formation by considering behavioral process measures as mediating variables between group membership and performance on the 2012 Programme for International Student Assessment complex problem solving (CPS) items. We found that across all investigated countries interactive behavior can fully explain gender differences in CPS, but cannot explain differences between students with and without a migration background. However, in some countries these results differ from the cross-country results. Our results indicate that process measures derived from log data are useful for further investigating and explaining performance differences between girls and boys and students with and without migration background. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation

Do student ratings of classroom management tell us more about teachers or about classroom […] Göllner, Richard; Fauth, Benjamin; Lenske, Gerlinde; Praetorius, Anna-Katharina; Wagner, Wolfgang Journal Article | In: Zeitschrift für Pädagogik. Beiheft | 2020 40729 Endnote: Author(s): Göllner, Richard; Fauth, Benjamin; Lenske, Gerlinde; Praetorius, Anna-Katharina; Wagner, Wolfgang
Title: Do student ratings of classroom management tell us more about teachers or about classroom composition?
In: Zeitschrift für Pädagogik. Beiheft, 66 (2020) , S. 156-172
Publication Type: 3a. Beiträge in begutachteten Zeitschriften; Beitrag in Sonderheft
Language: Englisch
Keywords: Einflussfaktor; Faktorenanalyse; Längsschnittuntersuchung; Deutschland; Klassenführung; Wahrnehmung; Schüler; Bewertung; Geschlechtsspezifischer Unterschied; Lehrer; Schuljahr 09; Schuljahr 10; Zusammensetzung; Mathematikunterricht; Leistungsdifferenzierung; Mathematische Kompetenz; Qualität; Unterrichtsklima; Unterrichtsstörung; Indikator
Abstract: The present study investigated whether the varying referents (i.e., teacher or student referent) of student ratings of established classroom management measures differ in their associations with compositional classroom characteristics and students' math achievement. Re-analysis of a large-scale dataset (PISA 2003) showed that classrooms with a higher proportion of male students, as well as those with lower math performance, exhibited lower scores on classroom management factors referring more to students than the teacher. These were in turn related to lower pre-adjusted math achievement of students. There were no associations with a measure referring to the teacher. Our results indicate that varying referents tap into different aspects of the classroom management process. (DIPF/Orig.)
DIPF-Departments: Bildungsqualität und Evaluation