-
-
Autor*innen: Drachsler, Hendrik; Stoyanov, Slavi; d'Aquin, Mathieu; Herder, Eelco; Guy, Marieke; Dietze, Stefan
Titel: An evaluation framework for data competitions in TEL
Aus: Rensing, Christoph;de Freitas, Sara;Ley, Tobias;Muñoz-Merino, Pedro J. (Hrsg.): Open learning and teaching in educational communities: 9th European Conference on Technology Enhanced Learning, EC-TEL 2014, Graz, Austria, September 16-19, 2014, Proceedings, Cham: Springer, 2014 (Information Systems and Applications, incl. Internet/Web, and HCI, 8719), S. 70-83
DOI: 10.1007/978-3-319-11200-8_6
Dokumenttyp: 4. Beiträge in Sammelwerken; Tagungsband/Konferenzbeitrag/Proceedings
Sprache: Englisch
Abstract: This paper presents a study describing the development of an Evaluation Framework (EF) for data competitions in TEL. The study applies the Group Concept Method (GCM) to empirically depict criteria and their indicators for evaluating software applications in TEL. A statistical analysis including multidimensional scaling and hierarchical clustering on the GCM data identified the following six evaluation criteria: 1.Educational Innovation, 2.Usability, 3.Data, 4.Performance, 5.Privacy, and 6.Audience. Each of them was operationalized through a set of indicators. The resulting Evaluation Framework (EF) incorporating these criteria was applied to the first data competition of the LinkedUp project. The EF was consequently improved using the results from reviewers' interviews, which were analysed qualitatively and quantitatively. The outcome of these efforts is a comprehensive EF that can be used for TEL data competitions and for the evaluation of TEL tools in general. (Orig.)