Launching Registered Report Replications in Computer Science Education Research Publikationsdatum:
|
|
Diese Seite wurde seit 2 Jahren inhaltlich nicht mehr aktualisiert.
Unter Umständen ist sie nicht mehr aktuell.
Zusammenfassungen
Background and Context. The quality of a research field is greatly determined by the quality of its publications. However, in many research fields this quality is endangered because of biases towards publishing positive results, which have led to questionable research practices that negatively impact the reliability of the reported findings. Objectives. We explored two approaches that could guard against these questionable research practices for computer science education research: 1. The replication of prior studies to confirm (or refute) previous findings and 2. requiring authors to submit a registered report, containing hypotheses, methods, and analytic procedures, before conducting the studies.
b>Method. Over the span of 18 months, we organized a special issue of the Computer Science Education journal that only accepted registered reports that replicated a previous computer science education research study. Registered reports involve peer review and approval at the research design stage, before data collection begins. The editorial process was thus modified to accommodate multiple rounds of review and a longer time period between original and final submissions.We believe this is the first use of registered reports in computer science education research. A questionnaire gathering feedback on the new process was also administered to the authors of the accepted reports.
Findings. We found seven author teams willing to submit a manuscript for the special issue. Out of this pool, preregistered reports from five teams were accepted to be taken forwards. One team then withdrew because the ethics procedure at their institution exceeded the special issue timeline. The remaining four author teams conducted their studies and resubmitted full papers that were accepted, pending some final corrections. Authors’ feedback about the registered reports process was positive.
Implications. We demonstrated that it is possible to attract interest for registered report replications in a computer science education journal issue, and to successfully conduct the necessary editorial steps. Future efforts should attend to challenges related to modified research and journal submission timelines and consider adding a second review cycle for the first stage of registered reports. While the procedures used in this special issue may be suitable for many research approaches, further discussion is warranted on how they can be combined with exploratory research (as opposed to hypothesis testing research) and how they can be adapted to non-positivist research.
Von Neil Brown, Eva Marinus, Aleata Hubbard Cheuoua im Text Launching Registered Report Replications in Computer Science Education Research (2022) b>Method. Over the span of 18 months, we organized a special issue of the Computer Science Education journal that only accepted registered reports that replicated a previous computer science education research study. Registered reports involve peer review and approval at the research design stage, before data collection begins. The editorial process was thus modified to accommodate multiple rounds of review and a longer time period between original and final submissions.We believe this is the first use of registered reports in computer science education research. A questionnaire gathering feedback on the new process was also administered to the authors of the accepted reports.
Findings. We found seven author teams willing to submit a manuscript for the special issue. Out of this pool, preregistered reports from five teams were accepted to be taken forwards. One team then withdrew because the ethics procedure at their institution exceeded the special issue timeline. The remaining four author teams conducted their studies and resubmitted full papers that were accepted, pending some final corrections. Authors’ feedback about the registered reports process was positive.
Implications. We demonstrated that it is possible to attract interest for registered report replications in a computer science education journal issue, and to successfully conduct the necessary editorial steps. Future efforts should attend to challenges related to modified research and journal submission timelines and consider adding a second review cycle for the first stage of registered reports. While the procedures used in this special issue may be suitable for many research approaches, further discussion is warranted on how they can be combined with exploratory research (as opposed to hypothesis testing research) and how they can be adapted to non-positivist research.
Dieses Konferenz-Paper erwähnt ...
Personen KB IB clear | Amjad AlTadmri , George Christopher Banks , Lecia Barker , Jens Bennedsen , Neil C. C. Brown , Michael E. Caspersen , Stephen Crain , Erik Gonzalez-Mulé , Margaret Hamilton , Michael Kölling , Kasper Dalgaard Larsen , Raymond Lister , Jan Lönnberg , Mike Lopez , Christopher Lynnly Hovey , Eva Marinus , Genevieve McArthur , Vaughan Nagy , Ernest Hugh O’Boyle , Karl R. Popper , Zoe Powell , Aishwarya Ramanathan , Phil Robbins , Sue Sentance , Judy Sheard , S. Simon , Elliot Soloway , Rosalind Thornton , Jacqueline L. Whalley , Larry Yueli Zhang , Shamama Zehra , Daniel Zingaro | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Begriffe KB IB clear | Informatikcomputer science , Informatik-Didaktikdidactics of computer science , Informatik-Unterricht (Fachinformatik)Computer Science Education , peer reviewpeer review , p-hacking , Publikationsbiaspublication bias , PublikationsdruckPublish or Perish! , rainfall problem , Replikationskrise , Statistikstatistics | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Bücher |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Texte |
|
Dieses Konferenz-Paper erwähnt vermutlich nicht ...
Nicht erwähnte Begriffe | Informatikunterricht in der Schule |
Tagcloud
Zitationsgraph
Zeitleiste
Anderswo finden
Volltext dieses Dokuments
Launching Registered Report Replications in Computer Science Education Research: Artikel als Volltext (: , 681 kByte; : ) |
Anderswo suchen
Beat und dieses Konferenz-Paper
Beat hat Dieses Konferenz-Paper während seiner Zeit am Institut für Medien und Schule (IMS) ins Biblionetz aufgenommen. Beat besitzt kein physisches, aber ein digitales Exemplar. Eine digitale Version ist auf dem Internet verfügbar (s.o.). Es gibt bisher nur wenige Objekte im Biblionetz, die dieses Werk zitieren. Beat selbst sagt, er habe dieses Dokument gelesen.