Background: Objectives: To produce and synthesize reliable data, systematic reviews need to adhere to rigorous methodological standards. This living meta-review aims to investigate risk of bias and open science practices in systematic reviews from the educational field published between 2022-2023. The aim of this meta-review is to get a better understanding of the current state of educational research regarding the aforementioned topics. Methods: Eligibility criteria: We included all systematic reviews of educational interventions, instructions, and methods for all K-12 student populations with experimental or quasi-experimental designs where the outcome variables were academic performance of any kind. Information sources: We searched through the Education Resources Information Centre (ERIC) for systematic reviews published between 2022-2023. In addition, we also hand searched four scholarly databases. Risk of Bias and FAIR principles: To assess systematic reviews risk of bias and open science practices in systematic reviews two tools were used, ROBIS - Risk of bias in systematic reviews, as well as a FAIR assessment tool. Results: 44 studies that matched our PICOS were included in this meta-review. Out of these studies four (9%) were deemed as having a low risk of bias. The remaining 40 studies were deemed as either having high risk of bias (89%) or unclear risk of bias (2%). Among the 44 studies included, only four studies (9%) had their data available, and none of them adhered to all of the items regarding the FAIR principles. Discussion: This meta-review shows that only a small part of systematic reviews in education can be considered low risk of bias, and an even smaller part can be considered adhering to open science principles. Therefore, much needs to change to adapt to new scientific guidelines.
| Identifer | oai:union.ndltd.org:UPSALLA1/oai:DiVA.org:lnu-130118 |
| Date | January 2024 |
| Creators | Dahl, Hugo, Däldborg, Per |
| Publisher | Linnéuniversitetet, Institutionen för psykologi (PSY) |
| Source Sets | DiVA Archive at Upsalla University |
| Language | English |
| Detected Language | English |
| Type | Student thesis, info:eu-repo/semantics/bachelorThesis, text |
| Format | application/pdf |
| Rights | info:eu-repo/semantics/openAccess |
Page generated in 0.002 seconds