Finding high quality materials for the preparation of epidemiological lectures is a serious challenge for epidemiologists and public health professionals across the world. The emergence of the Internet in the early 90s offered a way to ease the access to the epidemiological lectures; however it also raised important questions about the quality of the educational lectures which are freely available on the Internet. In this research, we analyzed the quality of epidemiological lectures in the Global Health Network Supercourse lecture library.
We selected a random sample of 100 lectures in the Supercourse that accumulated at least 3 reviews from the visitors of the Supercourse sites. We found 7 experts, leading researchers in the field of public health and medicine, who were also very experienced in reviewing papers for journals. These experts evaluated the same set of 100 lectures and gave us their expert opinion on their quality.
Overall, the lectures were rated positively by both expert and the Supercourse reviewers. Although t-test indicated that the difference between the means was statistically significant, this difference is not meaningful due to large sample size. Kappa statistic and intraclass correlations indicated that inter rater agreement for experts and non-experts was surprisingly low (less than 0.4). We also observed HALO affect with overall score being a good predictor of other scores.
Our findings were consistent with existing research in the area of peer review, demonstrating low inter rater agreement. This poor inter rater agreement was demonstrated for the first time for the Internet lectures. Our findings suggested that questionnaires assessing the quality of the Internet lectures may actually be replaced by one rating, similar to the system utilized in Amazon.com or hotel ratings.
This research was significant for the field of public health because it was one of the first efforts to evaluate the quality of epidemiological lectures on the Internet. The quality of lectures on the web has rarely been assessed scientifically for epidemiological and public health lectures. Future research in this area may need to concentrate on alternatives to the peer review system.
| Identifer | oai:union.ndltd.org:PITT/oai:PITTETD:etd-04112005-094420 |
| Date | 17 June 2005 |
| Creators | Linkov, Faina Y |
| Contributors | Francois Sauer, Sati Mazumdar, Deborah Aaron, Ronald E. LaPorte, Thomas J. Songer |
| Publisher | University of Pittsburgh |
| Source Sets | University of Pittsburgh |
| Language | English |
| Detected Language | English |
| Type | text |
| Format | application/pdf |
| Source | http://etd.library.pitt.edu/ETD/available/etd-04112005-094420/ |
| Rights | unrestricted, I hereby certify that, if appropriate, I have obtained and attached hereto a written permission statement from the owner(s) of each third party copyrighted matter to be included in my thesis, dissertation, or project report, allowing distribution as specified below. I certify that the version I submitted is the same as that approved by my advisory committee. I hereby grant to University of Pittsburgh or its agents the non-exclusive license to archive and make accessible, under the conditions specified below, my thesis, dissertation, or project report in whole or in part in all forms of media, now or hereafter known. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also retain the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report. |
Page generated in 0.0057 seconds