In this paper, 936 faculty free response reviews of open textbooks from the Open Textbook Library were analyzed for content and themes. The reviews were completed by faculty members at institutions in the United States and Canada. The textbooks were evaluated regarding their comprehensiveness, content accuracy, relevance longevity, clarity, consistency, modularity, organization structure flow, interface, grammatical errors, and cultural relevance. The results of the reviews found that the across 9360 comments regarding the quality of open textbooks, of these comments 97.3% reflected adequate or exceptional reviews of the textbooks. Faculty often compared the texts to traditional textbooks and in all mentions of comparison, the open textbook were regarded to be of equal or superior quality. The results of this study aid in alleviating concerns regarding quality of Open Educational Resources (OER) and provide peer reviews that faculty who consider adopting these textbooks often request. Limitations of the study and further prescriptions for research regarding OER quality and peer review research have been explored in the study.

The purpose of this study was to ascertain whether the adoption of Open Educational Resources had a significant effect on student learning outcomes in seven courses taught at seven post-secondary institutions. The use of open educational resources (OER) is increasing in the United States. Initiatives focusing on expanding the use of OER as a replacement for traditional textbooks at the post-secondary level include OpenStax, Project Kaleidoscope, Open Course Library, and others. While researchers have begun to explore OER, few have sought to evaluate the quality of OER as a function of student academic success. In this dissertation, I examined measures of student success in seven courses at seven different early-adopters of Project Kaleidoscope where faculty members chose to adopt OER to replace traditional textbooks. The sample for this study consisted of students using open textbooks in courses at seven Project Kaleidoscope post-secondary institutions, as well as a control group of students at those same institutions who used traditional textbooks in sections of the same courses. I used an ex-post-facto quasi-experimental design, in which I compared students using OER to students using traditional textbooks in comparable courses. In order to control for the threat of selection bias, I used propensity score matching (PSM) to match treatment and control groups on a set of demographic variables. After creating matched treatment and control groups, I used multiple regression and logistic regression to examine whether textbook selection predicts a measurable difference in student achievement after accounting for relevant covariates. I found that students using open textbooks earned, on average, lower grades than students who used traditional textbooks, after controlling for student-level and course-level covariates. Further analysis revealed that this negative differential was isolated to students in business and psychology classes. I also found that students who used open textbooks enrolled in more credits than students using traditional textbooks, controlling for relevant covariates. Because of the finding of a variation in textbook effect from course to course, future studies may seek to understand the effects of particular OER adoption instances rather than the global effect of OER adoption.

This mixed-methods study evaluated quality, usage, and perceptions of open educational resources compared to traditionally published textbooks. Because textbooks and other related materials make up a significant portion of educational costs, open educational resources have been explored for potential cost savings at all levels of education. These resources use public domain or open-licensed materials as the content component of free eTextbooks or low-cost printed textbooks. This evaluation explores how teachers and students use textbook resources both in and out of the classroom and the degree to which the content and design of open textbooks compares in quality and value to traditional textbooks. Data came through evaluating the print media design and content quality of the books in a Utah pilot program, analyzing the actual textbook artifacts from students, and conducting teacher surveys and interviews. The data points to clear differences in quality and use between the two types of books. Although the open textbooks are generally a lower quality product than traditional publisher produced textbooks, they were used in unique ways. Teachers who participated in the open textbook development tended to value the book as a resource, leading us to conclude that the ability to customize open resources may be an important determinant of textbook use. However, it is also likely that textbooks have only a minor affect on academic outcomes compared to other more problematic pedagogical and educational policy issues. This evaluation points to the need for additional study on the impact these differences have on learning outcomes.

In this paper, 936 faculty free response reviews of open textbooks from the Open Textbook Library were analyzed for content and themes. The reviews were completed by faculty members at institutions in the United States and Canada. The textbooks were evaluated regarding their comprehensiveness, content accuracy, relevance longevity, clarity, consistency, modularity, organization structure flow, interface, grammatical errors, and cultural relevance. The results of the reviews found that the across 9360 comments regarding the quality of open textbooks, of these comments 97.3% reflected adequate or exceptional reviews of the textbooks. Faculty often compared the texts to traditional textbooks and in all mentions of comparison, the open textbook were regarded to be of equal or superior quality. The results of this study aid in alleviating concerns regarding quality of Open Educational Resources (OER) and provide peer reviews that faculty who consider adopting these textbooks often request. Limitations of the study and further prescriptions for research regarding OER quality and peer review research have been explored in the study.