{"id":{"repo_id":"denver","oai_identifier":"oai:digitalcommons.du.edu:etd-2965"},"canonical_url":"https://search.ndltd.org/etd/denver/oai:digitalcommons.du.edu:etd-2965","repository":{"repo_id":"denver","name":"University of Denver","base_url":"https://digitalcommons.du.edu/do/oai/"},"display":{"title":"Use of Research Tradition and Design in Program Evaluation: An Explanatory Mixed Methods Study of Practitioners’ Methodological Choices","abstract":"The goal of this explanatory sequential mixed method study was to assess whether there were observable trends, associations, or group differences in evaluation methodology by settings and content area in published evaluations from the past ten years (quantitative), to illuminate how evaluation practitioners selected these methodologies (qualitative), and assess how emergent findings from each phase fit together or helped contextualize each other. In this study, methodology was operationalized as research tradition and method was operationalized as research design. For phase one (quantitative), a systematized ten-year review of five peer-reviewed evaluation journals was conducted and coded by journal, research tradition, research design, first author setting, evaluation content area, and publication year. These results were first reported descriptively and then considered for inferential modeling. For phase two (qualitative), interviews, which were informed by the findings that emerged in the quantitative phase, were conducted with a purposive sample of 15 practitioners to gain insight into how practitioners make methodological choices. In phase three (integration), findings were integrated to contextualize emergent learnings from each phase. Evidence of statistically significant associations between research tradition, design, first author setting, and content area were discovered. There were no statistically significant associations observed between either research tradition and publication year or research design and publication year. There was also evidence that evaluations conducted in the quantitative research tradition, as well as experimental designs, were overrepresented in the evaluation literature within the timeframe being reviewed. Finally, this study’s procedures generated a hypothesized grounded theory of how evaluators select methods that provided explanation for phase one findings; this theory should be tested by future researchers.","abstract_html":"The goal of this explanatory sequential mixed method study was to assess whether there were observable trends, associations, or group differences in evaluation methodology by settings and content area in published evaluations from the past ten years (quantitative), to illuminate how evaluation practitioners selected these methodologies (qualitative), and assess how emergent findings from each phase fit together or helped contextualize each other. In this study, methodology was operationalized as research tradition and method was operationalized as research design. For phase one (quantitative), a systematized ten-year review of five peer-reviewed evaluation journals was conducted and coded by journal, research tradition, research design, first author setting, evaluation content area, and publication year. These results were first reported descriptively and then considered for inferential modeling. For phase two (qualitative), interviews, which were informed by the findings that emerged in the quantitative phase, were conducted with a purposive sample of 15 practitioners to gain insight into how practitioners make methodological choices. In phase three (integration), findings were integrated to contextualize emergent learnings from each phase. Evidence of statistically significant associations between research tradition, design, first author setting, and content area were discovered. There were no statistically significant associations observed between either research tradition and publication year or research design and publication year. There was also evidence that evaluations conducted in the quantitative research tradition, as well as experimental designs, were overrepresented in the evaluation literature within the timeframe being reviewed. Finally, this study’s procedures generated a hypothesized grounded theory of how evaluators select methods that provided explanation for phase one findings; this theory should be tested by future researchers.","abstract_has_math":false,"creators":["Patel, Margaret Schultz"],"institution":null,"degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":null,"degree_department":null,"school":null,"contributors":["Duan Zhang","Antonio Olmos","Nicholas Cutforth"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T07:54:02Z","subjects":["Evaluation methods","Grounded theory","Mixed methods","Other Statistics and Probability","Quantitative, Qualitative, Comparative, and Historical Methodologies","Statistical Theory","Statistics and Probability"],"languages":["en"],"rights":["<p>Copyright is held by the author. User is responsible for all copyright compliance.</p>","Margaret Schultz Patel"],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.du.edu/etd/1974","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.du.edu/etd/1974","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.du.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.du.edu%3Aetd-2965","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Duan Zhang","Antonio Olmos","Nicholas Cutforth"]},{"key":"dc:creator","label":"Author","values":["Patel, Margaret Schultz"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2022-02-07T08:00:00Z"]},{"key":"dc:date.copyright","label":"Dc Date Copyright","values":["2021-01-01T08:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2021-01-01T08:00:00Z"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Evaluation methods","Grounded theory","Mixed methods","Other Statistics and Probability","Quantitative, Qualitative, Comparative, and Historical Methodologies","Statistical Theory","Statistics and Probability"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["<p>Copyright is held by the author. User is responsible for all copyright compliance.</p>"]},{"key":"dc:rights.holder","label":"Dc Rights Holder","values":["Margaret Schultz Patel"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.du.edu/etd/1974"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["The goal of this explanatory sequential mixed method study was to assess whether there were observable trends, associations, or group differences in evaluation methodology by settings and content area in published evaluations from the past ten years (quantitative), to illuminate how evaluation practitioners selected these methodologies (qualitative), and assess how emergent findings from each phase fit together or helped contextualize each other. In this study, methodology was operationalized as research tradition and method was operationalized as research design. For phase one (quantitative), a systematized ten-year review of five peer-reviewed evaluation journals was conducted and coded by journal, research tradition, research design, first author setting, evaluation content area, and publication year. These results were first reported descriptively and then considered for inferential modeling. For phase two (qualitative), interviews, which were informed by the findings that emerged in the quantitative phase, were conducted with a purposive sample of 15 practitioners to gain insight into how practitioners make methodological choices. In phase three (integration), findings were integrated to contextualize emergent learnings from each phase. Evidence of statistically significant associations between research tradition, design, first author setting, and content area were discovered. There were no statistically significant associations observed between either research tradition and publication year or research design and publication year. There was also evidence that evaluations conducted in the quantitative research tradition, as well as experimental designs, were overrepresented in the evaluation literature within the timeframe being reviewed. Finally, this study’s procedures generated a hypothesized grounded theory of how evaluators select methods that provided explanation for phase one findings; this theory should be tested by future researchers."]},{"key":"dc:description.provenance","label":"Dc Description Provenance","values":["Received from ProQuest"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:format.extent","label":"Dc Format Extent","values":["95 pgs"]},{"key":"dc:title","label":"Title","values":["Use of Research Tradition and Design in Program Evaluation: An Explanatory Mixed Methods Study of Practitioners’ Methodological Choices"]}]}],"canonical_facts":{"dc:contributor":["Duan Zhang","Antonio Olmos","Nicholas Cutforth"],"dc:creator":["Patel, Margaret Schultz"],"dc:date.available":["2022-02-07T08:00:00Z"],"dc:date.copyright":["2021-01-01T08:00:00Z"],"dc:date.created":["2021-01-01T08:00:00Z"],"dc:description.abstract":["The goal of this explanatory sequential mixed method study was to assess whether there were observable trends, associations, or group differences in evaluation methodology by settings and content area in published evaluations from the past ten years (quantitative), to illuminate how evaluation practitioners selected these methodologies (qualitative), and assess how emergent findings from each phase fit together or helped contextualize each other. In this study, methodology was operationalized as research tradition and method was operationalized as research design. For phase one (quantitative), a systematized ten-year review of five peer-reviewed evaluation journals was conducted and coded by journal, research tradition, research design, first author setting, evaluation content area, and publication year. These results were first reported descriptively and then considered for inferential modeling. For phase two (qualitative), interviews, which were informed by the findings that emerged in the quantitative phase, were conducted with a purposive sample of 15 practitioners to gain insight into how practitioners make methodological choices. In phase three (integration), findings were integrated to contextualize emergent learnings from each phase. Evidence of statistically significant associations between research tradition, design, first author setting, and content area were discovered. There were no statistically significant associations observed between either research tradition and publication year or research design and publication year. There was also evidence that evaluations conducted in the quantitative research tradition, as well as experimental designs, were overrepresented in the evaluation literature within the timeframe being reviewed. Finally, this study’s procedures generated a hypothesized grounded theory of how evaluators select methods that provided explanation for phase one findings; this theory should be tested by future researchers."],"dc:description.provenance":["Received from ProQuest"],"dc:format":["application/pdf"],"dc:format.extent":["95 pgs"],"dc:identifier":["https://digitalcommons.du.edu/etd/1974"],"dc:language":["en"],"dc:rights":["<p>Copyright is held by the author. User is responsible for all copyright compliance.</p>"],"dc:rights.holder":["Margaret Schultz Patel"],"dc:subject":["Evaluation methods","Grounded theory","Mixed methods","Other Statistics and Probability","Quantitative, Qualitative, Comparative, and Historical Methodologies","Statistical Theory","Statistics and Probability"],"dc:title":["Use of Research Tradition and Design in Program Evaluation: An Explanatory Mixed Methods Study of Practitioners’ Methodological Choices"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."]},"updated_at":"2026-11-19T07:54:02Z"}