{"id":{"repo_id":"eiu","oai_identifier":"oai:thekeep.eiu.edu:theses-5944"},"canonical_url":"https://search.ndltd.org/etd/eiu/oai:thekeep.eiu.edu:theses-5944","repository":{"repo_id":"eiu","name":"Eastern Illinois University","base_url":"https://thekeep.eiu.edu/do/oai/"},"display":{"title":"Social Validity and Feasibility of the Five in 20 Classroom Management Observation Tool","abstract":"The present study aimed to assess the social validity and feasibility of a standardized classroom observation tool intended to assess teachers’ current use of the five features critical to effective classroom management. Forty-three observers who regularly conducted classroom observations (e.g., school psychologists) were recruited to complete 20-min observations in kindergarten through twelfth grade classrooms, and then complete an adapted behavior intervention rating scale to assess their social validity ratings of the tool. Due to COVID-19, observers could either complete a live observation or recall a previously completed observation. Of the 43 observations, 15 were live and 28 were recalled. To complete the ratings, observers answered 15 Likert-style items to produce a total score with a maximum of 75 points. Total rating of 60 points or higher were considered acceptable. Seventy-nine percent of participants rated the tool a score of 60 or higher, suggesting most found the tool acceptable. No significant differences were found in ratings of the tool between live vs. recalled participants, participants with or without graduate training in consultation and direct observation, or participants who obtained more objective or less objective data from the tool itself. Additionally, no significant correlation was found between BIRS ratings and number of observations participants typically conduct per month. Additional comments left by participants presented important themes, as well, including positive feedback on the inclusion of operational definitions and the breadth of data the tool can collect, concerns regarding subjectivity of the strategy quality ratings, and a surprising amount of hesitation to provide classroom management skills feedback to teachers because of how they may react or perceive it. Future research and implications of these findings are discussed.","abstract_html":"The present study aimed to assess the social validity and feasibility of a standardized classroom observation tool intended to assess teachers’ current use of the five features critical to effective classroom management. Forty-three observers who regularly conducted classroom observations (e.g., school psychologists) were recruited to complete 20-min observations in kindergarten through twelfth grade classrooms, and then complete an adapted behavior intervention rating scale to assess their social validity ratings of the tool. Due to COVID-19, observers could either complete a live observation or recall a previously completed observation. Of the 43 observations, 15 were live and 28 were recalled. To complete the ratings, observers answered 15 Likert-style items to produce a total score with a maximum of 75 points. Total rating of 60 points or higher were considered acceptable. Seventy-nine percent of participants rated the tool a score of 60 or higher, suggesting most found the tool acceptable. No significant differences were found in ratings of the tool between live vs. recalled participants, participants with or without graduate training in consultation and direct observation, or participants who obtained more objective or less objective data from the tool itself. Additionally, no significant correlation was found between BIRS ratings and number of observations participants typically conduct per month. Additional comments left by participants presented important themes, as well, including positive feedback on the inclusion of operational definitions and the breadth of data the tool can collect, concerns regarding subjectivity of the strategy quality ratings, and a surprising amount of hesitation to provide classroom management skills feedback to teachers because of how they may react or perceive it. Future research and implications of these findings are discussed.","abstract_has_math":false,"creators":["Hampton, Kaylee"],"institution":null,"degree_name":"Specialist in School Psychology","degree_level":null,"degree_discipline":"Psychology","degree_department":null,"school":null,"contributors":["Margaret T. Floress","Assege HaileMariam","Wesley D. Allan"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T07:54:14Z","subjects":["social validity","feasibility","teacher observation tool","classroom management","direct observation","evidence-based strategies","School Psychology","Teacher Education and Professional Development"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://thekeep.eiu.edu/theses/4937","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://thekeep.eiu.edu/theses/4937","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://thekeep.eiu.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Athekeep.eiu.edu%3Atheses-5944","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Margaret T. Floress","Assege HaileMariam","Wesley D. Allan"]},{"key":"dc:creator","label":"Author","values":["Hampton, Kaylee"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2022-05-20T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2022-01-01T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Psychology"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Specialist in School Psychology"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["social validity","feasibility","teacher observation tool","classroom management","direct observation","evidence-based strategies","School Psychology","Teacher Education and Professional Development"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://thekeep.eiu.edu/theses/4937"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["The present study aimed to assess the social validity and feasibility of a standardized classroom observation tool intended to assess teachers’ current use of the five features critical to effective classroom management. Forty-three observers who regularly conducted classroom observations (e.g., school psychologists) were recruited to complete 20-min observations in kindergarten through twelfth grade classrooms, and then complete an adapted behavior intervention rating scale to assess their social validity ratings of the tool. Due to COVID-19, observers could either complete a live observation or recall a previously completed observation. Of the 43 observations, 15 were live and 28 were recalled. To complete the ratings, observers answered 15 Likert-style items to produce a total score with a maximum of 75 points. Total rating of 60 points or higher were considered acceptable. Seventy-nine percent of participants rated the tool a score of 60 or higher, suggesting most found the tool acceptable. No significant differences were found in ratings of the tool between live vs. recalled participants, participants with or without graduate training in consultation and direct observation, or participants who obtained more objective or less objective data from the tool itself. Additionally, no significant correlation was found between BIRS ratings and number of observations participants typically conduct per month. Additional comments left by participants presented important themes, as well, including positive feedback on the inclusion of operational definitions and the breadth of data the tool can collect, concerns regarding subjectivity of the strategy quality ratings, and a surprising amount of hesitation to provide classroom management skills feedback to teachers because of how they may react or perceive it. Future research and implications of these findings are discussed."]},{"key":"dc:title","label":"Title","values":["Social Validity and Feasibility of the Five in 20 Classroom Management Observation Tool"]}]}],"canonical_facts":{"dc:contributor":["Margaret T. Floress","Assege HaileMariam","Wesley D. Allan"],"dc:creator":["Hampton, Kaylee"],"dc:date.available":["2022-05-20T07:00:00Z"],"dc:date.created":["2022-01-01T08:00:00Z"],"dc:description.abstract":["The present study aimed to assess the social validity and feasibility of a standardized classroom observation tool intended to assess teachers’ current use of the five features critical to effective classroom management. Forty-three observers who regularly conducted classroom observations (e.g., school psychologists) were recruited to complete 20-min observations in kindergarten through twelfth grade classrooms, and then complete an adapted behavior intervention rating scale to assess their social validity ratings of the tool. Due to COVID-19, observers could either complete a live observation or recall a previously completed observation. Of the 43 observations, 15 were live and 28 were recalled. To complete the ratings, observers answered 15 Likert-style items to produce a total score with a maximum of 75 points. Total rating of 60 points or higher were considered acceptable. Seventy-nine percent of participants rated the tool a score of 60 or higher, suggesting most found the tool acceptable. No significant differences were found in ratings of the tool between live vs. recalled participants, participants with or without graduate training in consultation and direct observation, or participants who obtained more objective or less objective data from the tool itself. Additionally, no significant correlation was found between BIRS ratings and number of observations participants typically conduct per month. Additional comments left by participants presented important themes, as well, including positive feedback on the inclusion of operational definitions and the breadth of data the tool can collect, concerns regarding subjectivity of the strategy quality ratings, and a surprising amount of hesitation to provide classroom management skills feedback to teachers because of how they may react or perceive it. Future research and implications of these findings are discussed."],"dc:identifier":["https://thekeep.eiu.edu/theses/4937"],"dc:subject":["social validity","feasibility","teacher observation tool","classroom management","direct observation","evidence-based strategies","School Psychology","Teacher Education and Professional Development"],"dc:title":["Social Validity and Feasibility of the Five in 20 Classroom Management Observation Tool"],"thesis:degree_discipline":["Psychology"],"thesis:degree_name":["Specialist in School Psychology"]},"updated_at":"2026-11-19T07:54:14Z"}