Made available in DSpace on 2015-05-14T13:27:08Z (GMT). No. of bitstreams: 1 arquivototal.pdf: 1226963 bytes, checksum: 90aeb06e5559518d7a3acbe701c58f98 (MD5) Previous issue date: 2014-06-20 / Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPES / This work analyses the implementation of SINAES (the Brazilian system of policies to evaluate its Higher Education) at Federal University of Paraíba. SINAES is an ongoing process established for the development of an ‗evaluation culture in Brazilian universities, and this work aims at understanding how it is changing universities values and experiences, focusing on its effects on how the ideal of University is understood through the case study of UFPB. Its main idea is to identify if and how an ‗evaluation culture established by the Bologna Process is changing and reshaping the idea of University and how its functions and processes are being currently experienced at UFPB. In this way, the research is a critically oriented sociology of evaluation processes and routines based on a set of qualitative methods (participant observation, interviews and document analysis). / Este trabalho busca entender o processo de implementação de procedimentos avaliativos estabelecidos pelo SINAES na Universidade Federal da Paraíba. A ideia é identificar como aspectos de uma ―cultura da avaliação‖, firmemente estabelecida após o processo de Bolonha, estão sendo experienciados pelas universidades brasileiras através do estudo de caso da Universidade Federal da Paraíba. A abordagem metodológica utilizada foi a da pesquisa qualitativa (métodos de observação participante, entrevistas e análise de documentos) a partir de uma abordagem da sociologia crítica. Através da pesquisa qualitativa buscamos apresentar e entender a rotina dos processos de avaliação e como estes influenciam na construção de novos valores e práticas que orientam a vida universitária. Foi analisado o processo de avaliação interna da UFPB do ano de 2013 a partir de observação participante nos Seminários de Autoavaliação. Foram realizadas entrevistas com membros das CPA (Comissão Própria de Avaliação) e da Comissão Executiva de Avaliação Institucional (CEAI), de diretores ou vice-diretores dos centros do campus I da UFPB e de coordenadores ou vice-coordenadores de cursos. Assim, a pesquisa busca apresentar as especificidades do processo de implantação do SINAES na Universidade Federal da Paraíba. Percebemos que há na UFPB resistência em relação aos procedimentos de avaliação, seja por medo ou receio de serem avaliados, seja por descrédito do processo real de avaliação que se institucionalizou nas universidades. Essa resistência transpareceu em algumas entrevistas e na pouca participação da comunidade acadêmica no processo avaliativo. Além disso, notamos uma contradição entre o discurso oficial, que apoia a avaliação e a entende como fundamental para a universidade, e a prática, onde os procedimentos de avaliação não foram incorporados de fato na rotina acadêmica da UFPB.

Evaluation is a burgeoning field and remains fairly young by most standards. Within Cooperative Extension, evaluation practices have been implemented at a variety of levels given that evaluation is mandatory for much of the funding Cooperative Extension receives. With evaluation in high demand, it is expected that most Extension educators are performing some levels of evaluation as a routine part of their jobs. In order to perform the required evaluations, an Extension educator must exhibit some level of knowledge and skill regarding evaluation. While much research to date has been done on the level of evaluation within the organization, there is a lack of understanding regarding the evaluation competencies that Extension educators must possess and the culture of evaluation within the organization. This study set out to examine the evaluation competencies, culture, and evaluation behaviors within Cooperative Extension. Utilizing an online survey format and quantitative methodology, a widely accepted set of evaluation competencies were examined for their importance within Cooperative Extension. A panel of 13 experts was selected to examine the competencies and it was determined than all competencies in the list were necessary for Extension educators to exhibit in their jobs. The list of competencies was then combined with a subscale regarding culture and a subscale based on the Theory of Planned Behavior (Ajzen, 1991). A total of 419 Extension educators in four Extension systems participated in the study, with 222 generating usable data for a response rate of 13%. The highest and lowest skill level for the competencies were determined by Extension educators self-reporting. Perception of importance of each competency was examined and the highest and lowest importance rankings were determined. These were compared to the rankings of importance by the expert panel. A path analysis was conducted by modifying the Theory of Planned Behavior model and multiple regression analysis. Mean weighted discrepancy scores were calculated to determine the differences in skill level and perception for each of the competencies. The subscale of culture was examined for potential areas of Evaluation Capacity Building (ECB) within the organization. Results show that while there was much agreement between the expert panel and Extension educators regarding the importance of competencies, experts ranked all competencies as important while Extension educators did not. The results of the path analysis determined intention and perceived behavioral control explained 3.9% of the variance in the evaluation behavior exhibited by skill. Subjective norm and attitude explained 11.8% of the variance within intention. Perceived behavioral control, attitude and culture accounted for 13.1% of the variance in subjective norm. Culture and perception accounted for 7.1% of the variance in attitude. Perception, program area, college major, location, training in evaluation, degree level and years of experience explained 28% of the variance within evaluation culture. Finally, recommendations for practice and future research were made based on these findings. / Ph. D.

Made available in DSpace on 2016-06-02T19:39:42Z (GMT). No. of bitstreams: 1 5853.pdf: 4186685 bytes, checksum: fb2ecf17572a25d7181b7a21be25147a (MD5) Previous issue date: 2014-02-24 / Financiadora de Estudos e Projetos / This dissertation aims to investigate the performance of the Self Evaluation Commission (CPA) in conjunction with the processes of institutional self-evaluation, for both make use of a case study in UFSCar that the division of institutional assessment were investigated with four undergraduate courses face of the institution, all of the São Carlos campus. To this end, this study was guided from the qualitative, so research made use of desk research, semistructured interviews, the literature review and the online questionnaire closed. Documentary research was analyzed in the legislation of public policies for higher education evaluation, the period from 1996 to 2008, and the internal regulations of the institution. For bibliographic bibliometrics, which allowed analyzing 54 studies among theses, dissertations and articles in national and international researchers who investigate thematic educational assessment. Participated in semi-structured interviews of the following actors: coordinator or deputy coordinator of each course, a former member of CPA/UFSCar, and a former member of the Organizing Committee of the Project Evaluation of Undergraduate Teaching UFSCar. Finally, the closed online questionnaire was administered to students regularly enrolled in the penultimate and last year, the teacher who teaches discipline penultimate and last, and the administrative technician investigated each course. The results achieved through the collection of data showed that there was a poor articulation of the outcomes of institutional self-evaluation that occurs in courses with the actions taken by the CPA and the Management UFSCar. To sensitize the academic community to participate in the processes of institutional assessment would need to enhance information management within the IES, so that the CPA can be known to then be recognized. The little time to build the self-assessment report on the institution does not provide time for reflection and discussion with the community. There were times that the regulatory review predominated in the institution, but there were those that prevailed in the critical evaluation in daily practice, it became evident in two courses investigated. It was found that the construction of an evaluation design is a contentious field, as there are, within the institution, social actors who want to review the ranking and classification, as there are those who want the formative and emancipatory. / Esta Dissertação de Mestrado tem o objetivo de investigar a atuação da Comissão Própria de Avaliação (CPA) em articulação com os processos de autoavaliação institucional. Para tanto fez uso de um estudo de caso na UFSCar em que foi investigada a articulação da avaliação institucional em quatro cursos presenciais de graduação da instituição, todos do campus de São Carlos. Para tal, o presente estudo orientou-se a partir da pesquisa qualitativa, assim, fezse uso da pesquisa documental, da entrevista semiestruturada, do levantamento bibliográfico e do questionário fechado online. Na pesquisa documental foi analisada a legislação das políticas públicas para avaliação da educação superior, do período de 1996 a 2008, e as regulamentações internas da instituição. Para o levantamento bibliográfico foi utilizada a bibliometria, o que possibilitou analisar 54 trabalhos entre teses, dissertações e artigos de pesquisadores nacionais e internacionais que investigam a temática avaliação educacional. Das entrevistas semiestruturadas participaram os seguintes atores: coordenador ou vicecoordenador de cada curso; um ex-membro da CPA/UFSCar; e um ex-membro da Comissão Organizadora do Projeto de Avaliação do Ensino de Graduação UFSCar. Por fim, o questionário fechado online foi aplicado aos discentes regularmente matrículados no penúltimo e no último ano; aos docentes que lecionam disciplina no penúltino e no último ano; e ao técnico administrativo de cada curso investigado. Os resultados alcançados por meio da coleta de dados demostraram que houve uma fraca articulação dos resultados da autoavaliação institucional que ocorre nos cursos com as ações desenvolvidas pela CPA e pela Gestão da UFSCar. Para sensibilizar a comunidade acadêmica a participar dos processos de avaliação institucional, seria necessário intensificar a gestão da informação dentro da IES, para que a CPA possa ser conhecida para, então, ser reconhecida. O pouco tempo para construção do relatório de autoavaliação institucional não propicia momentos de reflexão e de discussão com a comunidade. Houve momentos em que a avaliação regulatória predominou na instituição, contudo houve aqueles em que prevaleceu a avaliação emancipatória nas práticas cotidianas, evidenciando isso em dois cursos investigados. Constatou-se que a construção de uma concepção de avaliação é um campo conflituoso, pois há, dentro da instituição, atores sociais que querem a avaliação para o ranqueamento e para a classificação, como há aqueles que querem a avaliação formativa e emancipatória.