Esta pesquisa discute a avaliação da pós-graduação no Brasil, analisando, de um lado, o sistema de avaliação da CAPES (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior) e, de outro, a opinião da comunidade científica sobre esse sistema, focando especificamente nos critérios e instrumentos utilizados para esse fim. Pretendeu-se, com esta abordagem, contribuir para o aprimoramento do sistema de avaliação nacional da pós-graduação, tornando a avaliação um processo pactuado entre a CAPES e os programas de pós-graduação no Brasil. Para isso, foram confrontados os procedimentos utilizados no sistema de avaliação expressos nos documentos da CAPES e documentos das áreas de avaliação, com as opiniões da comunidade acadêmica apresentadas em artigos de periódicos e monografias. Foram estabelecidos como referenciais teóricos da pesquisa os conceitos de campo científico de Bourdieu e o de avaliação de Dahler- Larsen. O corpus da pesquisa foi coletado em três fontes: documentos criados pela CAPES, que contextualizam a pós-graduação e sua avaliação (PNPG 2011-2020); os Documentos de área elaborados pelas 48 áreas de avaliação e as críticas da comunidade acadêmica publicados em artigos de periódicos científicos. O corpus foi analisado e sistematizado por meio do método de Análise de Conteúdo. A análise teve como fio condutor os seis quesitos de avaliação de programas de pós-graduação da CAPES: Proposta do programa, Corpo docente, Corpo discente, teses e dissertações, Produção intelectual, Inserção social, e Internacionalização, bem como a Avaliação como um todo. Buscou-se identificar os comentários positivos, os comentários negativos e as sugestões da comunidade acadêmica. O quesito Produção intelectual foi o que recebeu a maior quantidade de críticas, identificando-se, portanto, como o foco das dúvidas e comentários da comunidade acadêmica. Os quesitos Proposta do programa, Corpo docente, Corpo discente, teses e dissertações, Inserção social, e Internacionalização receberam menor quantidade de comentários. Os resultados mostram que a avaliação, como um todo, apesar das críticas, é reconhecida como necessária pela comunidade acadêmica. Como contribuição final, foram feitas sugestões para aprimorar a enunciação dos quesitos e critérios de avaliação, de forma a promover sua melhor compreensão e transparência. / This research discusses the graduate evaluation in Brazil, analyzing, on the one hand, the evaluation system of CAPES (Higher Education Personnel Training Coordination) and, on the other, the opinion of the scientific community about this system, specifically focusing on criteria and instruments used for this purpose. It was intended, with this approach, contribute to the improvement of the national evaluation system, in order to make evaluation a process agreed between CAPES and graduate programs in Brazil. For this, they were confronted the procedures used in evaluation system expressed in the Capes documents and documents of the evaluation areas, with the views of the academic community presented in journal papers and monographs. The concepts of scientific field (Bourdieu) and evaluation society (Dahler-Larsen) were used as theoretical background of this research. The corpus of the research was collected from three sources: the documents created by CAPES which contextualize the evaluation process (PNPG 2011-2020), the documents prepared by the 48 evaluation areas and criticisms of the academic community published in scientific journals. The corpus was analyzed and systematized through the method of Content Analysis. The analysis was to thread the six evaluation items of graduate programs of CAPES: Program proposal, Faculty, Students, Theses and dissertations, Intellectual production, Social insertion, and Internationalization. One tried to identify the positive comments, negative comments and suggestions of the academic community. The item Intellectual Production has received the highest amount of criticism, becoming therefore the focus of the questions and comments of the academic community. The items Program proposal, Faculty, Students, Theses and dissertations, Social insertion, and Internationalization received fewer comments. The results show that evaluation, despite criticism, is recognized as necessary by the academic community. As a final contribution, suggestions were made to enhance the formulation of the evaluation criteria in order to promote their better understanding and transparency.

Dentre as fontes renováveis de energia, os biocombustíveis têm apresentado amplo destaque como alternativa sustentável e potenciais substitutos aos combustíveis fósseis, e são vistos por muitos decisores políticos e cientistas como recursos de baixo impacto ambiental e de boa rentabilidade econômica. No Brasil o biocombustível que tem apresentado maior destaque tem sido o etanol da cana-de-açúcar. Entretanto, existem questionamentos sobre sua produção e consumo. De um lado ocorrem ganhos pelo fato desta ser uma atividade energética renovável, mas por outro lado, observa-se a ocorrência de degradações sociais e ambientais, derivadas da monocultura extensiva, bem como, problemas econômicos de instabilidade de mercado. Ademais, é importante considerar a existência de uma rede de atores políticos, técnicos e de consumidores relacionados ao processo de tomada de decisão, processos econômicos e às questões sociais e ambientais. Estes agentes podem influenciar de forma direta e/ou indireta no futuro da cana-de-açúcar no Brasil. A interação entre estes vários elementos torna complexa a realidade do setor e potencializa as várias preocupações sobre a evolução da atividade. Desse modo, postular a sustentabilidade como uma característica fundamental para a atividade, tem se apresentado como um difícil, porém importante desafio. Um dos aspectos essenciais para responder a estes desafios, é a avaliação de sustentabilidade. Porém muitas das ferramentas de avaliação possuem limitações em contemplar critérios de sustentabilidade de maneira sistêmica. Com a gama de opções existentes, a decisão pela adoção de métodos de avaliação de sustentabilidade também se apresenta complexa, já que cada ferramenta \"abraça\" uma visão especifica de mundo, de sustentabilidade, de valores, de acordo com suas teorias, abordagens e conceitos. Nesse sentido, esta tese se concentrou na pergunta sobre como estas questões de complexidade são consideradas no processo de seleção dos modelos de avaliação, bem como, de que forma estes modelos são escolhidos e, assim propôs, por meio da elaboração de procedimentos e critérios sistêmicos, uma estrutura analítica de seleção de modelos e/ou ferramentas de avaliação de sustentabilidade. Para tanto, a pesquisa: utilizou-se do arcabouço teórico da teoria geral de sistemas e da avaliação de sustentabilidade; realizou uma análise contextual e identificou pontos de intervenção para o sistema e a complexidade envolvida na temática do etanol de cana-de-açúcar; identificou pontos críticos envolvidos nos processos de operacionalização do conceito de sustentabilidade e sua avaliação e, levantou atributos necessários a elaboração dos critérios sistêmicos. Por fim, a pesquisa concluiu que não se observa uma adequada aderência entre os modelos de análise e sua seleção, prejudicando a operacionalidade da sustentabilidade e sua avaliação. Com tal estrutura é possível fornecer subsídios ao processo de tomada de decisão e à formulação e/ou avaliação de políticas públicas voltadas à para a sustentabilidade do setor. / Amongst the renewable energy sources, the biofuels have presented extent prominence as a sustainable alternative, ever since they present themselves as potential substitutes to fossil fuels and have been considered, by many policy makers and scientists, as low environmental impact and good economic profitability resources. In Brazil, the sugarcane ethanol is the biofuel which has had greater highlighting. However, there are some discussions about its production and consumption. On the one hand gains occur since the pollution decline and on account of ethanol is a renewable energy. On the other, it is observed the occurrence of social and environmental degeneration derived from extensive monoculture, as well, market instability. Furthermore, it is important to consider the existence of political, technical and consumer\'s network related to the decision making process, and economic, social and environmental issues. These agents can influence directly and /or indirectly in the future of sugarcane in Brazil. The interaction among this range of elements complicates the ethanol industry\'s reality and enhances the concerns about the activity evolution. Thus, postulating sustainability as a essential feature for the activity has emerged as a difficult but important challenge. One of the key aspects to respond to these challenges is the sustainability assessment. But many of assessment tools have limitations in contemplating systemically sustainability criteria. With the range of options available, the adoption decision of sustainability assessment methods also affords complexity, seeing that each tool \"embraces\" a world vision, sustainability, values, according to their theories, approaches and concepts. In this sense, this thesis focused on the question of how these complex issues are considered in the selection of valuation models process as well as how these models are chosen and proposed, by the development of systemic procedures and criteria, composing an analytical framework for model selection and/or sustainability assessment tools. Hence, for the search: were used the theoretical framework of the general theory of systems and evaluation of sustainability; was conducted a contextual analysis and identified intervention points for the system and complexity of sugarcane ethanol, identified critical issues involved in the implementation process of the sustainability concept and its assessment, and was ranked attributes required to systemic criteria. Finally, the research concluded that there hasn´t been an adequate linkage between the analysis models and their selection, harming the operational sustainability and evaluation. By such a structure can provide input and contribute to the decision-making process and the formulation and/or evaluation of public policies aimed for the sector\'s sustainability.

Submitted by Joana Azevedo (joanad@id.uff.br) on 2017-09-01T15:21:02Z No. of bitstreams: 1 Dissert Eduardo de Assumpção Silva.pdf: 1604099 bytes, checksum: 47a7b2843f5729ca0a320602bc1c384e (MD5) / Approved for entry into archive by Biblioteca da Escola de Engenharia (bee@ndc.uff.br) on 2017-09-04T13:30:26Z (GMT) No. of bitstreams: 1 Dissert Eduardo de Assumpção Silva.pdf: 1604099 bytes, checksum: 47a7b2843f5729ca0a320602bc1c384e (MD5) / Made available in DSpace on 2017-09-04T13:30:26Z (GMT). No. of bitstreams: 1 Dissert Eduardo de Assumpção Silva.pdf: 1604099 bytes, checksum: 47a7b2843f5729ca0a320602bc1c384e (MD5) Previous issue date: 2017-07-18 / A ciência e a tecnologia têm relação direta com o desenvolvimento de um país. Os projetos de pesquisa e desenvolvimento na CNEN são financiados pelos recursos diretos do orçamento da União e das Agências de Fomento como a FINEP e o CNPq. De um modo geral os gerentes de projetos acreditam que conseguem ter sucesso quando completam um projeto no prazo programado, no orçamento e nos requisitos previstos, que é comumente conhecido como “restrição tripla” ou “triângulo de ferro”. Entretanto, na revisão da literatura verificou-se outros critérios de avaliação do sucesso nos projetos, como os benefícios gerados à sociedade, o desenvolvimento das capacidades da equipe, as oportunidades futuras, novas tecnologias, entre outros. Diante dessa questão, buscando auxiliar o gestor na avaliação dessa tipologia de projetos, a pesquisa propôs um modelo com critérios e requisitos baseado na revisão da literatura e buscou através de um questionário medir os graus de importância e de utilização desses critérios junto aos especialistas da CNEN, que atuam diretamente na execução desses projetos. Os resultados revelaram que os critérios propostos no modelo possuem um grau de importância alto, com uma queda em relação à utilização, indicando que os critérios utilizados no modelo podem auxiliar os gestores na avaliação dessa tipologia de projeto. / Science and technology are directly related to the development of a country. The research and development projects at CNEN are financed by the direct resources of the budget of the Union and of the Development Agencies such as FINEP and CNPq. In general, project managers believe they can succeed when they complete a project within the programmed schedule, budget, and anticipated requirements, which is commonly known as a "triple constraint" or "iron triangle." However, in the review of the literature, other criteria for evaluation of success in projects, such as the benefits generated by society, the development of the team's capabilities, future opportunities, new technologies, among others, were verified. Faced with this question, seeking to assist the manager in the evaluation of this typology of projects, the research proposed a model with criteria and requirements based on the literature review and sought through a questionnaire to measure the degrees of importance and use of these criteria with the specialists of CNEN , Which act directly in the execution of these projects. The results showed that the criteria proposed in the model have a high degree of importance, with a decrease in relation to the use, indicating that the criteria used in the model can help managers in the evaluation of this type of project.

Esta pesquisa discute a avaliação da pós-graduação no Brasil, analisando, de um lado, o sistema de avaliação da CAPES (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior) e, de outro, a opinião da comunidade científica sobre esse sistema, focando especificamente nos critérios e instrumentos utilizados para esse fim. Pretendeu-se, com esta abordagem, contribuir para o aprimoramento do sistema de avaliação nacional da pós-graduação, tornando a avaliação um processo pactuado entre a CAPES e os programas de pós-graduação no Brasil. Para isso, foram confrontados os procedimentos utilizados no sistema de avaliação expressos nos documentos da CAPES e documentos das áreas de avaliação, com as opiniões da comunidade acadêmica apresentadas em artigos de periódicos e monografias. Foram estabelecidos como referenciais teóricos da pesquisa os conceitos de campo científico de Bourdieu e o de avaliação de Dahler- Larsen. O corpus da pesquisa foi coletado em três fontes: documentos criados pela CAPES, que contextualizam a pós-graduação e sua avaliação (PNPG 2011-2020); os Documentos de área elaborados pelas 48 áreas de avaliação e as críticas da comunidade acadêmica publicados em artigos de periódicos científicos. O corpus foi analisado e sistematizado por meio do método de Análise de Conteúdo. A análise teve como fio condutor os seis quesitos de avaliação de programas de pós-graduação da CAPES: Proposta do programa, Corpo docente, Corpo discente, teses e dissertações, Produção intelectual, Inserção social, e Internacionalização, bem como a Avaliação como um todo. Buscou-se identificar os comentários positivos, os comentários negativos e as sugestões da comunidade acadêmica. O quesito Produção intelectual foi o que recebeu a maior quantidade de críticas, identificando-se, portanto, como o foco das dúvidas e comentários da comunidade acadêmica. Os quesitos Proposta do programa, Corpo docente, Corpo discente, teses e dissertações, Inserção social, e Internacionalização receberam menor quantidade de comentários. Os resultados mostram que a avaliação, como um todo, apesar das críticas, é reconhecida como necessária pela comunidade acadêmica. Como contribuição final, foram feitas sugestões para aprimorar a enunciação dos quesitos e critérios de avaliação, de forma a promover sua melhor compreensão e transparência. / This research discusses the graduate evaluation in Brazil, analyzing, on the one hand, the evaluation system of CAPES (Higher Education Personnel Training Coordination) and, on the other, the opinion of the scientific community about this system, specifically focusing on criteria and instruments used for this purpose. It was intended, with this approach, contribute to the improvement of the national evaluation system, in order to make evaluation a process agreed between CAPES and graduate programs in Brazil. For this, they were confronted the procedures used in evaluation system expressed in the Capes documents and documents of the evaluation areas, with the views of the academic community presented in journal papers and monographs. The concepts of scientific field (Bourdieu) and evaluation society (Dahler-Larsen) were used as theoretical background of this research. The corpus of the research was collected from three sources: the documents created by CAPES which contextualize the evaluation process (PNPG 2011-2020), the documents prepared by the 48 evaluation areas and criticisms of the academic community published in scientific journals. The corpus was analyzed and systematized through the method of Content Analysis. The analysis was to thread the six evaluation items of graduate programs of CAPES: Program proposal, Faculty, Students, Theses and dissertations, Intellectual production, Social insertion, and Internationalization. One tried to identify the positive comments, negative comments and suggestions of the academic community. The item Intellectual Production has received the highest amount of criticism, becoming therefore the focus of the questions and comments of the academic community. The items Program proposal, Faculty, Students, Theses and dissertations, Social insertion, and Internationalization received fewer comments. The results show that evaluation, despite criticism, is recognized as necessary by the academic community. As a final contribution, suggestions were made to enhance the formulation of the evaluation criteria in order to promote their better understanding and transparency.

本研究旨在瞭解目前我國公立大學教師教學評鑑作法及實施上的優缺點，進而發展一套大學教師教學評鑑項目與指標及評鑑實施方式，最後提出有效提升我國當前大學教師教學評鑑作法之建議。文獻探討方面，主要瞭解「大學教學評鑑基本理論」、「大學教學評鑑相關研究」和「國外大學教學評鑑之設計與執行情形」。研究方法方面，本研究採用文件分析法、訪談法和德懷術專家問卷調查法蒐集本研究所需資料。透過文件分析法分析41所公立大學所訂定之教學評鑑辦法、教師評鑑辦法、教師升等辦法、教師教學服務成績考核辦法、優良教學教師評選辦法、教學意見調查表等內容，以瞭解目前公立大學教師之教學評鑑作法。並訪談15位分別於15所公立大學任教之教授，專長含括文、理、商、醫、農、工、社科、藝術、傳播、資電、運管、教育、生命科學、體育等領域，以及3所公立大學學生會會長，以瞭解目前公立大學教學評鑑實施方式之優缺點，及採用同儕評鑑、校友評鑑和公開教學評鑑結果的適切性。更邀請10位專精高等教育教學評鑑之專家學者組成德懷術專家小組，進行3回合德懷術專家問卷調查，以發展大學教師教學評鑑項目與指標及評鑑實施方式。茲將本研究之結論羅列於下，並依據結論提供有效提升大學教師教學評鑑設計之建議。 壹、結論 一、我國公立大學教學評鑑作法之特色和優點 （一）目前我國公立大學定期於學期末舉行教學意見調查，升等和教師評鑑時尚採用授課大綱、論文指導情形、授課時數、課程內容、教材研發、優良教師獲獎和他類課程支援等評鑑項目。 （二）目前我國公立大學教學評鑑之比重，於升等時教學績效比重較低，教師評鑑時教學績效比重較高且調整空間較大。 （三）國內半數以上公立大學設有教學優良教師遴選辦法，由特定委員會負責遴選作業，以鼓勵教學優良教師。 （四）目前國內公立大學最重視亦最普遍之教學評鑑方式為教學意見調查。調查內容主要著重「教師教學情形」、「學生學習成效」、和「課程綜合評述」，並輔以「學生背景資料」調查。 （五）目前國內公立大學教學評鑑作法具有形式上之提醒和警惕作用，可砥礪教師更用心於教學，提升個人教學品質。並藉以了解本身教學和學生學習情形，可作為規劃課程及調整教學方法之依據。 二、我國公立大學教學評鑑執行上之問題 （一）目前公立大學對於教學評鑑結果並無明確之獎懲和追蹤機制，教學評鑑結果對於教學品質之影響並不明顯。 （二）目前公立大學過於強調教師研究績效，間接抑制教師對於教學之熱情和付出。輕忽大學身為教育機構必須擔負之學生教學責任，可能導致未來教學績效每況愈下之隱憂。 （三）多數公立大學採用同一版本教學意見調查問卷評鑑多類課程，無法真實反應各類課程教學情形。 （四）目前公立大學教學意見調查之學生樣本無法掌握，認真填寫之學生亦未必能完整反應真正意見，開放意見填寫人數過少，調查結果並非完整且具代表性，評鑑結果之正確性和助益性有待評估。 （五）目前公立大學所執行之教學意見調查，學生之評分標準易受課程難易、給分情形、教師要求和本身能力所影響，不一定客觀呈現實際教學良窳，應避免作為教學評鑑唯一參考。 三、採用同儕評鑑、校友評鑑和公開評鑑結果之適切性 （一）同儕評鑑雖可借重教師專業以提供教學評鑑重要資訊，但因涉及教師間之相處問題，彼此人際關係良窳、資歷深淺、身分尊卑等原因可能影響評鑑標準之公正性，無法真實反應教學情形。 （二）同儕評鑑之時間、人員和標準難以規劃，教師教學可能因同儕評鑑而受到干擾，或因此調整教學方式以配合評鑑，最後淪為單堂課程教學演示，徒增教師工作負擔，無法深入且完整瞭解教學情形。 （三）全面公開教師教學評鑑結果，雖可做為學生選課參考並惕勵教師提升教學品質。但可能導致教師為提高評鑑成績而改變教學內容或評分方式，僅迎合學生喜惡而非改善教學品質，讓學生以教學評鑑分數評斷教師教學良窳並不妥適。 （四）畢業校友之意見具實用性，但教師每年教學方式持續調整進步，校友對學校事務關切度和瞭解度未必正確，因此，畢業校友之教學評鑑應著重於課程內容規劃是否有助於工作職場需求，而非評鑑教師個人教學優劣。 四、大學教師教學績效評鑑項目與指標及實施方式之規劃 （一）採用單一教學評鑑項目與指標作為升等、教師評鑑、教學評鑑之共同參考依據，並針對不同指標給予不同權重計分。 （二）包括三大教學評鑑面向、十項教學評鑑項目和三十四項教學評鑑指標，其中「教學歷程」最受重視，其次為「教學成果」，再其次為「教學投入」。 （三）採用教師資料提供、同儕教師專業審查、學生意見調查和系所資料審查之多元評鑑人員和評鑑方式。其中學生意見調查應可作為最基礎之評鑑方式，並輔以同儕評鑑以兼顧其專業性。 （四）規劃配合每學年定期舉行之教師評鑑，具備教學成長、人事決策、後續追縱輔導和獎懲機制之教學評鑑流程。 貳、建議 一、對大學教學評鑑制度規劃之建議 （一）應正視當前重研究輕教學之情形，建議設立教學型和研究型教師之制度，減輕教師研究負擔，並提升教學之重要性。 （二）建議設立教學評鑑結果之追蹤輔導和獎懲機制，促使教學評鑑確實發揮提升教學品質之功能。 （三）教學評鑑應和教學專業發展結合，形塑教學專業成長乃教師生涯重要任務之概念，使教師有意願於教學專業之提升和教學評鑑工作之協助。 （四）於學校中建立常設性教學專業成長和教學評鑑單位，提供教師專業相關協助，使其從教學評鑑的被動者轉化為主動者。並規劃評鑑能力培訓課程，以培育評鑑人員定期進行深入且連貫之教學評鑑工作。 二、對大學教學評鑑內容及方式之建議 （一）目前國內公立大學教學評鑑作法以教學意見調查結果為基礎，教學優良教師遴選為鼓勵，兼具全面和拔尖之優點，應繼續維持。 （二）教學評鑑應採多元且客觀之評鑑標準，以提升教學評鑑之公正性。建議參考本研究所研發之「大學教師教學評鑑項目與指標及實施方式」規劃教學評鑑制度。 （三）建議採用焦點團體、評鑑者和受評者討論機制，以使評鑑結果發揮最大效果，並彌補教學意見調查不足之處。 （四）借重同儕教師之專業，協助評鑑教材內容選用之專業性，以避開同儕進行教學評鑑可能面臨之問題，作為推動同儕評鑑之初步作法。 （五）校友評鑑著重於課程內容之實用性，可作為系所課程規劃或教師課程設計之參考資料。 （六）建議由即將畢業的學生票選系所教學最優良之教師，歷年統計下來將可獲得學生心目中教師教學情形之數據資料。 三、大學教學意見調查實施之建議 （一）教學意見調查問卷題目之設計應更具體，並設計可配合不同性質課程進行調整之彈性機制。 （二）設法提高學生填寫教學意見調查表以及開放意見之意願和誘因，以提高樣本之充足性，並設立問卷篩選機制，促使調查結果更具正確性，確實發揮協助教學品質提升之功能。 （三）僅公布教學意見調查結果優良之課程，以取代全面公布教學評鑑結果，應可提升教學品質、提供學生選課參考，並避免增加教師教學壓力之效果。 四、大學教學評鑑未來研究相關建議 （一）「大學教學成果評鑑項目與指標」之研發。 （二）「同儕評鑑專業審查可行性」之調查。 （三）「我國私立大學教師教學評鑑」之研究。 （四）本研究「大學教學評鑑項目與指標及實施方式」可行性調查。 / The purpose of the research is to explore the teaching evaluation system in public universities in Taiwan and to develop a model for teaching evaluation criteria and process. The research adopts documentary analysis, interview and Delhi questionnaire survey to achieve the purpose of the study. First, the researcher analyzed the prescripts and documents about teaching evaluation in 41 public universities to explore the teaching evaluation system now executed in schools. Then, the researcher interviewed university students and teachers who major in Liberal Arts, Science, Social Science, Medicine, Engineering, Bio-Resources and Agriculture, Management, Public Health, Electrical Engineering and Computer Science, Law and Life Science to find the difficulties and problems of the evaluation system. At the same time, the researcher tried to develop a model of teaching evaluation criteria and process with Delhi questionnaire survey, and adopt AHP to analyze the data to get the indicators’ weights. The major findings were summarized as follows: 1. The characteristics of the teaching evaluation in public universities in Taiwan: (1)All public universities hold student ratings of instruction in the end of each semester; it’s the most prevalent way to evaluate teaching. (2)The universities will evaluate the syllabus, essay instruction, teaching hours, curriculum materials, excellent teaching rewards and curriculum support when promotion and teacher evaluation in process. (3)Most universities ask better instruction accountability in teacher evaluation than in promotion. (4)Half of the public universities have selection systems for excellent teaching teachers. 2. The problems in carrying out the teaching evaluation system: (1) We need to establish the feedback and punishment mechanism for the teaching evaluation. (2) Both instruction and research ability of college teachers should be equally emphasized, not just emphasize the research accountability. (3)Most universities use the same content questionnaires to evaluate different kinds of curriculum, and also can’t control the sample of student rating; this will reduce the accuracy of evaluation result. (4)The instruction rating from students may be influenced by the material, grades, instructional styles and student’s ability; we should try to use multiple evaluation data to make the evaluation results more correct. 3.The practicability of peer review, alumni ratings of instruction and teaching evaluation results publication: (1)The relationship between teachers may affect the objectivity and fairness of peer review. (2)The time, people, and criteria of peer review are difficult to arrange, and teachers may change the teaching way to match the evaluator’s favor, this may only increase the burden of teachers but can’t help evaluators catch the whole picture of teaching. (3)Publication of teaching evaluation result may make teachers change the material and grading to match the students favor to have better rating score; this may not improve the qualities of teaching but increase the pressure of teachers. (4)The opinions of alumni can give suggestion to teachers to adjust the content of material but can work as the criteria of instruction. 4.The characters of the teaching evaluation criteria and process developed by this research: (1)Adopting an assortment of evaluation indicators with different weights for promotion, teacher evaluation and teaching evaluation. (2)Adopting documentary audition, peer review, students rating for multiple evaluation methods. (3)Developing a teaching evaluation process for teaching progression, promotion decision , evaluation feedback and punishment mechanism. Finally, several suggestions have been made for developing and improving the teaching evaluation system in universities.

L’organisation des connaissances est une discipline investie par des bibliothécaires, documentalistes, archivistes spécialistes de l’information, informaticiens et tous professionnels de documents. Elle englobe toutes activités, études et recherches qui élaborent et traitent les processus d’organisation et de présentation des ressources documentaires utiles dans une organisation. Dans ce contexte, le projet ANR Miipa-Doc a pour objectifs d’explorer des nouvelles méthodes d’indexation ascendantes, en utilisant des termes descripteurs formulés par les individus plutôt que choisis parmi une liste préétablie, pour l’organisation des contenus documentaires complexes au sein des entreprises de large taille, et concevoir l’architecture logicielle correspondante.Dans ce projet notre contribution consiste à gérer l’hétérogénéité d’un système d’information d’organisation des contenus documentaires, basé sur une approche orientée métier et un SOC (système d’organisation des connaissances) folksonomique à facette. Nous proposons dans cette gestion une approche incrémentale dirigée par les modèles, issue de l’IDM (ingénierie dirigée par les modèles), basée sur des méta-modèles pour garantir l’aspect d’évolutivité. Après l’implémentation du prototype HyperTaging qui met en place ces deux approches, nous proposons un processus d’évaluation permet de positionner ce prototype et tous SI de classification documentaire dans l’environnement des ECM, en se basant sur des critères d’évaluation fins et particuliers. / The knowledge organization is invested by librarians, archivists, information specialists, IT professionals and all discipline of document. It includes all activities, studies and research which develop and treat organization process and presentation of relevant information resources in an organization. In this context the Miipa-Doc project aims to explore new ascendants indexing methods, using descriptors made by individuals rather than selected given list for complex contained in the organization document, in large size companies, and design the corresponding software architecture.Our contribution in this project is to manage the heterogeneity of an information system of document organization, based on a business-oriented approach and a KOS (knowledge organization system) of folksonomy facet. We propose an incremental approach this management model driven, outcome of MDE (Model Driven Engineering), based on meta-models to ensure scalability appearance. After implementing the HyperTaging prototype, that implements both approaches, we propose an evaluation process used to position the prototype and all IS of documentary classification in the environment of ECM based on purposes of delicate and particular evaluation criteria.

L’organisation des connaissances est une discipline investie par des bibliothécaires, documentalistes, archivistes spécialistes de l’information, informaticiens et tous professionnels de documents. Elle englobe toutes activités, études et recherches qui élaborent et traitent les processus d’organisation et de présentation des ressources documentaires utiles dans une organisation. Dans ce contexte, le projet ANR Miipa-Doc a pour objectifs d’explorer des nouvelles méthodes d’indexation ascendantes, en utilisant des termes descripteurs formulés par les individus plutôt que choisis parmi une liste préétablie, pour l’organisation des contenus documentaires complexes au sein des entreprises de large taille, et concevoir l’architecture logicielle correspondante.Dans ce projet notre contribution consiste à gérer l’hétérogénéité d’un système d’information d’organisation des contenus documentaires, basé sur une approche orientée métier et un SOC (système d’organisation des connaissances) folksonomique à facette. Nous proposons dans cette gestion une approche incrémentale dirigée par les modèles, issue de l’IDM (ingénierie dirigée par les modèles), basée sur des méta-modèles pour garantir l’aspect d’évolutivité. Après l’implémentation du prototype HyperTaging qui met en place ces deux approches, nous proposons un processus d’évaluation permet de positionner ce prototype et tous SI de classification documentaire dans l’environnement des ECM, en se basant sur des critères d’évaluation fins et particuliers. / The knowledge organization is invested by librarians, archivists, information specialists, IT professionals and all discipline of document. It includes all activities, studies and research which develop and treat organization process and presentation of relevant information resources in an organization. In this context the Miipa-Doc project aims to explore new ascendants indexing methods, using descriptors made by individuals rather than selected given list for complex contained in the organization document, in large size companies, and design the corresponding software architecture.Our contribution in this project is to manage the heterogeneity of an information system of document organization, based on a business-oriented approach and a KOS (knowledge organization system) of folksonomy facet. We propose an incremental approach this management model driven, outcome of MDE (Model Driven Engineering), based on meta-models to ensure scalability appearance. After implementing the HyperTaging prototype, that implements both approaches, we propose an evaluation process used to position the prototype and all IS of documentary classification in the environment of ECM based on purposes of delicate and particular evaluation criteria.

Despite widespread use of web-based e-learning applications, insufficient attention is paid to their usability. There is a need to conduct evaluation using one or more of the various usability evaluation methods. Given that heuristic evaluation is known to be easy to use and cost effective, this study investigates the extent to which it can identify usability problems in a web-based e-learning application at a tertiary institution. In a comparative case study, heuristic evaluation by experts and survey evaluation among end users (learners) are conducted and the results of the two compared. Following literature studies in e-learning - particularly web-based learning - and usability, the researcher generates an extensive set of criteria/heuristics and uses it in the two evaluations. The object of evaluation is a website for a 3rd year Information Systems course. The findings indicate a high correspondence between the results of the two evaluations, demonstrating that heuristic evaluation is an appropriate, effective and sufficient usability evaluation method, as well as relatively easy to conduct. It identified a high percentage of usability problems. / Computing / M.Sc. (Information Systems)

Dentre as fontes renováveis de energia, os biocombustíveis têm apresentado amplo destaque como alternativa sustentável e potenciais substitutos aos combustíveis fósseis, e são vistos por muitos decisores políticos e cientistas como recursos de baixo impacto ambiental e de boa rentabilidade econômica. No Brasil o biocombustível que tem apresentado maior destaque tem sido o etanol da cana-de-açúcar. Entretanto, existem questionamentos sobre sua produção e consumo. De um lado ocorrem ganhos pelo fato desta ser uma atividade energética renovável, mas por outro lado, observa-se a ocorrência de degradações sociais e ambientais, derivadas da monocultura extensiva, bem como, problemas econômicos de instabilidade de mercado. Ademais, é importante considerar a existência de uma rede de atores políticos, técnicos e de consumidores relacionados ao processo de tomada de decisão, processos econômicos e às questões sociais e ambientais. Estes agentes podem influenciar de forma direta e/ou indireta no futuro da cana-de-açúcar no Brasil. A interação entre estes vários elementos torna complexa a realidade do setor e potencializa as várias preocupações sobre a evolução da atividade. Desse modo, postular a sustentabilidade como uma característica fundamental para a atividade, tem se apresentado como um difícil, porém importante desafio. Um dos aspectos essenciais para responder a estes desafios, é a avaliação de sustentabilidade. Porém muitas das ferramentas de avaliação possuem limitações em contemplar critérios de sustentabilidade de maneira sistêmica. Com a gama de opções existentes, a decisão pela adoção de métodos de avaliação de sustentabilidade também se apresenta complexa, já que cada ferramenta \"abraça\" uma visão especifica de mundo, de sustentabilidade, de valores, de acordo com suas teorias, abordagens e conceitos. Nesse sentido, esta tese se concentrou na pergunta sobre como estas questões de complexidade são consideradas no processo de seleção dos modelos de avaliação, bem como, de que forma estes modelos são escolhidos e, assim propôs, por meio da elaboração de procedimentos e critérios sistêmicos, uma estrutura analítica de seleção de modelos e/ou ferramentas de avaliação de sustentabilidade. Para tanto, a pesquisa: utilizou-se do arcabouço teórico da teoria geral de sistemas e da avaliação de sustentabilidade; realizou uma análise contextual e identificou pontos de intervenção para o sistema e a complexidade envolvida na temática do etanol de cana-de-açúcar; identificou pontos críticos envolvidos nos processos de operacionalização do conceito de sustentabilidade e sua avaliação e, levantou atributos necessários a elaboração dos critérios sistêmicos. Por fim, a pesquisa concluiu que não se observa uma adequada aderência entre os modelos de análise e sua seleção, prejudicando a operacionalidade da sustentabilidade e sua avaliação. Com tal estrutura é possível fornecer subsídios ao processo de tomada de decisão e à formulação e/ou avaliação de políticas públicas voltadas à para a sustentabilidade do setor. / Amongst the renewable energy sources, the biofuels have presented extent prominence as a sustainable alternative, ever since they present themselves as potential substitutes to fossil fuels and have been considered, by many policy makers and scientists, as low environmental impact and good economic profitability resources. In Brazil, the sugarcane ethanol is the biofuel which has had greater highlighting. However, there are some discussions about its production and consumption. On the one hand gains occur since the pollution decline and on account of ethanol is a renewable energy. On the other, it is observed the occurrence of social and environmental degeneration derived from extensive monoculture, as well, market instability. Furthermore, it is important to consider the existence of political, technical and consumer\'s network related to the decision making process, and economic, social and environmental issues. These agents can influence directly and /or indirectly in the future of sugarcane in Brazil. The interaction among this range of elements complicates the ethanol industry\'s reality and enhances the concerns about the activity evolution. Thus, postulating sustainability as a essential feature for the activity has emerged as a difficult but important challenge. One of the key aspects to respond to these challenges is the sustainability assessment. But many of assessment tools have limitations in contemplating systemically sustainability criteria. With the range of options available, the adoption decision of sustainability assessment methods also affords complexity, seeing that each tool \"embraces\" a world vision, sustainability, values, according to their theories, approaches and concepts. In this sense, this thesis focused on the question of how these complex issues are considered in the selection of valuation models process as well as how these models are chosen and proposed, by the development of systemic procedures and criteria, composing an analytical framework for model selection and/or sustainability assessment tools. Hence, for the search: were used the theoretical framework of the general theory of systems and evaluation of sustainability; was conducted a contextual analysis and identified intervention points for the system and complexity of sugarcane ethanol, identified critical issues involved in the implementation process of the sustainability concept and its assessment, and was ranked attributes required to systemic criteria. Finally, the research concluded that there hasn´t been an adequate linkage between the analysis models and their selection, harming the operational sustainability and evaluation. By such a structure can provide input and contribute to the decision-making process and the formulation and/or evaluation of public policies aimed for the sector\'s sustainability.

Abstract Pressures to cut public expenditure and to maximize value-adding use of scarce governmental resources are evident across the globe. Decision support tools for pinpointing when the activity is net beneficial are lacking, i.e. accountability is urgently called for but the process for recognizing and validating the best choices in direction and control are yet in their development. The objective of this research is to provide the science in general, and national administrations’ management and overseeing bodies in particular, a new understanding of how well the tasks and missions of the administration are fulfilled in terms of enhanced socio-economic well-being and adding to the value of different functions of society. This study approaches public performance management from the view-point of impact evaluation of a service oriented public product portfolio. The adopted research approach combines both qualitative and quantitative research methods. The research presents a process for evaluating a public organization’s overall benefit to cost ratio, with a case study within transport safety administration. The key findings of this research are that the socio-economic efficiency of a public entity can be quantified and that an operation of a public agency can be socio-economically net beneficial. Practical implications include re-allocation of resources to other more beneficial fields of responsibility, redesign of performance agreements and their indicators and initiating discussion in joint design of sustainable and balanced operational and strategic targets across government. Further research can exploit the methods presented in this study, as it has overcome some of the hurdles in socio-economic evaluation of public entities. With a clearer understanding of performance, government is able to better achieve its mission and its task of ensuring that agencies and other public bodies are functioning efficiently and properly. / Tiivistelmä Paineet julkisten menojen leikkaamiseksi tai hallitsemiseksi sekä julkisten resurssien tehokkaimman mahdollisen käytön varmistamiseksi kasvavat maailmanlaajuisesti. Julkisen toiminnan tulosohjausta tukevat päätöksenteko-työkalut ovat vielä puutteellisia ja varhaisessa kehitysvaiheessa, samalla kun toiminnan kustannusvastaavuutta ja tehokkuutta vaaditaan. Tämän tutkimuksen päätavoite on tuottaa uuttaa tietoa tieteelle ja myös julkishallinnolle siitä, kuinka hyvin viranomaisille asetetut tavoitteet ja tehtävät toteutuvat yhteiskuntataloudelle tuotettavan lisäarvon kannalta, sekä siitä miten lisäarvoa kyetään mittaamaan. Tämä tutkimus lähestyy tulosohjauksen tutkimusta ja kehittämistä palvelukeskeisen julkisorganisaation sekä sen palveluvalikoiman yhteiskunta-taloudellisen vaikuttavuuden arvioinnin keinoin. Valittu lähestymistapa yhdistelee laadullisia ja määrällisiä tutkimusmenetelmiä. Tutkimuksessa esitetään prosessi ja menetelmävalikoima julkisviranomaisen kustannushyötysuhteen määrittelemiseksi Liikenteen turvallisuusvirastoa käsittelevän tapausesimerkin avulla. Tutkimuksen keskeiset löydökset osoittavat, että julkisorganisaation yhteiskuntataloudellinen tehokkuus voidaan määrällistää ja että julkistoimijan toiminta voi olla yhteiskuntataloudellisesti kannattavaa. Käytännön suosituksiin sisältyy resurssien uudelleenohjaaminen tehokkaammin toimiville vastuualueille, tulossopimusten ja erityisesti niihin valittavien mittareiden uudelleensuunnittelu, sekä koko hallinnon kattavan keskustelun ja yhteissuunnittelun aloittaminen kestävän ja tasapainoisen tulosohjauksen aikaansaamiseksi strategisella ja operatiivisella tasolla. Jatkotutkimus ja hallinto voi hyödyntää tässä esitettyjä menetelmiä, nyt kun julkistoimijoiden yhteiskuntataloudellisen vaikuttavuuden arvioimisen haasteita on ratkaistu. Tuloksellisuuden vaatimusten selkeämpi ymmärtäminen mahdollistaa hallinnolle tehokkaamman tulosohjauksen ja siten tukee hallintoa sen pyrkimyksissä varmistaa julkistoimijoiden tehokas ja asianmukainen toiminta.