Submitted by Rosina Valeria Lanzellotti Mattiussi Teixeira (rosina.teixeira@unisantos.br) on 2015-04-10T11:48:28Z No. of bitstreams: 1 Marcel A. Valluis.pdf: 880165 bytes, checksum: 547522a8b04c5d9a482daa88d2f9d3aa (MD5) / Made available in DSpace on 2015-04-10T11:48:28Z (GMT). No. of bitstreams: 1 Marcel A. Valluis.pdf: 880165 bytes, checksum: 547522a8b04c5d9a482daa88d2f9d3aa (MD5) Previous issue date: 2014-05-15 / This dissertation analyzes the Enade (National Examination Performance of Students), one of the external assessments within the Sinaes (National Evaluation System of Higher Education), established by Law 10.861, of April 14, 2004, with the purpose of assessing HEI (Higher Education Institutions), the courses and performance of college students. The objective of this research is to analyze the impact of this examination on the graduating students of Business. The study is based on official documents, references on higher education in Brazil, its quality and on the current assessment policy. The research comes from the experience of the author, who is a professor and coordinator of the Business course and investigates a group of students from a HEI. It adopts a qualitative approach, conducted like as a case study, drawing on consultation with the subject using a questionnaire with open and closed questions. Responses to the questionnaire indicate that subjects perceive the Enade as an evaluating instrument of the training received in the course, they would do it spontaneously and that, from their perspective it contributes to improving the quality of higher education in Brazil. The results obtained from the research can be added to the other researches dealing with national examinations and assessment in higher education, as well as indicate to managers and teachers of HEI, alternatives to better incorporate this type of external evaluation to their daily routine without compromising their autonomy, and better understand the challenges faced by the course that meets working students, aged between 21 and 45, who come from public schools. / A dissertação analisa o Enade (Exame Nacional de Desempenho de Estudantes), uma das avaliações externas que integram o Sinaes (Sistema Nacional de Avaliação da Educação Superior), instituído por meio da Lei 10.861, de 14 de abril de 2004, com o propósito de avaliar as IES (Instituições de Educação Superior), os cursos e o desempenho de estudantes universitários. O objetivo da investigação consiste em analisar a repercussão do Exame junto a estudantes concluintes do curso de Administração. O estudo fundamenta-se em documentos oficiais, referenciais sobre educação superior no Brasil, sua qualidade e sobre a atual política de avaliação. A pesquisa tem origem na experiência do autor, que é professor e coordenador do curso de Administração e investiga um grupo de estudantes de uma IES específica, que é confessional e comunitária. Adota abordagem qualitativa, realizando um estudo de caso de caráter exploratório, valendo-se de consulta aos sujeitos por meio de questionário com perguntas abertas e fechadas a estes estudantes. As respostas ao questionário indicam que os sujeitos percebem o Enade como instrumento avaliador da formação recebida no curso, que o fariam espontaneamente e que, sob sua ótica, contribui para a melhoria da qualidade da educação superior no Brasil. Os resultados obtidos por meio deste estudo exploratório poderão somar-se a outros que tratam de exames nacionais e avaliação na educação superior, além de indicar aos gestores e professores da IES alternativas para melhor incorporar esse tipo de avaliação externa ao seu cotidiano sem, no entanto, comprometer sua autonomia e melhor entender os desafios enfrentados pelo curso de Administração devido à origem socioeconômica e escolar de seus estudantes.

The purposes of this study were two-fold: to develop a program model for vocational assessment of handicapped students in the public schools that would include information concerning the following components: goals/outcomes, methods, procedures, target populations, and staffing. (2) to compare perceptions of four types of personnel (vocational evaluators, vocational adjustment coordinators, vocational counselors, and educational diagnosticians) concerning the components that should be included in a program model of vocational assessment of handicapped students.

Quando um conjunto de dados possui uma estrutura hierárquica, uma possível abordagem são os modelos de regressão multiníveis, que se justifica pelo fato de haver uma porção significativa da variabilidade dos dados que pode ser explicada por níveis macro. Neste trabalho, desenvolvemos a seleção de modelos de regressão multinível aplicados a dados educacionais. Esta análise divide-se em duas partes: seleção de variáveis e seleção de modelos. Esta última subdivide-se em dois casos: modelagem clássica e modelagem bayesiana. Buscamos através de critérios como o Lasso, AIC, BIC, WAIC entre outros, encontrar quais são os fatores que influenciam no desempenho em matemática dos alunos do nono ano do ensino fundamental do estado de São Paulo. Também investigamos o funcionamento de cada um dos critérios de seleção de variáveis e de modelos. Foi possível concluir que, sob a abordagem frequentista, o critério de seleção de modelos BIC é o mais eficiente, já na abordagem bayesiana, o critérioWAIC apresentou melhores resultados. Utilizando o critério de seleção de variáveis Lasso para abordagem clássica, houve uma diminuição de 34% dos preditores do modelo. Por fim, identificamos que o desempenho em matemática dos estudantes do nono ano do ensino fundamental do estado de São Paulo é influenciado pelas seguintes covariáveis: grau de instrução da mãe, frequência de leitura de livros, tempo gasto com recreação em dia de aula, o fato de gostar de matemática, o desempenho em matemática global da escola, desempenho em língua portuguesa do aluno, dependência administrativa da escola, sexo, grau de instrução do pai, reprovações e distorção idade-série. / When a dataset contains a hierarchical data structure, a possible approach is the multilevel regression modelling, which is justified by the significative amout of the data variability that can be explained by macro level processes. In this work, a selection of multilevel regression models for educational data is developed. This analysis is divided into two parts: variable selection and model selection. The latter is subdivided into two categories: classical and Bayesian modeling. Traditional criteria for model selection such as Lasso, AIC, BIC, and WAIC, among others are used in this study as an attempt to identify the factors influencing ninth grade students performance in Mathematics of elementary education in the State of São Paulo. Likewise, an investigation was conducted to evaluate the performance of each variable selection criteria and model selection methods applied to fitted models that will be mentioned throughout this work. It was possible to conclude that, under the frequentist approach, BIC is the most efficient, whereas under the bayesian approach, WAIC presented better results. Using Lasso under the frequentist approach, a decrease of 34% on the number of predictors was observed. Finally, we identified that the performance in Mathematics of students in the ninth year of elementary school in the state of São Paulo is most influenced by the following covariates: mothers educational level, frequency of book reading, time spent with recreation in classroom, the fact of liking Math, school global performance in Mathematics, performance in Portuguese, school administrative dependence, gender, fathers educational degree, failures and age-grade distortion.

<p>Critique is an essential skill of professional designers to communicate success and failure of a design with others. For graphic design educators, including critique in their pedagogical approaches enables students to improve both their design capability and critique skills. Adaptive Comparative Judgment (ACJ) is an innovative approach of assessment where students and instructors make comparisons between two designs and choose the better of the two. The purpose of this study was to investigate the differences between instructors’ and students’ critiquing practices. The data was collected through think-aloud protocol methods while both groups critiqued the same design projects. </p> <p>The results indicate that it took students longer to finish the same amount of critiques as those completed by instructors. Students spent more time describing their personal feelings, evaluating each individual design, and looking for the right phrases to precisely express their thoughts on a design. Instructors, with more teaching experience, were able to complete the critique more quickly and justify their critique decisions more succinctly with efficient use of terminology and a reliance on their instincts. </p>

<p>The Elon Research Seminar, <i>Critical Transitions: Writing and the Question of Transfer</i>, was a coalition of rhetoric and composition scholars’ attempt at codifying writing transfer knowledge for teaching and research purposes. Although the seminar was an important leap in transfer research, many ‘behind the scenes’ decisions of writing transfer, often those not involving the writing program, go unnoticed, yet play a pivotal role in how writing programs encourage and reproduce writing transfer in the classroom. This dissertation study, inspired by a pilot study conducted in Fall 2018 on writing across the curriculum programs and their role in writing transfer, illustrates how an institution’s context systems (e.g., macrosystem, mesosystem, microsystem, etc.) affect writing programs’ processes—i.e., curriculum components, assessment, and administrative structure and budget—and vice versa. Using Bronfenbrenner and Morris’ (2006) bioecological model, I show how writing programs and their context systems interact to reproduce writing transfer practices. Through ten interviews with writing program administrators at state comprehensive universities, I delineate specific actions that each writing program could take to encourage writing transfer. I develop a list of roles and responsibilities a university’s context systems play in advocating writing transfer practices. The results of the study show that research beyond the writing classroom and students is necessary to understand how writing transfer opportunities arise in university cultures of writing.</p>

This article opens up a discussion on the power that teachers have in mathematics curriculum at the Further Education and Training level. It is related to the general question: who holds the power in school mathematics education in South Africa? To what extent is the teacher given an opportunity to exercise their power in mathematics assessment? If the teacher is given power, what does that power allow teachers to do, and under what conditions does this happen? The case of mathematics is presented here to illustrate the above complex questions of teacher power in new forms of assessment in the curriculum.

No description available.

<p>  </p> <p>Clustering, a prevalent class of machine learning (ML) algorithms used in data mining and pattern-finding—has increasingly helped engineering education researchers and educators see and understand assessment patterns at scale. However, a challenge remains to make ML-enabled educational inferences that are useful and reliable for research or instruction, especially if those inferences influence pedagogical decisions or student outcomes. ML offers an opportunity to better personalizing learners’ experiences using those inferences, even within large engineering classrooms. However, neglecting to verify the trustworthiness of ML-derived inferences can have wide-ranging negative impacts on the lives of learners. </p> <p><br></p> <p>This study investigated what student clusters exist within the standard operational data of a large first-year engineering course (>1500 students). This course focuses on computational thinking skills for engineering design. The clustering data set included approximately 500,000 assessment data points using a consistent five-scale criterion-based grading framework. Two clustering techniques—N-TARP profiling and K-means clustering—examined criterion-based assessment data and identified student cluster sets. N-TARP profiling is an expansion of the N-TARP binary clustering method. N-TARP is well suited to this course’s assessment data because of the large and potentially high-dimensional nature of the data set. K-means clustering is one of the oldest and most widely used clustering methods in educational research, making it a good candidate for comparison. After finding clusters, their interpretability and trustworthiness were determined. The following research questions provided the structure for this study: RQ1 – What student clusters do N-TARP profiling and K-means clustering identify when applied to structured assessment data from a large engineering course? RQ2 – What are the characteristics of an average student in each cluster? and How well does the average student in each cluster represent the students of that cluster? And RQ3 – What are the strengths and limitations of using N-TARP and K-means clustering techniques with large, highly structured engineering course assessment data?</p> <p><br></p> <p>Although both K-means clustering and N-TARP profiling did identify potential student clusters, the clusters of neither method were verifiable or replicable. Such dubious results suggest that a better interpretation is that all student performance data from this course exist in a single homogeneous cluster. This study further demonstrated the utility and precision of N-TARP’s warning that the clustering results within this educational data set were not trustworthy (by using its W value). Providing this warning is rare among the thousands of available clustering methods; most clustering methods (including K-means) will return clusters regardless. When a clustering algorithm identifies false clusters that lack meaningful separation or differences, incorrect or harmful educational inferences can result. </p>

<p>Despite an emphasis on oral communication in most foreign language classrooms, the resource-intensive nature (i.e. time and manpower) of speaking tests hinder regular oral assessments. A possible solution is the development of a (semi-) automated scoring system. When it is used in conjunction with human raters, the consistency of computers can complement human raters’ comprehensive judgments and increase efficiency in scoring (e.g., Enright & Quinlan, 2010). In search of objective and quantifiable variables that are strongly correlated with overall oral proficiency, a number of studies have reported that some utterance fluency variables (e.g., speech rate and mean length of run) might be strong predictors for L2 learners’ speaking ability (e.g., Ginther et al., 2010; Hirotani et al., 2017). However, these findings are difficult to generalize due to small sample sizes, narrow ranges of proficiency levels, and/or a lack of data from languages other than English. The current study analyzed spontaneous speech samples collected from 170 Japanese learners at a wide range of proficiency levels determined by a well-established speaking test, the American Council on the Teaching of Foreign Languages’ (ACTFL) Oral Proficiency Interview (OPI). Prior to analysis, 48 <i>Complexity, Accuracy, Fluency</i> (CAF) measures (with a focus on fluency variables) were calculated from the speech samples. First, the study examined the relationships among the CAF measures and learner oral proficiency assessed by the ACTFL OPI. Then, using an empirically-based approach, a feasibility of using a composite measure to predict L2 oral proficiency was investigated. The results revealed that <i>Speech Speed</i> and <i>Complexity</i> variables demonstrated strong correlation to the OPI levels, and moderately strong correlations were found for the variables in the following categories: <i>Speech Quantity, Pause</i>, <i>Pause Location</i> (i.e., Silent pause ratio within AS-unit), <i>Dysfluency</i> (i.e., Repeat ratio), and <i>Accuracy.</i> Then, a series of multiple regression analyses revealed that a combination of five CAF measures (i.e., Effective articulation rate, Silent pause ratio, Repeat ratio, Syntactic complexity, and Error-free AS-unit ratio) can predict 72.3% of the variance of the OPI levels. This regression model includes variables that correspond to Skehan’s (2009) proposed three categories of fluency (speed, breakdown, and repair) and variables that represent CAF, supporting the literature (e.g., Larsen-Freeman, 1978, Skehan, 1996).</p>

No description available.