The problem of this study was an analysis of the scores made on selected standardized tests used as one part of the procedure for admission to the teacher education program at North Texas State University. The students involved were enrolled in their first professional course in education.

College admission tests are of great importance for admissions systems in general and for candidates in particular. The SweSAT (Högskoleprovet in Swedish) has been used for college admission in Sweden for more than 30 years, and today it is alongside with the upper-secondary school GPA the most widely used instrument for selection of college applicants. Because of the importance that is placed on the SweSAT, it is essential that the scores are reliable and that the interpretations and uses of the scores are valid. The main purpose of this thesis was therefore to examine some assumptions that are of importance for the validity of the interpretation and use of SweSAT scores. The argument-based approach to validation was used as the framework for the evaluation of these assumptions.The thesis consists of four papers and an extensive introduction with summaries of the papers. The first three papers examine assumptions that are relevant for the use of SweSAT scores for admission decisions, while the fourth paper examines an assumption that is relevant for the use of SweSAT scores for providing diagnostic information. The first paper is a review of predictive validity studies that have been performed on the SweSAT. The general conclusion from the review is that the predictive validity of SweSAT scores varies greatly among study programs, and that there are many problematic issues related to the methodology of the predictive validity studies. The second paper focuses on an assumption underlying the current SweSAT equating design, namely that the groups taking different forms of the test have equal abilities. The results show that this assumption is highly problematic, and consequently a more appropriate equating design should be applied when equating SweSAT scores. The third paper examines the effect of textual item revisions on item statistics and preequating outcomes, using data from the SweSAT data sufficiency subtest. The results show that most kinds of revisions have a significant effect on both p-values and point-biserial correlations, and as a consequence the preequating outcomes are affected negatively. The fourth paper examines whether there is added value in reporting subtest scores rather than just the total score to the test-takers. Using a method derived from classical test theory, the results show that all observed subscores are better predictors of the true subscores than is the observed total score, with the exception of the Swedish reading comprehension subtest. That is, the subscores contain information that the test-takers can use for remedial studies and hence there is added value in reporting the subscores. The general conclusion from the thesis as a whole is that the interpretations and use of SweSAT scores are based on several questionable assumptions, but also that the interpretations and uses are supported by a great deal of validity evidence.

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior / Esta tese objetiva a análise de provas discursivas de Língua Portuguesa de vestibulares, na perspectiva da leitura, focando a compreensão de texto, suas estratégias e os conhecimentos prévios necessários ao egresso do Ensino Médio. São analisadas as provas discursivas de Língua Portuguesa da UERJ, UNIRIO, UFF e UFRJ, realizadas nos vestibulares 2006, 2007 e 2008. Parte-se das seguintes hipóteses: as provas solicitam conhecimentos prévios baseados nos programas, habilidades e competências a serem desenvolvidos no nível médio; a dificuldade apresentada na realização das questões está relacionada não só ao conhecimento disciplinar de língua portuguesa, mas também à capacidade/estratégia de leitura dos enunciados e à dificuldade de seleção e interação de diferentes conhecimentos específicos relacionados ao seu uso pragmático. A partir de tais hipóteses, propõem-se os seguintes objetivos: levantar os conhecimentos específicos relativos ao ensino de língua portuguesa; compreender a relação do processo de leitura na ativação do conhecimento prévio; relacionar o processo de avaliação do vestibular ao contexto da educação básica; buscar explicação para as questões com nota média baixa. Para atingir os objetivos, contextualiza-se o ensino de Língua Portuguesa no Ensino Médio; aborda-se a leitura, no viés da compreensão de texto, focalizando principalmente conhecimentos prévios e inferências; faz-se uma breve história do vestibular, seus objetivos e seu papel; a seguir, analisam-se as provas indicadas, levantando-se conhecimento prévio, habilidades e competências envolvidas no processo de compreensão de texto. As principais conclusões são: as questões das provas analisadas estão de acordo com os programas publicados pelas universidades e com os PCNs; o nível de exigência é graduado, conforme as competências e habilidades variadas; o conhecimento prévio organizado e esquematizado é fundamental para a realização de inferências adequadas / This dissertation aims the discursive exam analysis of Portuguese language in admission tests on a reading perspective focusing the text comprehension, its strategies and previous knowledge needed to High School graduation. The analysis is made out on UERJ, UNIRIO, UFF and UFRJ universities discursive exams in Portuguese language performed in admission tests of 2006, 2007 and 2008. We start from the following hypothesis: exams require previous knowledge based in programs, skills and competences to be developed at medium level; the difficulty presented when performing questions is not only related to the disciplinary knowledge of Portuguese language, but also to the reading capacity/strategy of the enunciated and to the selection and interaction difficulty of different specific knowledge related to its pragmatic use. Starting from these hypotheses, the following objectives are proposed: to raise specific knowledge related to Portuguese language teaching; to understand the reading process relationship in the activation of previous knowledge; to relate the evaluation process of the admission exam to the basic educational context; to look for explanations to questions with low average mark. In order to meet the objectives, Portuguese language teaching is put in the same context as high school; the reading approach in the sense of text comprehension focuses mainly previous knowledge and inferences; a brief history of the admission exam is made, its objectives and its role are followed by indicated exam analysis, raising previous knowledge, skills and competences involved in the text comprehension process. The main conclusions are: questions of analyzed exams are according to programs published by universities and with PCNs (National Curricular Parameters); the demand level is graduated according to varied competences and skills; the organized and schematized previous knowledge is fundamental when performing adequate inferences

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior / Esta tese objetiva a análise de provas discursivas de Língua Portuguesa de vestibulares, na perspectiva da leitura, focando a compreensão de texto, suas estratégias e os conhecimentos prévios necessários ao egresso do Ensino Médio. São analisadas as provas discursivas de Língua Portuguesa da UERJ, UNIRIO, UFF e UFRJ, realizadas nos vestibulares 2006, 2007 e 2008. Parte-se das seguintes hipóteses: as provas solicitam conhecimentos prévios baseados nos programas, habilidades e competências a serem desenvolvidos no nível médio; a dificuldade apresentada na realização das questões está relacionada não só ao conhecimento disciplinar de língua portuguesa, mas também à capacidade/estratégia de leitura dos enunciados e à dificuldade de seleção e interação de diferentes conhecimentos específicos relacionados ao seu uso pragmático. A partir de tais hipóteses, propõem-se os seguintes objetivos: levantar os conhecimentos específicos relativos ao ensino de língua portuguesa; compreender a relação do processo de leitura na ativação do conhecimento prévio; relacionar o processo de avaliação do vestibular ao contexto da educação básica; buscar explicação para as questões com nota média baixa. Para atingir os objetivos, contextualiza-se o ensino de Língua Portuguesa no Ensino Médio; aborda-se a leitura, no viés da compreensão de texto, focalizando principalmente conhecimentos prévios e inferências; faz-se uma breve história do vestibular, seus objetivos e seu papel; a seguir, analisam-se as provas indicadas, levantando-se conhecimento prévio, habilidades e competências envolvidas no processo de compreensão de texto. As principais conclusões são: as questões das provas analisadas estão de acordo com os programas publicados pelas universidades e com os PCNs; o nível de exigência é graduado, conforme as competências e habilidades variadas; o conhecimento prévio organizado e esquematizado é fundamental para a realização de inferências adequadas / This dissertation aims the discursive exam analysis of Portuguese language in admission tests on a reading perspective focusing the text comprehension, its strategies and previous knowledge needed to High School graduation. The analysis is made out on UERJ, UNIRIO, UFF and UFRJ universities discursive exams in Portuguese language performed in admission tests of 2006, 2007 and 2008. We start from the following hypothesis: exams require previous knowledge based in programs, skills and competences to be developed at medium level; the difficulty presented when performing questions is not only related to the disciplinary knowledge of Portuguese language, but also to the reading capacity/strategy of the enunciated and to the selection and interaction difficulty of different specific knowledge related to its pragmatic use. Starting from these hypotheses, the following objectives are proposed: to raise specific knowledge related to Portuguese language teaching; to understand the reading process relationship in the activation of previous knowledge; to relate the evaluation process of the admission exam to the basic educational context; to look for explanations to questions with low average mark. In order to meet the objectives, Portuguese language teaching is put in the same context as high school; the reading approach in the sense of text comprehension focuses mainly previous knowledge and inferences; a brief history of the admission exam is made, its objectives and its role are followed by indicated exam analysis, raising previous knowledge, skills and competences involved in the text comprehension process. The main conclusions are: questions of analyzed exams are according to programs published by universities and with PCNs (National Curricular Parameters); the demand level is graduated according to varied competences and skills; the organized and schematized previous knowledge is fundamental when performing adequate inferences

No description available.

La segmentation de l’éducation entre le secteur de l’éducation publique et le secteur de l’éducation privée induit une persistance dans l’inégalité au Chili. En effet, les étudiants issus des écoles publiques font face à des opportunités plus faibles que les étudiants issus des écoles secondaires privées, notamment à l’entrée dans les universités traditionnelles qui sont les universités où les étudiants sont fortement demandés sur le marché du travail à la sortie de leurs études universitaires comparativement aux universités privées. Cependant, le test de sélection universitaire pour accéder à une université traditionnelle est mieux réussi par les étudiants du secondaire privé au détriment des étudiants du secondaire public. Nous tentons d’expliciter les politiques qui pourraient être mises en place pour faciliter l’accès à l’éducation privée ou améliorer la qualité de l’éducation publique afin d’accroître l’égalité des chances à l’entrée des universités traditionnelles pour tous les étudiants. Trois types de politiques ont été retenus : i) une augmentation du taux de subventions accordées aux écoles privées, ii) une diminution du prix aux consommateurs des services d’éducation publique et iii) une hausse des dépenses courantes en services d’éducation publique. Dans le premier chapitre, intitulé « Quelle politique de financement pour améliorer l’accès à une éducation de qualité ? », un modèle d’équilibre général calculable statique est présenté en considérant la segmentation du marché de l’éducation entre le secteur public et le secteur privé. Nous formalisons les comportements des agents sur le marché de l’éducation en termes de demande et de production des services d’éducation par cycles d’éducation. Nous considérons différents types de qualification et de dépendance éducationnelle constituant l’offre sur le marché du travail, exogène dans les deux premiers chapitres. Suite aux simulations, les résultats indiquent que l’accès à l’éducation privée pour tous les ménages est facilité dans le cas d’une politique d’augmentation des subventions accordées aux écoles privées alors qu’il est plus difficile d’accéder aux écoles privées dans le cas d’une hausse des dépenses courantes en services d’éducation publique. La concurrence en termes de prix entre les différents secteurs de l’éducation est plus élevée dans le cas d’une politique de baisse des prix aux consommateurs des services d’éducation publique. Enfin, l’augmentation des dépenses publiques courantes dans les services d’éducation publique réduit significativement le chômage. Le deuxième chapitre, intitulé « Qualité de l’éducation et productivité au Chili : une analyse dynamique en équilibre général calculable », est une extension du modèle présenté dans le premier chapitre. Nous spécifions dans ce modèle dynamique deux indicateurs. L’indicateur de qualité de l’éducation influence le comportement des ménages dans la demande des services d’éducation publique et privée. L’indicateur de formation du capital humain dépend des investissements réels en éducation réalisés dans chaque type d’éducation. Nous évaluons les impacts des diverses politiques sur la productivité sectorielle, la croissance et le chômage. Selon l’objectif principal du gouvernement, celui-ci adoptera une politique engendrant une croissance élevée au détriment d’une augmentation du chômage (augmentation des subventions accordées aux écoles privées) ou une politique tendant à réduire le chômage tout en assurant une croissance économique, bien que plus faible (amélioration de la qualité de l’éducation publique par augmentation des dépenses publiques courantes). Le troisième chapitre, intitulé « Éducation publique, éducation privée et offre de travail au Chili : une analyse dynamique en équilibre général calculable », est une extension du modèle présenté dans le premier chapitre. Ce modèle dynamique considère le comportement des étudiants dans les différents grades et niveaux d’éducation du parcours scolaire chilien, selon la méthodologie MAMS. Nous y introduisons la présence de différents types d’écoles et le mode d’entrée dans les universités. L’évolution de la composition de l’offre de travail varie suite aux études scolaires réalisées. La qualité de l’éducation influe sur le comportement des étudiants dans leurs parcours scolaires. Les résultats montrent que l’augmentation des dépenses publiques courantes au secondaire permet d’accroître les chances de réussite au test de sélection universitaire pour les étudiants issus du secondaire public tout en diminuant le taux de sortie du système scolaire. La hausse du taux de subventions publiques accordées aux écoles privées facilite l’accès aux écoles privées pour tous les ménages au détriment des étudiants des écoles publiques qui voient leur chance d’entrer dans les universités traditionnelles diminuer. / The Chilean education system is split between the public and private sectors, inducing persistent inequality. Students from public secondary schools benefit from fewer opportunities than those from private schools, particularly in regard to acceptance rates at traditional universities. Acceptance at traditional universities is conditional on passing a selection test. In this regard, private secondary school graduates outperform their public-school peers. However, businesses prefer to hire students from traditional universities rather than private universities. Due to the high costs of private education and to the quality gap between public and private education at primary and secondary levels, students from poor households find themselves at a disadvantage when applying to traditional universities. In this thesis, we study three kind of policies that facilitate access to private schools or aim to improve the quality of public education, allowing equal opportunities for all students to enter into traditional universities. The policies analyzed are: i) an increase in subsidies granted to private schools, ii) a decrease of the consumer price of public education services and iii) an increase in current expenditures in public education services. In the first chapter, we use a static computable general equilibrium model which takes into account the segmentation of the education market between public and private sectors. We present the behaviours in the education market in terms of the demand and production of education services by level of education (primary, secondary and tertiary). Labour supply is exogenous and is specified according to skills (diplomas) and type of education (public or private). The simulation results show that a policy of increased subsidies granted to private primary and secondary schools facilitates access to private primary and secondary schools. Conversely, an increase in current expenditures in public education services restricts access to private schools. A reduction in the consumer price of public education services renders the different sectors of education more competitive with one another. In addition, unemployment decreases significantly with a policy of higher current expenditures granted to public education services. The model presented in the second chapter is a dynamic extension of the model used in the first chapter, taking into account two new indicators. Household demand for public and private education services depends on relative prices and on an indicator for relative quality of education. The human capital formation indicator varies according to real investments made in each level and type of education. In this chapter, labour supply is exogenous. We focus on the impacts of each policy on sectoral productivity, growth and unemployment. Depending on the targets pursued by the government, policy can be chosen to induce high levels of growth at the expense of a rising unemployment (increased subsidies granted to private schools) or a policy which reduces unemployment and which generates lower, but still substantial, levels of growth (improvement of the quality of public education by increased public expenditures into public education services). Finally, the model specified in the third chapter is a further dynamic extension of the model presented in first chapter. We consider students’ behaviour in the different grades and levels of education in the Chilean school system, according to the MAMS methodology. This model also takes into account the types of schools and the method of entry into traditional and private universities. Labour supply is endogenous in this case and varies according to the type of school and the student behaviour in schooling. Moreover, education quality and other indicators influence students’ behaviours in their schooling. After simulations, we observe that students from public secondary schools succeed better in the case of increased public expenditures directed to public education services. This policy also produces a lower dropout rate. Access to private schools is facilitated with a higher subsidy granted to private primary schools. But, in this case, students from public secondary schools have a lower chance of acceptance at a traditional university. Furthermore, we show that the Ley de la Gratuidad de la Educación in traditional universities has important positive impacts on economic and human capital growth. The dropout rate at the secondary level is lower under this policy. Furthermore, incentives under this program favoured stronger student effort, increasing chances of acceptance at traditional Chilean universities.