MAIA, José Leudo. Uso da Teoria Clássica dos Testes – TCT e da Teoria de Resposta ao Item – TRI na avaliação da qualidade métrica de testes de seleção. 2009. 325f. Tese (Doutorado em Educação) – Universidade Federal do Ceará, Faculdade de Educação, Programa de Pós-Graduação em Educação Brasileira, Fortaleza-CE, 2009. / Submitted by Maria Josineide Góis (josineide@ufc.br) on 2012-07-10T11:42:58Z No. of bitstreams: 1 2009_Tese_JLMaia.pdf: 4582126 bytes, checksum: 35b2f8279baa21b052a910889b5a7001 (MD5) / Approved for entry into archive by Maria Josineide Góis(josineide@ufc.br) on 2012-07-13T11:49:37Z (GMT) No. of bitstreams: 1 2009_Tese_JLMaia.pdf: 4582126 bytes, checksum: 35b2f8279baa21b052a910889b5a7001 (MD5) / Made available in DSpace on 2012-07-13T11:49:37Z (GMT). No. of bitstreams: 1 2009_Tese_JLMaia.pdf: 4582126 bytes, checksum: 35b2f8279baa21b052a910889b5a7001 (MD5) Previous issue date: 2009 / sse trabalho doutoral tem como proposta fazer uso da Teoria Clássica dos Testes – TCT e da Teoria de Resposta ao Item – TRI como instrumentos na avaliação da qualidade métrica de testes de seleção, sob quatro aspectos de investigação: Análise da Validez do Construto; Análise Psicométrica dos Itens; Funcionamento Diferencial dos Itens – DIF; e Função de Informação. Para tanto, foram utilizados dados dos resultados das provas de Português e Matemática do concurso vestibular da Universidade Estadual do Estado do Ceará – UECE, de 2007, em que participaram 20.016 candidatos a 38 Cursos de Graduação, somente na Capital do Estado. Para o tratamento desses dados, foram utilizados os seguintes softwares: SPSS, v15; BILOG-MG, v3.0; MULTILOG FOR WINDOWS, v1.0; e o TESTFACT v4.0. A primeira providência foi verificar a dimensionaidade dessas provas. Para tanto se utilizou o Método de Kaiser-Guttman, Scree-plot, e o Método das Cargas Fatoriais e das Comunalidades da Matriz de Fatores. A constatação foi de que a prova de Português apresentava características multidimensionais, sendo, portanto, descartada, por não atender aos pressupostos básicos da Unidimensionalidade e Independência Local dos Itens. A prova de Matemática, no entanto, por apresentar comportamento unidimensional, se tornou o foco deste trabalho. A análise da Validez do Construto foi realizada por meio dos coeficientes Alpha de Cronbach e Kuder-Richardson, tendo gerado valores iguais a 0,685, além da utilização, também, do método das Cargas Fatoriais, com cargas entre 0,837 e 0,960, indicando intensa consistência interna. A análise psicométrica dos itens foi realizada por meio dos índices de dificuldade, discriminação e acerto ao acaso, para ambas as teorias, indicando ser essa uma prova de dificuldade mediana, com bom comportamento discriminativo e baixo índice de acerto ao acaso. A análise do DIF foi realizada, segundo o gênero dos candidatos, pelos métodos Delta-plot, Maentel-Haenszel, Regressão Logística e Comparação dos Betas, indicando resultados estatísticamente não significativos, no que se concluiu não apresentar, a prova, comportamento diferenciado, segundo o gênero. A análise da Função de Informação da prova permitiu se observar que esta é particularmente válida para candidatos com aptidão em torno de 0,8750 e que, a um nível de confiança de 95%, 49,3% dos candidatos atenderiam a essa indicação. Observou-se também que 90,6% dos candidatos, em ambos os processos, apresentaram o mesmo nível de aptidão, indicando uma convergência bastante razoável entre os resultados gerados pela TCT e TRI, no entanto, no estudo amostral, a TRI identificou que 9,4% dos candidatos apresentaram maior aptidão para a realização de um curso superior que os selecionados pela TCT.

FundaÃÃo de Amparo à Pesquisa do Estado do Cearà / Esse trabalho doutoral tem como proposta fazer uso da Teoria ClÃssica dos Testes â TCT e da Teoria de Resposta ao Item â TRI como instrumentos na avaliaÃÃo da qualidade mÃtrica de testes de seleÃÃo, sob quatro aspectos de investigaÃÃo: AnÃlise da Validez do Construto; AnÃlise PsicomÃtrica dos Itens; Funcionamento Diferencial dos Itens â DIF; e FunÃÃo de InformaÃÃo. Para tanto, foram utilizados dados dos resultados das provas de PortuguÃs e MatemÃtica do concurso vestibular da Universidade Estadual do Estado do Cearà â UECE, de 2007, em que participaram 20.016 candidatos a 38 Cursos de GraduaÃÃo, somente na Capital do Estado. Para o tratamento desses dados, foram utilizados os seguintes softwares: SPSS, v15; BILOG-MG, v3.0; MULTILOG FOR WINDOWS, v1.0; e o TESTFACT v4.0. A primeira providÃncia foi verificar a dimensionaidade dessas provas. Para tanto se utilizou o MÃtodo de Kaiser-Guttman, Scree-plot, e o MÃtodo das Cargas Fatoriais e das Comunalidades da Matriz de Fatores. A constataÃÃo foi de que a prova de PortuguÃs apresentava caracterÃsticas multidimensionais, sendo, portanto, descartada, por nÃo atender aos pressupostos bÃsicos da Unidimensionalidade e IndependÃncia Local dos Itens. A prova de MatemÃtica, no entanto, por apresentar comportamento unidimensional, se tornou o foco deste trabalho. A anÃlise da Validez do Construto foi realizada por meio dos coeficientes Alpha de Cronbach e Kuder-Richardson, tendo gerado valores iguais a 0,685, alÃm da utilizaÃÃo, tambÃm, do mÃtodo das Cargas Fatoriais, com cargas entre 0,837 e 0,960, indicando intensa consistÃncia interna. A anÃlise psicomÃtrica dos itens foi realizada por meio dos Ãndices de dificuldade, discriminaÃÃo e acerto ao acaso, para ambas as teorias, indicando ser essa uma prova de dificuldade mediana, com bom comportamento discriminativo e baixo Ãndice de acerto ao acaso. A anÃlise do DIF foi realizada, segundo o gÃnero dos candidatos, pelos mÃtodos Delta-plot, Maentel-Haenszel, RegressÃo LogÃstica e ComparaÃÃo dos Betas, indicando resultados estatÃsticamente nÃo significativos, no que se concluiu nÃo apresentar, a prova, comportamento diferenciado, segundo o gÃnero. A anÃlise da FunÃÃo de InformaÃÃo da prova permitiu se observar que esta à particularmente vÃlida para candidatos com aptidÃo em torno de 0,8750 e que, a um nÃvel de confianÃa de 95%, 49,3% dos candidatos atenderiam a essa indicaÃÃo. Observou-se tambÃm que 90,6% dos candidatos, em ambos os processos, apresentaram o mesmo nÃvel de aptidÃo, indicando uma convergÃncia bastante razoÃvel entre os resultados gerados pela TCT e TRI, no entanto, no estudo amostral, a TRI identificou que 9,4% dos candidatos apresentaram maior aptidÃo para a realizaÃÃo de um curso superior que os selecionados pela TCT.

Este trabalho apresenta uma proposta para o ensino da Estatística e Probabilidade nas séries finais do Ensino Fundamental II. Seu objetivo é mostrar que a metodologia aqui adotada possibilita a aquisição de conceitos estatísticos e probabilísticos, assim como o desenvolvimento de habilidades pessoais e interpessoais. Trata de um projeto fundamentado em Planejamento de Experimentos com respaldo na aprendizagem ativa. Na sequência didática do projeto os alunos realizaram um experimento com aviões de papel no qual tiveram que responder, na prática, a seguinte questão \"Quais alterações podem ser feitas em um modelo de avião de papel para que ele permaneça mais tempo no ar?\". Para atestar a efetividade da sequência didática, foi construído e validado um Teste de Proficiência em Estatística e Probabilidade (TEPEP) com base nos fundamentos da Psicometria. A análise das características do teste foi feita por meio da Teoria Clássica dos Testes e da Teoria de Resposta ao Item. Foram sujeitos da pesquisa 391 alunos de escolas públicas e particulares da região do Vale do Paraíba, Estado de São Paulo. Desse total, 374 auxiliaram na validação do instrumento e os 17 alunos restantes participaram do projeto. Os resultados deste trabalho mostraram que o uso de Planejamento de Experimentos favoreceu a aprendizagem da Estatística e Probabilidade, desenvolvendo também outras competências. Em relação à validação do TEPEP, concluiu-se que os métodos psicométricos empregados têm grande potencial e devem ser mais explorados. Esta pesquisa apresenta, como produtos finais, a metodologia desenvolvida e o teste de proficiência construído, oferecendo ambos a professores e pesquisadores. / This work presents a proposal for teaching of Statistics and Probability, for the last years of Elementary School. Its objective is to show that the methodology adopted here allows the acquisition of statistical and probabilistic concepts, as well as the development of personal and interpersonal skills. It\'s a project with a didactic sequence grounded in Designs of Experiments, supported in active learning. In the didactic sequence of the project the students carried out an experiment with paper airplanes in which they had to answer, in practice, the following question \"What changes can be made to a paper airplane model so that it stays longer in the air?\". To attest the effectiveness of the didactic sequence, it was developed and validated a Proficiency Test in Statistics and Probability (PTSP), this using Psychometry. The analysis of the characteristics of the test was made through the Classical Test Theory and the Item Response Theory. The research subjects were a total of 391 students from public and private schools in the Vale do Paraíba region, State of São Paulo. Of this total, 17 students participated in the project. The other students (374) assisted in the test validation. The results of this research showed that the use of Design of Experiments favored the learning of Statistic and Probability, also to develop others competences. Regarding the validation of PTSP, it could be concluded that the psychometric methods used have potential and they should be more explored. This research acclaims, as final products, the developed methodology and the Proficiency test validated, both offered to teachers and researchers.

Dynamic assessment, which is often characterised by the learning potential approach across the world and in South Africa, is receiving more and more attention from educators and research practitioners alike. The nature of dynamic assessment lends itself to application in areas where prior dependence on static (traditional) forms of psychometric assessment can no longer be sustained as viable options towards assessment. A main focus area within dynamic assessment is the field of tertiary selections and admissions. More research is needed in this field in South Africa and in order to progress within the field in this country in terms of designing, developing, norming and implementing dynamic assessment tests/batteries, previous research has to be investigated in detail in order to understand the areas which need attention and improvement more fully. In addition, it is not only the negative aspects which need to be investigated but also the success with which many studies have been greeted which needs to be looked at. Investigating the status of South African research into the field of dynamic assessment offers the interested practitioner a platform from which to view results that have emanated from this country in the past fifteen years. Past reliance on static measures meant that product-based assessment made no allowance for the detection and measurement of potential within individuals. It is not the contention of this study to state unequivocally that all disadvantaged students possess equal potential, but that a large pool of learners with potential are often passed over during selection for admission. In order to address these and similar issues, new tests will have to be developed but these can only be developed once past and current research is properly assessed. This is the aim of the present study. There is no document yet available on the status of dynamic assessment in South Africa which pays close attention to the research details of various findings within this field. The main findings indicate that although the field is still being researched today, there has been a decrease in the number of studies as well as a concomitant decrease in the implementation of dynamic research efforts. The reasons cited are lack of time, costs, inefficiencies and also confusion as to what dynamic assessment entails. There is, as yet, no consistent definition of dynamic assessment in South Africa, which makes it all the harder to entrench dynamic assessment as a methodology and implement it on as wide a scale as possible. Most research efforts in this field in South Africa presently comprise Master's and Doctoral studies and are, for the most part, efforts emanating from a handful of tertiary institutions. Some past research efforts have been successful but have since been disbanded, whereas there has been a growing awareness of the usefulness of dynamic assessment but it is not being implemented for the reasons stated above. This study investigates these results. Dynamic assessment is most certainly a prudent and effective partial solution to the issue of assessment in South Africa and can no longer be ignored. Yet, with cautious interpretation of the results, researchers and practitioners in the field will be better able to arrive at a more informed opinion of the advances in the field when allowed to scour past and present research. / Thesis (MA (Research Psychology))--University of Pretoria, 2003. / Psychology / unrestricted

Dynamic assessment, as manner of alternative process-based assessment, is currently at a cross-roads chiefly characterised by, at times, vague conceptualisation of terminology, blurred demarcation as to its model and theory status and at times ill-defined fundamental philosophy. As a movement in modern psychological assessment within the broader field of intelligence, dynamic assessment does not present with a coherent unifying theory as such and due to its lack of clarity in a number of key areas its eventual disuse might well be the final outcome of this method and its unique history and methodology. In pursuit of this study’s main goal, dynamic assessment models and theories are critically explored by means of a meta-theory largely inspired by the work K.B. Madsen, a Danish meta-theorist and pioneer in theoretical psychology. Madsen’s meta-theory is attenuated in order to suit the nature and purposes of this study; so as to better analyse dynamic assessment within intelligence research and assessment. In its primary aim, this study builds on a foundation of epistemological and ontological considerations within science in general, the social sciences and psychology in particular. In keeping with Madsen’s method of meta-theory analysis, the author’s predilections are stated at the outset in order to place the progression of analyses of the various models and theories within dynamic assessment. Dynamic assessment and intelligence are discussed and a brief digression into the history of Soviet psychology is offered as it is pertinent to the work of Lev Vygotsky and its subsequent influence within process-based assessment. Theory and model development within science and the social sciences are described from a philosophy-of-science vantage point. Psychological assessment’s prime considerations are critically explored and the discussion highlights the role played by the philosophical aspects of mathematics and statistical foundations as leveraging measurement within assessment. Particular attention is paid to the perennial controversy surrounding null hypothesis significance testing and the possible future directions that can be explored by and within dynamic assessment which lends itself to approaches less restrictive than those offered by mainstream statistics. The obvious and not so obvious aspects within the mathematical, statistical and measurement foundations are critically explored in terms of how best dynamic assessment can manoeuvre within the current mainstream psychological assessment system and how new models of item response theory suited to change-based assessment can be explored as possible manner of handling the gain score issue; itself a paradoxical state of affairs within classical and modern test theory. Dynamic assessment’s past has in large part been dictated by mainstream considerations in the areas mentioned and in order to place itself on an alternative path these considerations are critically assessed in terms of dynamic assessment’s future path. Dynamic assessment and its place within the broader intelligence assessment field is then investigated by means of the meta-theory developed. It is envisaged that the intuitive appeal of dynamic assessment will continue to garner support from practitioners across the globe, specifically those trained in countries outside the traditional stronghold of Western psychological theory. However, the position taken in this argument is that in order to ensure its survival it will need to make a decision in terms of its future progress: either to branch off from mainstream assessment altogether or to become fused within mainstream assessment. The “best of both worlds” scenario has obviously not worked out as it was originally hoped. The study concludes with the meta-theoretical exploration of dynamic assessment within intelligence by utilising a small selection of current models. The application of the attenuated Madsenian framework seeks to explore, place and ascertain the nature of each model regarding the ontological and philosophical status of the approach; the nature of the hypothetical terminology, scientific hypotheses and hypothesis system utilised and lastly the nature of the abstract data, concrete data and prime considerations as implicit concerns within the varied approaches. An HQ score is calculated for each such model and is a partial indicator of the testability (verifiability or falsifiability) of the model in question. The models are thus couched in meta, hypothetical and data strata and can be positioned on a continuum of sorts according to which tentative claims can be made regarding the veracity of the approach behind each model. The study concludes with two appendices; a meta-analysis which was conducted on South African research in the field of dynamic assessment (1961-2002) and which cumulated in a significant effect size evidencing an overall positive effect that dynamic assessment has had as an alternative intervention technique in comparison to conventional or static based assessment models. In order to encourage replication of this study, all details pertaining to the studies included for consideration in the meta-analyses are attached in section 2 of this appendix. Secondly, an informal content analysis was conducted on eleven responses to questionnaires that were originally delivered to one hundred dynamic assessment practitioners and researchers across the globe. The purpose of the questionnaire was to ascertain information on core issues within dynamic assessment, as these fundamental issues were considered as pivotal in the future of this approaches’ eventual development or stagnation. The analysis concluded that dynamic assessment is indeed perceived to be at a crossroads of sorts and thus supported the initial hypothesis stated above. It is hoped that this theoretical study will aid in aligning dynamic assessment in a manner such that its eventual place in psychological assessment will be solidly grounded, theoretically defensible and viable as alternative manner of assessment. / Thesis (PhD (Psychology))--University of Pretoria, 2007. / Psychology / PhD / PhD / unrestricted

This thesis explores item response theory (IRT) in the Personal Profile Analysis (PPA) from Thomas International. The study contains two parts (Part 1 and Part II) for which two sample groups were collected. For Part I of the research 650 participants were collected via the old form (CPPA25/C7) in the Beijing office of Thomas International in China (male=323, Female=267, missing=60). Part II of the research used the amended form in the same area and collected a sample of 307 (male=185, female=119, missing=3). The study postulates that IRT methods are applicable to forced-choice psychometrics. The results of Part I showed that the current CPPA form functions, to some extent, according to PPA’s original constructs. Part I of the research identified 16 items that need to be amended (called Amend A in this research). The amended form was returned to China for the collection of samples for Part II, and the results are deemed acceptable. The study concludes with a research protocol for PPA-IRT research generated from the current research. The research protocol suggests four levels of analysis for forced choice (FC) psychometrics, namely: 1. Textual analysis, 2. Functional analysis, 3. Dynamic analysis, and 4. Construct analysis. / Psychology / M.A. (Psychology)

No description available.

This thesis explores item response theory (IRT) in the Personal Profile Analysis (PPA) from Thomas International. The study contains two parts (Part 1 and Part II) for which two sample groups were collected. For Part I of the research 650 participants were collected via the old form (CPPA25/C7) in the Beijing office of Thomas International in China (male=323, Female=267, missing=60). Part II of the research used the amended form in the same area and collected a sample of 307 (male=185, female=119, missing=3). The study postulates that IRT methods are applicable to forced-choice psychometrics. The results of Part I showed that the current CPPA form functions, to some extent, according to PPA’s original constructs. Part I of the research identified 16 items that need to be amended (called Amend A in this research). The amended form was returned to China for the collection of samples for Part II, and the results are deemed acceptable. The study concludes with a research protocol for PPA-IRT research generated from the current research. The research protocol suggests four levels of analysis for forced choice (FC) psychometrics, namely: 1. Textual analysis, 2. Functional analysis, 3. Dynamic analysis, and 4. Construct analysis. / Psychology / M.A. (Psychology)

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior / This dissertation aims to analyze the items and dimensions of quality related to apartments in the city of Santa Maria / RS. It is underlined that quality investigated comes to compliance with the characteristics required by customers. About the methodological proceedings, 39 characteristics of location qualities, position and typological were listed according to the bibliography and sequentially reviewed by the real estate agencies. Subsequently, on the real estate agencies, data were collected of 500 apartments sold on 04/01/2013 to 08/25/2014; representing 37% of apartments sold in the city in that period. The data analysis began with the classical theory of tests, using Exploratory Factor Analysis and Confirmatory Factor Analysis sequentially, using the varimax rotation; which identified two factors, based on the criterion of Kaiser. Thus, the approach of Item Response Theory was opportunity, with the logistic model of two parameters as well, the presentation of the critical aspects on the use of Item Response Theory. The first model of Item Response Theory, whose latent trait was named quality of apartments about status, are compost of four items; while the second model, the latent trait quality of apartments about utility, no identified items Sequentially, it was found that the analyzed apartments had scores between 80 to 90, thus, it is clear that most of the apartments investigated for status have the score features 80 in ITR. Therefore it is possible conclude that the proposed objective of this dissertation was achieved. / Esta dissertação visa analisar os itens e dimensões da qualidade referentes aos apartamentos da cidade de Santa Maria/RS. Salienta-se que a qualidade estudada se trata da satisfação das características requeridas pelos clientes. Acerca dos procedimentos metodológicos, 39 características acerca de qualidades de localização, posição e tipológicas foram elencados de acordo com a bibliografia e sequencialmente verificados nas agências imobiliárias. Posteriormente, nas agências imobiliárias, foram coletados dados de 500 apartamentos vendidos nos períodos de 04/01/2013 a 25/08/2014; representando 37% dos apartamentos vendidos na cidade no referido período. O tratamento dos dados iniciou com a Teoria Clássica dos Testes, utilizando a Análise Fatorial Exploratória e sequencialmente a Análise Fatorial Confirmatória, utilizando a rotação ortogonal varimax; que apontou dois fatores, tendo como base o critério de Kaiser. Oportunizando assim a abordagem da Teoria de Resposta ao Item, apresentando o Modelo Logístico de dois parâmetros bem como, a apresentação dos aspectos críticos acerca da utilização da Teoria de Resposta ao Item. O primeiro modelo da Teoria de Resposta ao Item, cujo traço latente foi denominado qualidade dos apartamentos quanto ao status do apartamento, é composto por quatro itens; enquanto o segundo modelo, de traço latente qualidade dos apartamentos quanto à utilidade, não gerou itens. Sequencialmente, verificou-se que os apartamentos analisados possuíam escore entre 80 a 90, por conseguinte, é possível afirmar que a maioria dos apartamentos investigados quanto a status possuem as características de escore 80 na TRI. Portanto, é possível afirmar que, o objetivo proposto da presente dissertação foi alcançado.

Contexte. Au cours des dernières années, l’évaluation de la violence sexuelle a connu un essor croissant. En effet, les milieux de la recherche tentent d’étudier plus largement l’ensemble des violences sexuelles, notamment en s’intéressant à la coercition sexuelle. À ce jour, il subsiste des différences quant à la définition de la notion de coercition sexuelle et une incertitude relative aux instruments de mesure à employer demeure. Objectif. L’objectif du présent mémoire est donc de construire et de mettre à l’épreuve la validé d’une échelle de mesure de la coercition sexuelle en utilisant les items du Multidimensional Inventory of Development, Sex, and Agression (MIDSA). Méthodes. L’échantillon est composé de 529 hommes, ayant commis une infraction à caractère sexuel, incarcérés dans une prison ou encore dans un centre de traitement du Massachusetts ou du Minnesota. Tous les participants ont complété le MIDSA. Le MIDSA propose 20 items mesurant 5 types de tactiques de coercition sexuelle : la manipulation, l’intoxication volontaire, l’action de prendre avantage d’une personne intoxiquée, la menace de l’utilisation de la force physique ainsi que l’utilisation de la force physique. Résultats. Les résultats indiquent que l’échelle de coercition sexuelle à 5 items possède les meilleures propriétés psychométriques. La cohérence interne de l'échelle est bonne. De plus, les analyses de théorie de réponse à l’item indiquent que la majorité des items étaient considérés comme difficiles et que tous les items possèdent un bon pouvoir discriminant. Enfin, l’échelle présente des corrélations de modérées à élevées avec la majorité des échelles associées, indiquant ainsi une bonne validité convergente et concurrente. / Background. In recent years, the assessment of sexual violence has grown steadily. In fact, the research community has been trying to examine broader forms of sexual perpetration and victimization, especially sexual coercion. There is no consistent definition in the literature for sexual coercion and uncertainty remains regarding the measuring instruments. Objective. The study aims to create a scale of sexual coercion using items from the Multidimensional Inventory of Development, Sex, and Aggression (MIDSA) and assess its validity. Methods. The sample included 529 adult males who committed a sexual offense. They completed the MIDSA while incarcerated in prisons and special commitment facilities in Massachusetts and Minnesota at the time of assessment. The MIDSA proposes a 20 item pool measuring sexual coercion based on 5 types of tactics to coerce someone into sexual activity: manipulation and bribing, offering drinks or drugs, taking advantage of someone already intoxicated by drugs or alcohol, using threats of physical force, and the use of physical force. Results. Findings from this study revealed that a 5-item version of the sexual coercion scale has the best psychometric properties. The internal consistency of the scale is good. Furthermore, the item response theory analysis shows that most items were considered difficult and serious and that all items present a good discriminant power. Finally, the sexual coercion scale presents moderate-high correlations with almost all associated scales, indicating good convergent and concurrent validity.