Cognitive diagnostic assessment (CDA) is a new theoretical framework that is designed to integrate cognitive psychology into measurement theories. The main purpose of CDA is to provide examinees with diagnostic information while traditional psychometric approaches focus on how latent variables are accurately measured. Many cognitive diagnostic models (CDM) have been developed for CDA. Three cognitive diagnostic models- namely the rule space method (RSM), the high-order deterministic inputs, noisy ‘and’ gate (HO-DINA) model, and the multidimensional latent trait model for diagnosis (MLTM-D) model were compared using simulated data and empirical data. For the simulation study, three methods of data generation are proposed. Each method was designed based on one of the three models. A total of 12 conditions was involved in the simulation study: 2 item designs X 2 level of test X 3 methods of data generation. The diagnostic results were compared by level of test difficulty, level of ability estimates, and level of dimensionality. The effect of number of attributes on accurate classification was also investigated. For the empirical study, a mathematics test data was used and the diagnostic results were compared.

<div> <p>In order to achieve broadening participation in computer science and other careers related to computing, middle school classrooms should provide students opportunities (tasks) to think like a computer scientist. Researchers in computing education promote the idea that programming skill should not be a pre-requisite for students to display computational thinking (CT). Thus, some tasks that aim to deliberately elicit students’ CT competency should be stand-alone tasks rather than coding fluency-oriented tasks. Guided by this approach, this assessment design process began by examining national standards in CT. A Q-matrix (i.e., item–attribute alignment table) was then developed and modified using (a) literature in CT, (b) input from subject-matter experts, and (c) cognitive interviews with a small sample of students. After multiple-choice item prototypes were written, pilot-tested, and revised, 15 of them were finally selected to be administered to 564 students in two middle schools in the Mid-western US. Through cognitive diagnostic modeling, the estimation results yielded mastery classifications or subscores that can be used diagnostically by teachers. The results help teachers facilitate students’ <i>mastery orientations</i>, that is, to address the gap between what students know and what students need to know in order to meet desired learning goals. By equipping teachers with a diagnostic classification based assessment, this research has the capacity to inform instruction which, in turn, will enrich students’ learning experience in CT. </p> </div> <br>

This dissertation proposes two modified cognitive diagnostic models (CDMs), the deterministic, inputs, noisy, "and" gate with hierarchy (DINA-H) model and the deterministic, inputs, noisy, "or" gate with hierarchy (DINO-H) model. Both models incorporate the hierarchical structures of the cognitive skills in the model estimation process, and can be used for situations where the attributes are ordered hierarchically. The Trends in International Mathematics and Science Study (TIMSS) 2003 data are analyzed to illustrate the proposed approaches. The simulation study evaluates the effectiveness of the proposed approaches under various conditions (e.g., various numbers of attributes, test lengths, sample sizes, and hierarchical structures). The simulation study attempts to address the model fits, items fit, and accuracy of item parameter recovery when the skills are in a specified hierarchy and varying estimation models are applied. The simulation analysis examines and compares the impacts of the misspecification of a skill hierarchy on various estimation models under their varying assumptions of dependent or independent attributes. The study is unique in incorporating a skill hierarchy with the conventional DINA and DINO models. It also reduces the number of possible latent classes and decreases the sample size requirements. The study suggests that the DINA-H/ DINO-H models, instead of the conventional DINA/ DINO models, should be considered when skills are hierarchically ordered. Its results demonstrate the proposed approaches to analyzing the hierarchically structured CDMs, illustrate the usage in applying cognitive diagnosis models to a large-scale assessment, and provide researchers and test users with practical guidelines.

A recent trend in education has been toward formative assessments to enable teachers, parents, and administrators assist students succeed. Cognitive diagnostic modeling (CDM) has the potential to provide valuable information for stakeholders to assist students identify their skill deficiency in specific academic subjects. Cognitive diagnosis models are mainly viewed as a family of latent class confirmatory probabilistic models. These models allow the mapping of students' skill profiles/academic ability. Using a complex simulation studies, the methodological issues in one of the existing cognitive models, referred to as compensatory reparameterized unified model (CRUM) under the log-linear model family of CDM, was investigated. In order for practitioners to implement these models, their item parameter recovery and examinees' classifications need to be studied in detail. A series of complex simulated data were generated for investigation with the following designs: three attributes with seven items, three attributes with thirty five items, four attributes with fifteen items, and five attributes with thirty one items. Each dataset was generated with observations of: 50, 100, 500, 1,000, 5,000, and 10,000 examinees. The first manuscript is the report of the investigation of how accurately CRUM could recover item parameters and classify examinees under true QMattrix specification and various research designs. The results suggested that the test length with regards to number of attributes and sample size affects the item parameter recovery and examinees classification accuracy. The second manuscript is the report of the investigation of the sensitivity of relative fit indices in detecting misfit for over- and opposite-Q-Matrix misspecifications. The relative fit indices under investigation were Akaike information criterion (AIC), Bayesian information criterion (BIC), and sample size adjusted Bayesian information criterion (ssaBIC). The results suggested that the CRUM can be a robust model given the consideration to the observation number and item/attribute combinations. The findings of this dissertation fill some of the existing gaps in the methodological issues regarding cognitive models' applicability and generalizability. It helps practitioners design tests in CDM framework in order to attain reliable and valid results. / Ph. D.

Grounded in developmental theory, the Ship of Change provides a renewed look at diagnostic relationships between organizational elements, and their interactions through the lens of a metaphorical ship analogy. Elements are identified and arranged based on empirical studies from the field with causal considerations emphasized by Burke-Litwin. The model uses a two-tiered visual perspective to depict multi-dimensionality that links core organizational elements to work unit activities through the interplay of culture, communication and climate. The model is intended for both the conveyance of principles related to open systems theory, and the practical application of diagnosing organizations for planning and implementing change. The model was tested in a case study with a transportation company using multiple methods data collection including a communication satisfaction survey, workplace observations, and employee interviews. The model was used to categorize and interpret data and to inform recommendations for change.

Diagnostic classification models used in conjunction with diagnostic assessments are to classify individual respondents into masters and nonmasters at the level of attributes. Previous researchers (Madison & Bradshaw, 2015) recommended items on the assessment should measure all patterns of attribute combinations to ensure classification accuracy, but in practice, certain attributes may not be measured by themselves. Moreover, the model estimation requires large sample size, but in reality, there could be unanswered items in the data. Therefore, the current study sought to provide suggestions on selecting between two alternative Q-matrix designs when an attribute cannot be measured in isolation and when using maximum likelihood estimation in the presence of missing responses. The factorial ANOVA results of this simulation study indicate that adding items measuring some attributes instead of all attributes is more optimal and that other missing data treatments should be sought if the percent of missing responses is greater than 5%.

No description available.

Le diagnostic de l'asthme professionnel (AP) est toujours un défi. Le test de provocation bronchique spécifique (TPS), comme une méthode de diagnostic de référence, n’est pas aisément accessible. Cette étude diagnostique rétrospective vise à évaluer des outils diagnostiques actuels et à développer des scores cliniques pour AP (définis comme ayant le résultat positif en TPS). Les données concernant les travailleurs soupçonnés d'avoir de l’AP qui, d’une part, ont été exposés aux agents de haut-poids-moléculaire élevé (HPM) (n=139) et à bas-poids-moléculaire (BPM) (n=285), et d’autre part, ont travaillé encore un mois avant de l’évaluation de TPS. Par ailleurs, les modèles de régression logistique sont développés dans chaque groupe d'exposition. Ainsi, concernant des tests objectifs, les valeurs de différents tests distinctifs sont ajoutées aux caractéristiques cliniques, et enfin, le résultat a été évalué. Les modèles ont été testés pour l’exactitude, et pour la validation interne par la procédure bootstrapping. Suite à cela, les modèles finaux sont traduits en scores cliniques et le score total est stratifié en groupes à risque. Chez les travailleurs exposés à des agents BPM, si le test de la méthacholine est fait isolément, le modèle prédictif n'a pas montré de meilleures valeurs diagnostiques que le test de provocation. Cependant, dans le groupe HPM, le modèle final, y compris le sexe, l'âge> 40 ans, la durée des symptômes ≥1 an, la rhinoconjonctivite, l'utilisation de corticostéroïdes inhalés, le test de provocation à la méthacholine, et le test de la piqûre épidermique spécifique, avait un bon calibrage et une validation interne raisonnable. Par ailleurs, la catégorie de sujets avec une probabilité élevée d’avoir AP avait une meilleure spécificité et une meilleure valeur prédite positive par rapport à la combinaison de test de provocation à la méthacholine et de la piqûre épidermique spécifique dans la détection de l'AP, cependant n'avait pas de signification statistique. En conclusion, ce modèle quantifie la probabilité individuelle d'AP. Dans les centres où l'accès à TPS est difficile ou impossible, notre modèle serait utile dans le diagnostic d’OA, néanmoins, la validation externe du modèle reste nécessaire. Mots-clés : asthme professionnel, modèle diagnostique, prévention, score clinique. / The diagnosis of occupational asthma (OA) is challenging since the use of specific inhalation challenge (SIC) as the reference test is not widely accessible. This retrospective diagnostic study is aimed to evaluate current diagnostic tools and to develop clinical scores for OA (defined as positive SIC). Data from workers with suspected OA who were exposed to high-molecular-weight (HMW) (n=139) and low-molecular-weight (LMW) agents (n=285) and still working one month before the SIC were evaluated. Logistic regression models were developed in each exposure group. The added values of different objective tests to clinical and exposure characteristics were evaluated. The models were tested for accuracy, and, validated internally by the bootstrapping procedure. The final models were translated into clinical score and the sum scores were stratified into risk groups. In workers exposed to LMW agents, the predictive model did not perform better diagnostically than the methacholine challenge test alone. In the HMW group, the final model including sex, age >40 years, symptom duration ≥1 year, rhinoconjunctivitis, inhaled corticosteroid use, the methacholine challenge test, and specific SPT had a good accuracy and reasonable internal validation. The high probability category of the predictive model had a better specificity and positive predicted value compared to the combination of methacholine challenge test and specific SPT in detecting OA but did not reach the statistical significance. Our results suggest that this model could quantify an individual’s probability of OA. This model emphasizes the necessity of performing both tests in order to have a more accurate diagnosis in workers exposed to HMW agents. In centers where access to SIC is difficult or impossible, our model might be of benefit in diagnosing OA. Nevertheless, external validation of the model is necessary. Key words: occupational asthma, diagnostic model, prevention, clinical score.

Afrikaans text / Hierdie navorsing spruit uit die behoefte om doeltreffendheid van hulpverlening by kliente in die ouderdomsgroep elf- tot veertien jaar te verbeter. Die doel was om vas te stel of die projeksietegniek storievoltooiing by vroee adolessente nuttige responsies oplewer. Twee bestaande storievoltooiingsmedia, naamlik die Doss Fabels en die Madeleine Thomas Toets is toegepas saam met ander projeksiemedia en die responsies wat by storievoltooing gekry is, is geevalueer. Deur middel van 'n literatuurstudie is die eienskappe van die vroee adolessent nagegaan. Daar is spesiale aandag gegee aan die probleme wat kliente in hierdie ouderdomsgroep by hulpverlening vir die hulpvertener oplewer. Navorsing dui daarop dat die vroee adolessent 'n relatief hoe risiko loop om wordingsprobleme te ontwikkel. Vanwee die kenmerke van hierdie spesifteke ontwikkelingstadium, is erkende metodes van hulpverlening soos onderhoudvoering, nie altyd die aangewese of mees suksesvolle metode van hulpverlening nie. Tydens die empiriese ondersoek is gevind dat die proefpersone gunstig gereageer het op die storievoltooiingsmedia en nuttige responsies gelewer het. Die gevolgtrekking is gemaak dat storievoltooing as tegniek, moontlik 'n rol te speel het naas die meer bekende projeksiemedia soos die TAT en die OAP as hulpmiddel by diagnose van probleme by vroee adolessente. / This reseach evolved from the need to increase the efficiency of therapy with early adolescents. The objective was to establish whether story completion as projective technique elicits useful responses. Two existing story completion media, the Duss Fables and the Madeleine Thomas Test, were applied in addition to other projection media and the responses were evaluated. The characteristics of the early adolescent were studied as found in the literature. Research indicates that the early adolescent is at risk for various ontological and psychological problems. Because of the characteristics of clients in this specific developmental stage, accepted techniques in therapy, for example the interview, are not entirely successful when counseling early adolescents. It was found that testees responded positively to the story completion media and produced useful responses. The conclusion was that story completion may have a role to play as an instrument in diagnosing the problems of early adolescents. / Psychology of Education / M. Ed. (Voorligting)

Afrikaans text / Hierdie navorsing spruit uit die behoefte om doeltreffendheid van hulpverlening by kliente in die ouderdomsgroep elf- tot veertien jaar te verbeter. Die doel was om vas te stel of die projeksietegniek storievoltooiing by vroee adolessente nuttige responsies oplewer. Twee bestaande storievoltooiingsmedia, naamlik die Doss Fabels en die Madeleine Thomas Toets is toegepas saam met ander projeksiemedia en die responsies wat by storievoltooing gekry is, is geevalueer. Deur middel van 'n literatuurstudie is die eienskappe van die vroee adolessent nagegaan. Daar is spesiale aandag gegee aan die probleme wat kliente in hierdie ouderdomsgroep by hulpverlening vir die hulpvertener oplewer. Navorsing dui daarop dat die vroee adolessent 'n relatief hoe risiko loop om wordingsprobleme te ontwikkel. Vanwee die kenmerke van hierdie spesifteke ontwikkelingstadium, is erkende metodes van hulpverlening soos onderhoudvoering, nie altyd die aangewese of mees suksesvolle metode van hulpverlening nie. Tydens die empiriese ondersoek is gevind dat die proefpersone gunstig gereageer het op die storievoltooiingsmedia en nuttige responsies gelewer het. Die gevolgtrekking is gemaak dat storievoltooing as tegniek, moontlik 'n rol te speel het naas die meer bekende projeksiemedia soos die TAT en die OAP as hulpmiddel by diagnose van probleme by vroee adolessente. / This reseach evolved from the need to increase the efficiency of therapy with early adolescents. The objective was to establish whether story completion as projective technique elicits useful responses. Two existing story completion media, the Duss Fables and the Madeleine Thomas Test, were applied in addition to other projection media and the responses were evaluated. The characteristics of the early adolescent were studied as found in the literature. Research indicates that the early adolescent is at risk for various ontological and psychological problems. Because of the characteristics of clients in this specific developmental stage, accepted techniques in therapy, for example the interview, are not entirely successful when counseling early adolescents. It was found that testees responded positively to the story completion media and produced useful responses. The conclusion was that story completion may have a role to play as an instrument in diagnosing the problems of early adolescents. / Psychology of Education / M. Ed. (Voorligting)