An efficient pool is critical for CAT administrations. Two approaches have been developed to design an optimal CAT pool: the linear programming method (LP; Veldkamp & van der Linden, 2000, 2010) and the bin-and-union method (BU; Reckase, 2003, 2010). This study manipulated different content balancing approaches and exposure conditions to investigate their impacts on the pool performances of the LP and BU methods under practical testing situations. The optimal pools were constructed in terms of the specification of an operational fixed-length CAT program and the IRT model employed. This study considered the one-parameter logistic (1PL) model to simulate adaptive test item responses using optimal and operational pools. Several psychometric properties were compared between the pools designed under the LP and BU methods. This research attempted to answer the following question: Under the consideration of content balancing and exposure control, what were the benefits and limitations of the LP and BU methods with respect to the optimal pool design? The results were evaluated in terms of pool characteristics, content constraint management, item exposure control, pool utilization, test reliability, and measurement precision. Similar pool characteristics were found between the LP and BU methods. With respect to the evaluation criteria, the LP and BU pools exhibited consistent performance. However, compared to the LP pools, the BU pools demonstrated slight superiority under the condition with strict content balancing and exposure control. Given two bin widths (.35 and .70), the pools with a bin-width of .35 exhibited better performance than those with a bin-width of .70 with respect to various evaluation criteria. Especially under the condition with the strict content balancing and exposure control, a bin-width of .35 might be a better option to generate an optimal pool than a bin-width of .70 in order to maintain a higher test on-target rate.

To enhance test security of high stakes tests, it is vital to understand the way various exposure control strategies function under various IRT models. To that end the present dissertation focused on the performance of several exposure control strategies under the generalized partial credit model with an item pool of 100 and 200 items. These procedures are relatively easy to implement and have shown promise as an alternative to more complex exposure control strategies. Through unique algorithms these procedures select an item for administration from a subset of items in the item pool. The five procedures examined for efficacy were the modified within .10 logits, restricted modified within .10 logits, randomesque, restricted randomesque, and progressive restricted procedures. The modified within .10 logits, restricted modified within .10 logits, and randomesque, and restricted randomesque procedures select an item for administration from a subset of optimal items. To test the effect of the number of items available for selection in this subset, 3, 6, and 9 items were made available for selection in these procedures. Maximum information item selection was used as a base line, no exposure control, condition. The progressive restricted, restricted randomesque, and restricted modified within .10 logits procedures were found to optimally protect test security while not significantly degrading measurement precision. The restricted forms of the randomesque and modified within .10 logits procedures proved superior to their base procedures, particularly in controlling average maximum exposure rate. The incrementation of item group size in the modified within .10 logits, restricted modified within .10 logits, and randomesque, and restricted randomesque procedures demonstrated that increasing the item group size provided better test security while not significantly degrading measurement precision. Additionally, in general, the increase of the item pool size from 100 to 200 improved measurement precision and test security. Implications towards practical application are discussed and directions for future research are suggested. / text

Previous psychological literature has shown mathematics anxiety in older populations to have an association with many factors, including an adverse effect on task performance. However, the origins of mathematics anxiety have, until recently, received limited attention. It is now accepted that this anxiety is rooted within the early educational years, but research has not explored the associated factors in the first formal years of schooling. Based on previous focus groups with children aged 4-7 years, ‘numeracy apprehension’ is suggested in this body of work, as the foundation phase of negative emotions and experiences, in which mathematics anxiety can develop. Building on this research, the first piece of research utilized 2 interviews and 5 focus groups to obtain insight from parents (n=7), teachers (n=9) and mathematics experts (n=2), to explore how children experience numeracy and their observations of children’s attitudes and responses. Thematic and content analysis uncovered a range of factors that characterised children’s numeracy experiences. These included: stigma and peer comparisons; the difficulty of numeracy and persistent failure; a low sense of ability; feelings of inadequacy; peer evaluation; transference of teacher anxieties; the right or wrong nature of numeracy; parental influences; dependence on peers; avoidance and children being aware of a hierarchy based on numeracy performance. Key themes reflected the focus group findings of children aged 4-7 years. This contributed to an item pool for study 2, to produce a first iteration of the Numeracy Apprehension Scale (NAS) that described day-to-day numeracy lesson situations. This 44-item measure was implemented with 307 children aged 4-7 years, across 4 schools in the U.K. Exploratory factor analysis led to a 26-item iteration of the NAS, with a 2-factor structure of Prospective Numeracy Task Apprehension and On-line Number Apprehension, which related to, for example, observation and evaluation anxiety, worry and teacher anxiety. The results suggested that mathematics anxiety may stem from the initial development of numeracy apprehension and is based on consistent negative experiences throughout an educational career. The 26-item iteration of the NAS was further validated in study 3 with 163 children aged 4-7 years, across 2 schools in the U.K. The construct validity of the scale was tested by comparing scale scores against numeracy performance on a numeracy task to determine whether a relationship between scale and numeracy task scores was evident. Exploratory factor analysis was again conducted and resulted in the current 19-item iteration of the NAS that related to a single factor of On-line Number Apprehension. This related to the experience of an entire numeracy lesson, from first walking in to completing a task and was associated with, for example, explaining an answer to the teacher, making mistakes and getting work wrong. A significant negative correlation was observed between the NAS and numeracy performance scores, suggesting that apprehensive children demonstrate a performance deficit early in education and that the NAS has the potential to be a reliable assessment of children’s numeracy apprehension. This empirical reinforces that the early years of education are the origins of mathematics anxiety, in the form of numeracy apprehension.

Universal screening is an emerging practice in the field of education to provide at-risk students with early intervention services. Currently there is not a universal screener specifically designed for the middle school population. Therefore, the purpose of this study was to obtain junior high and middle school teachers' perspectives on behaviors exhibited by students at risk for emotional and behavioral disorders in order to develop preliminary test items. Several themes were identified from the teachers' perspectives. Teacher perspectives noted that at-risk students displayed a variety of internalizing and externalizing behaviors. These issues included difficulty maintaining peer and teacher relationships, difficulty with hygiene and sleep, challenging home and school relationships, and noncompliant behaviors. From these themes, the researcher created an initial item pool of 24 items, which can be used for future development of a screening instrument.

Social comparison influences well-being, especially during psychological threat. Social comparison outcomes have been theorized to depend on motivation, frequency, contrast versus identification, with a better- versus worse-off other. To reduce this complexity in the theory, 94 senior-housing residents were interviewed and cluster analysis was conducted. Four clusters emerged. Half the interviewees formed a cluster using only adaptive social comparison methods. Adaptives were contrasted with a cluster of indiscriminate comparers, a cluster striving for improvement, and a cluster of participants disagreeing with most questions. Clusters differed especially in patterns of downward identification, upward and downward contrast. Self-evaluation and uncertainty-reduction also differed between clusters; self-enhancement and self-improvement motivations did not. Cluster membership had no direct effect on well-being, but moderation analysis demonstrated threat-buffering of high neuroticism in the adaptive cluster. The benefits were not due to self-esteem or educational level. By separating individuals rather than behaviors, cluster analysis provides a fresh perspective.

Social comparison influences well-being, especially during psychological threat. Social comparison outcomes have been theorized to depend on motivation, frequency, contrast versus identification, with a better- versus worse-off other. To reduce this complexity in the theory, 94 senior-housing residents were interviewed and cluster analysis was conducted. Four clusters emerged. Half the interviewees formed a cluster using only adaptive social comparison methods. Adaptives were contrasted with a cluster of indiscriminate comparers, a cluster striving for improvement, and a cluster of participants disagreeing with most questions. Clusters differed especially in patterns of downward identification, upward and downward contrast. Self-evaluation and uncertainty-reduction also differed between clusters; self-enhancement and self-improvement motivations did not. Cluster membership had no direct effect on well-being, but moderation analysis demonstrated threat-buffering of high neuroticism in the adaptive cluster. The benefits were not due to self-esteem or educational level. By separating individuals rather than behaviors, cluster analysis provides a fresh perspective.