The holistic listening comprehension of 112 Kyoto University students, operationalized as TOEFL iBT listening (long listening), was investigated with a battery of 12 tests, including a phoneme and word recognition test, a test of short 10-second listening, a test of long 3- to 5-minute listening, a reading comprehension of listening scripts test, listening and reading cloze tests, a gap-filling test designed to assess syntactic awareness, a grammatical error detection test, and the Vocabulary Size Test. Rasch analyses were employed to yield person ability measures; these measures were used for correlation studies, a series of linear regression analyses, principal components analysis, and structural equation modeling. Long listening correlated most strongly with the reading comprehension test (.756) and the listening cloze test (.705), and these two variables explained as much variance in long listening as all the variables combined in a linear regression (68%). Of the two prominent components yielded by a principal components analysis, capturing sounds and processing for meaning, long listening loaded significantly only on processing for meaning (.727) and showed no notable loading on capturing sounds. When long listening comprehension was viewed as a two-stage activity consisting of capturing input and processing that input for meaning, the participants were found to rely mainly on processing for meaning. As a result, long/holistic listening had more in common with reading comprehension than with short listening, for which the first stage of input capture was more important. As a part of this study, long listening was expressed as a product of aural word recognition and processing for meaning as in the Simple View of Reading, where reading comprehension is regarded as a product of decoding and linguistic comprehension. While the Simple View of Reading typically accounts for 48% of the variance in reading comprehension, its listening counterpart in this study explained up to 58% of the variance; as much as an improved version of the Simple View of Reading named the Component Model of Reading. The identification of the structural equation models required an additional component for a total of three latent variables; availability of written text, aural activities, and processing for meaning. The three-latent-variable model for long listening incorporated all the variables as indicators except for the grammatical error detection due to its insignificant contribution to holistic understanding. Generally speaking, structural equation approach produced models which were in good qualitative agreements with correlation studies, principal components analysis, and multiple regression; thus, providing an integrative view and a unified treatment of the participants' proficiency with a focus on long listening. Overall, the results highlighted the importance of processing for meaning, a skill largely shared with reading comprehension, for the long listening comprehension of Kyoto University students. This finding indicates a transfer of meaning formation skill from L1 and L2 reading to L2 listening. / CITE/Language Arts

The focus of this study is the development and implementation of the Iterative Needs Assessment/Evaluation Model for use as part of an English curriculum reform project at a four-year university in Japan. Three questions were addressed in this study: (a) what model components were necessary for use in a Japanese university setting; (b) what survey instruments would work with such a model; and (c) what needs would the stakeholders in the project report? The site for the study was a mid-sized private, four-year university in Japan. Set as an instrumental case study (Stake, 1998), multiple methods and sources were employed. Stakeholders in the project included university students (n = 1533), teaching staff (n = 33), university administrators and staff (n = 5), and domain experts (n = 7). Data collection included the use of questionnaires, unstructured and semi-structured interviews, and systems and materials analyses. Questionnaires were developed and analyzed using Rasch analysis. The Needs Assessment/Evaluation Model was assessed using a modified version of the Checklist for Judging the Adequacy of an Evaluation Design (Sanders & Nafziger, 1985). Implementation of a full iteration of the Model indicated that use of the Iterative Needs Assessment/Evaluation Model could guide the development and evaluation of the English language program. As part of the study, valid survey instruments that can continue to aid the assessment of needs for and evaluation of the courses were developed. Data from multiple sources indicated a difference in the perception of needs between stakeholders. The processes followed through the development and application of the Iterative Needs Assessment/Evaluation Model served to incorporate these different perceptions into a cohesive language program curriculum. / CITE/Language Arts

Willingness to communicate (WTC) in a second language (L2) is crucial to the development of communicative speaking skills. This study is a cross-sectional investigation of the role in models of second language (L2) willingness to communicate of three personality variables hitherto underresearched in the L2 field: extroversion, ego permeability (one's capacity to tolerate ambiguity), and perceived distance from one's core persona. A sample of 252 Japanese university students responded to a set of instruments used to measure individual difference variables and personality variables; the instruments were drawn from the fields of L2 acquisition and psychology as well as a 5-item instrument designed to measure perceived distance in a series of participatory L2 speaking activities. Confirmatory factor analysis, Rasch analysis, and structural equation modeling were utilized to validate the respective instruments. The International Posture instrument was best represented by a two-factor configuration consisting of Intergroup Approach-Avoidance Tendency and Intercultural Friendship Orientation, while the L2 Communicative Confidence was altered to consist of three factors (L2 Anxiety, Perceived L2 Communicative Competence, and Extroversion). The hypothesized additions of Ego Permeability and Perceived Distance failed to improve the measurement models, and the original Ego Permeability variable functioned poorly in this context. The MacIntyre and Charos (1996) model had marginal fit to the data even after undergoing considerable respecification. The models of Yashima (2002) and Yashima, Zenuk-Nishide, and Shimizu (2004) were found to have good fit as originally conceptualized, but the addition of Extroversion and paths from International Posture and L2 Communicative Anxiety improved the fit of both models. Collectively, the results indicate that extroversion plays an important role in models of L2 WTC and that the basic models of Yashima and colleagues are robust. These findings provide crucial insights into the process of L2 WTC, an important factor in the students' acquisition of communicative competence. / CITE/Language Arts

This study was an investigation into the effects of repetition on a listening comprehension test for second language learners. Repetition has been previously examined in a cursory way, usually as a secondary question to a primary treatment. Additionally, the method of repetition was limited to one way and to one treatment condition; therefore, it is not clear how different methods of repetition have influenced the results. To date, there are few studies on the influence of repetition on listening comprehension tests in English as a Foreign Language (EFL) situations. The purpose of this study was to examine four methods of repetition on listening comprehension with Japanese learners of English. In addition, the effect of repetition method on proficiency level, question type, and question difficulty was also examined. The participants were 2,041 students attending a private university in Tokyo, Japan. They experienced five conditions: non-repetition, immediate repetition, delayed repetition theory, delayed repetition A, and delayed repetition B. The participants listened to 12 passages under one of the five randomized conditions, and then answered five questions in one of three question types: true-false, multiple-choice, or short-answer. Additionally, the test included questions intended to measure two levels of comprehension, specific details and inference. Finally, the participants were divided into two listening proficiency levels based on the Global Test of English Communication. The results indicated that the type of repetition had an effect on listening comprehension. Overall, both proficiency groups in the delayed repetition conditions had higher comprehension scores. In addition, the delayed repetition conditions were better for all question types (true-false, multiple-choice, and short-answer) with each proficiency group responding equally well. Finally, the delayed repetition conditions reduced the range of question difficulty, especially when participants were allowed to preview questions. The theoretical implications of this study are that comprehension scores are affected by the strength of memory trace, focus of attention, and activated memory. The pedagogical implications are that delayed repetition is useful in the classroom because it not only improves comprehension scores on tests, but also reinforces material learned across several activities, and incorporates recycling into the curriculum design. The results will help test-makers consider new avenues to testing, teachers to incorporate delayed repetition into classroom activities, and administrators to incorporate delayed repetition into the curriculum. / CITE/Language Arts

This study is a cross-sectional investigation into the relationship among Japanese EFL learners’ vocabulary size, two aspects of depth of vocabulary knowledge, polysemy and collocational knowledge, and automaticity of word recognition specified as orthographic decoding speed and lexical meaning access speed, and the roles these aspects of lexical knowledge play in general academic reading comprehension as well as in each of five Reading Comprehension item types—Main Idea, Stated Details, Paraphrased Details, Guessing Vocabulary from Context, and Making Inferences. The participants (N = 166) were first- and second-year, non-English majors at a four-year, co-educational university in western Japan. The participants were gathered from seven intact classes, where they focused on developing reading skills for TOEIC. Data were obtained from six major instruments: the Reading Comprehension Test, the Vocabulary Size Measure, the Revised Word Associates Polysemy Test, the Revised Word Associates Collocation Test, the Lexical Decision Task, and the Antonym Semantic Decision Task. The first four tests were administered with pencil and paper over two months, and the latter two tests were administered during the summer vacation with individual participants using computer software that produced reaction time data. Before conducting the quantitative analyses, the paper and pencil based tests were analyzed using the Rasch dichotomous model to examine the validity and reliability of the instruments and to transform the raw scores into equal interval Rasch measures. Pearson correlation coefficients were calculated to investigate how these aspects of lexical knowledge were related, and hierarchical multiple regression analysis was conducted to determine to what extent these aspects of lexical knowledge contributed to the prediction of general reading comprehension as well as each of the five reading comprehension item types. In addition, using the percentage of correct answers, 12 anchor words across three lexical knowledge tests, the Vocabulary Size Measure, the Revised Word Associates Polysemy Test, and the Revised Word Associates Collocation, were analyzed to examine the possible presence of a hierarchical acquisitional pattern for the three aspects of lexical knowledge. The results showed strong correlations among the Vocabulary Size Measure, the Revised Word Associates Polysemy Test, and the Revised Word Associates Collocation Test, which suggested that vocabulary size and depth of vocabulary knowledge are closely related. This indicated that the more learners expand their written receptive vocabulary, the more likely they are to learn about various aspects of those words, such as their common collocation. On the contrary, none of the three lexical knowledge tests correlated significantly with the Lexical Decision Task and the Antonym Semantic Decision Task, which suggested that increases in vocabulary size and depth of lexical knowledge were not accompanied by the development of faster recognition of orthographic form or faster access to word meaning. Hence, this result implied that developing greater speed of lexical access lags behind increases in overall vocabulary size. Furthermore, the micro-analysis of 12 anchor words indicated that item dependency and considerable individual variation for each anchor word was present for the three aspects of lexical knowledge. The results also indicated that both vocabulary size and depth of lexical knowledge play significant roles in academic reading comprehension. Moreover, the two aspects of depth of vocabulary, polysemy and collocational knowledge, made unique contributions to the prediction of academic reading comprehension, which suggested that as learners’ vocabulary size approaches 3,000 words families, depth of lexical knowledge becomes increasingly important for academic reading comprehension. In a similar vein, the strong correlations among Guessing Vocabulary from Context item type, vocabulary size, and the two aspects of depth of vocabulary knowledge suggested that successful lexical guessing requires both a reasonably large vocabulary size and depth of lexical knowledge. That is, learners need to know the primary meaning of words, secondary meanings, and how the words relate to other words if they are to successfully guess the meaning of unknown words. The results also indicated that word recognition, specified as orthographic processing speed and lexical meaning access, did not uniquely contribute to the prediction of academic reading comprehension nor to the prediction of most of the five Reading Comprehension item types for the relatively low English proficiency participants in this study. Only orthographic processing speed predicted 5% of the variance in the Reading Comprehension Paraphrased Details item type; however, a plausible explanation for this finding is that it was caused by the difficulty of this item type. This finding is reasonable, as verbal efficiency theory (Perfetti, 1985) states that as lower-level processes are automatized, cognitive capacity is freed up. A possible explanation for the other insignificant results between the two reaction times tests and the other four Reading Comprehension item types is that the participants were under no pressure to complete the reading comprehension measure quickly, as it was an unspeeded test. Another plausible reason is that the participants’ L2 lexical proficiency was relatively low; therefore, they have not yet developed word recognition fluency. Finally, the results showed that the Reading Comprehension Main Idea item type and Paraphrased Details item type are more closely related to depth of vocabulary knowledge than to vocabulary size. / Teaching & Learning

The notion of learner autonomy is one of the major theoretical constructs studied in L2 learning. Drawing on Deci and Ryan's (1985) Self-Determination Theory (SDT), I sought to investigate and describe L2 learner autonomy and how an educational intervention influences it. The SDT conceptualizing human motivation for learning as existing on a continuum from extrinsic to intrinsic motivation provides ways of measuring learner autonomy and a rationale for educational interventions for developing it. First, Japanese adult EFL learners' characteristics were described in terms of learner autonomy-related psychological constructs (motivation, affect, and strategy use) according to levels of learner autonomy based on SDT. Second, the adapted VSS yielded significant effects on the participants' vocabulary learning and L2 learning anxiety (for the high and low autonomous motivation groups) and social strategy use (for the low autonomous motivation group). Third, the implementation of the adapted VSS into the adult L2 English classes was considered in terms of the development of linguistic and autonomous forms of learning quoting from the participants' quantitative and qualitative responses for this approach. / CITE/Language Arts

The purpose of this descriptive, ex post facto study was to examine possible relationships between demographic, pre-programmatic, and programmatic factors with success in a final Advanced Medical-Surgical nursing course and the National Council Licensure Examination for Registered Nurses, as well as their predictive abilities. Data were obtained from the academic records of 209 full-time and part-time nursing program graduates who completed an upper-division baccalaureate nursing degree at a mid-Atlantic private urban university. Descriptive and inferential analyses were utilized to discover possible relationships between the two dependent variables and the various independent variables in groupings suggested by Carroll's (1963) model of School Learning. Two models were derived to predict success in the nursing program as evidenced by successful completion of the final Advanced Medical-Surgical nursing course and passing the NCLEX-RN on the first attempt. The first model identified age at entrance to the nursing program and repeating a science course as the two factors that explained approximately 49% of the variance in the Advanced Medical-Surgical course performance. The second model was able to predict 97.2% correctly those graduates who would be successful on the NCLEX-RN, and only identify 43.8% of those candidates likely to fail. The overall classification ability by the model was 89%. Implications for nursing educators are that more attention needs to be given to admission policies/procedures, and that students entering nursing programs require routine standardized evaluation, identification and remediation of nursing content gaps in order to be successful throughout their nursing studies and ultimately on the NCLEX-RN. / Educational Psychology

This research involves three separate studies with the goal of investigating learner increases in the pragmatic awareness when exposed to various degrees of sustained, explicit instruction. Operationalized as a composite construct in the theory of communicative competence, pragmatic awareness includes knowledge of pragmalinguistic forms and sociopragmatic features, with sequential action events representing the former and relationship status categories the latter. Research questions for each study focus on gains learners revealed on a video-based pragmatic awareness assessment instrument delivered in pretest-posttest format. Data collection occurred from fall semester 2013 to spring semester 2015 in one single-sex junior/senior high school and two co-educational universities, one with a first-year focus group and the other with a second-year group, with participates across the contexts enrolled in 1 of 12 intact classes ranging in size from 23 to 33. At each site, data collection included response behaviors for comparison counterfactual groups. Data for the primary analyses of each study were subjected to a one-way ANCOVA. Results revealed a significant difference between the treatment group performances compared to a counterfactual group from each institution: Study 1, F(1,152) = 5.86, p = 0.02; Study 2, F(34, 115.28) = 5.71, p = 0.02; and Study 3, F(3, 77.30) = 8.04, p < 0.00. Relationship strength between the factor levels and the dependent variable, as measured in partial eta squared, accounted for 4%, 14%, and 16% of the variance, respectively. In Study 3 a Bayesian confirmatory analysis revealed that the least explicit treatment, one involving only a focus on pragmalinguistic input, showed the greatest gains. Implications for the three studies are: (a) pragmalinguistic and sociopragmatic categories reveal difficulty hierarchies, with particular sequential action events and relationship status categories consistently more challenging than others; (b) learners display differential awareness of pragmalinguistic and sociopragmatic sub-constructs, with the former registered as more difficult; and (c) explicit instruction on a limited number of pragmalinguistic categories might result in spillover learning effects to other, untaught categories. / Applied Linguistics

Background: The use of outcome measures to evaluate upper extremity function after stroke is highly recommended in clinical practice and research. The Chedoke Arm and Hand Activity Inventory (CAHAI) is a recommended measure as it has strong psychometric properties and clinical utility. However, the measure has not been validated in Asia and there are also gaps in the knowledge about the psychometric properties of the CAHAI. Aim & Objectives: This thesis is dedicated to the continued evaluation of the CAHAI with two main objectives: (1) to develop a Singapore version of the CAHAI, and (2) to re-evaluate the original CAHAI using modern test theories. Method: We conducted a study to cross-culturally adapt the CAHAI and evaluated the psychometric properties in a stroke sample in Singapore. Two studies were conducted to re-evaluate the original CAHAI using modern test theories. In the first study, item response theory and Rasch measurement theory were used to evaluate the psychometric properties of the measure. Following which, both measurement theories were used to revise the CAHAI in the second study. Results: Two test items were modified for the Singapore version of the CAHAI, and the measure had good inter-rater reliability (intra-class correlation coefficient = 0.95 – 0.97) and construct validity. The evaluation of the original CAHAI using modern test theories identified three main problems: (1) the scoring scale was not working as intended, (2) local dependency, and (3) the measure was not unidimensional. Revisions to the CAHAI included collapsing the 7-category scale to four categories, deleting two test items, and developing two new shortened versions. Conclusion: The Singapore version of the CAHAI is a valid and culturally relevant outcome measure that can be used to evaluate post-stroke upper extremity function. The original CAHAI was refined into a new 11- and 5-item versions with a 4-category scale which clinicians may find easier to use. / Thesis / Doctor of Philosophy (PhD)

Most research on confirmatory factor analysis using global fit indices (AIC, BIC, AICc, and CAIC) has been in the structural equation modeling framework. Little research has been done concerning application of these indices to item response models, especially within the framework of multidimensional Rasch analysis. The results of two simulations studies that investigated how sample size, between-dimension correlation, and test length affect the accuracy of these indices in model recovery using a multidimensional Rasch analysis are described in this dissertation. The first study analyzed dichotomous data, with model-to-data misfit as an additional independent variable. The second study analyzed polytomous data, with rating scale structure as an additional independent variable. The interaction effect between global fit index and between-dimension correlation had very large effect sizes in both studies. At higher values of between-dimension correlation, AIC indicated the correct two-dimension generating structure slightly more often than does the BIC or CAIC. The correlation by test length interaction had an odds ratio indicating practical importance in the polytomous study but not the dichotomous study. The combination of shorter tests and higher correlations resulted in a difficult-to-detect distinction being modeled with less statistical information. The correlation by index interaction in the dichotomous study had an odds ratio indicating practical importance. As expected, the results demonstrated that violations of the Rasch model assumptions are magnified at higher between-dimension correlations. Recommendations for practitioners working with highly correlated multidimensional data include creating moderate length (roughly 40 items) instruments, minimizing data-to-model misfit in the choice of model used for confirmatory factor analysis (MRCMLM or other MIRT models), and making decisions based on multiple global indices instead of depending on one index in particular. / Ph. D.