Much research has been undertaken to determine how Subject Matter Expert characteristics affect job analysis outcomes. The current study seeks to discover if performance levels are related to current incumbents ratings of their positions. A group of 114 corporate associates, from two administrative positions, served as Subject Matter Experts (SME) for this study. Separate job analyses for each position were conducted using the Job Analysis Task Checklist. The results for each job were analyzed to determine if SME performance levels affected job analysis outcomes. The results for both jobs showed that there were very few differences in job analysis results as a function of SME performance levels.

There is growing interest in alignment between state's standards and test content partly due to accountability requirements of the No Child Left Behind (NCLB) Act of 2001. Among other problems, current alignment methods almost entirely rely on subjective judgment to assess curriculum-assessment alignment. In addition none of the current alignment models accounts for student actual performance on the assessment and there are no consistent criteria for assessing alignment across the various models. Due to these problems, alignment results employing different models cannot be compared. This study applied item mapping to student response data for the Massachusetts Adult Proficiency Test (MAPT) for Math and Reading to assess alignment. Item response theory (IRT) was used to locate items on a proficiency scale and then two criterion response probability (RP) values were applied to the items to map each item to a proficiency category. Item mapping results were compared to item writers' classification of the items. Chi-square tests, correlations, and logistic regression were used to assess the degree of agreement between the two sets of data. Seven teachers were convened for a one day meeting to review items that do not map to intended grade level to explain the misalignment. Results show that in general, there was higher agreement between SMEs classification and item mapping results at RP50 than RP67. Higher agreement was also observed for items assessing lower level cognitive abilities. Item difficulty, cognitive demand, clarity of the item, level of vocabulary of item compared to reading level of examinees and mathematical concept being assessed were some of the suggested reasons for misalignment.

During an audit, if an audit team does not have sufficient knowledge when auditing a complex issue they often call upon subject matter experts to provide advice. While these experts are the knowledge experts in their area, the quality of the advice depends upon their ability to fully understand and incorporate client specific facts. PCAOB inspection reports suggest that audit teams are neglecting to perform the required work to assess the quality of experts' recommendations. Additionally, the decision to use subject matter experts can be made during planning or when a complex issue surfaces during the audit. As such, auditors may or may not be a priori aware that an expert's use is planned before auditing a complex issue. In this dissertation, I examine how receiving advice of different levels of quality in terms of whether it incorporated all relevant client facts (lower or higher), and a priori awareness of the use of a subject matter expert (aware or unaware), can impact auditors' use of the advice and the resulting effort and judgment accuracy. I conducted a computerized experiment where professional auditors read a case study and made an initial judgment around a complex issue, received advice, and then made a final judgment. Based on advice-taking literature, I predict and find support that auditors who are a priori unaware of the use of a subject matter expert will employ lower effort in understanding the client facts and thus be less discerning and more accepting of the advice received. Being a priori unaware and receiving low quality advice can lead to lower judgment accuracy than receiving high quality advice with a priori unawareness. Auditors who are a priori aware are expected to, and found to employ greater effort, thus reducing the accuracy differences between receiving high and low quality advice. These findings can help improve the professions' understanding of auditors' advice taking behavior and the conditions under which expert advice is accepted without performing the required quality assessment. / Ph. D.

No description available.

Most Small and Medium scale Enterprises (SMEs) in Ghana are notparticularly anxious about the consequences of inadequacy or lack of anyform of vulnerability management operation in their normal businesspractices. This case study research explores how a local Internet ServiceProvider (ISP) in Ghana and its local client-base can manage vulnerabilitieswith a targeted patch management practise integrated into their operations.To answer the research question “How can a SME local Internet ServiceProvider (ISP) in Accra, Ghana, assist their local customer base to integrateeffective cybersecurity vulnerability management into their operations?“,This case study comprised the Subject Matter Expert of one local ISP as well as4 other technical Subject Matter Experts of the ISP’s clients about their patchmanagement operations. This case study research revealed that most SMEs donot consider vulnerability management as a key concern in the operation oftheir organisation and therefore, proposes a way to highlight the importanceof vulnerability management whiles doing so at a cost-effective manner. Theimplications of targeted cybersecurity patch management for the local ISP andtheir client-base is also addressed by this thesis research.

No description available.