This research attempts to confirm the reliability and construct validity of a personnel selection instrument called a Situational Judgment Test (SJT) through reliability analysis and factor analysis. The existing literature on SJTs is reviewed, including the advantages of using SJTs in personnel selection as well as the debate on whether SJTs measure a single construct or whether they can be multidimensional depending on the content. The specific SJT in this research was theoretically developed and received expert ratings to assess four general constructs: problem solving, planning, priority setting, and leadership. No support from alpha internal consistency reliability analysis was found for the assembly of these items into the four a priori subscales, thus assembly of these items into the theoretical subscales and scales was not supported.

Assessment centers, although useful for assessing behaviors and competencies associated with a targeted construct, can be low in economic utility. The current study sought to validate a situational judgment test (SJT) that was developed as an alternate form of assessment for a leadership development program. The first study examined the content validity of the SJT by performing retranslation on item stems and calibration of the item responses. The second study examined alternate forms reliability between the two forms of the leadership SJT that were developed. The third and final study evaluated the relationship between assessment center performance scores and SJT scores by demonstrating their convergent validities. Results from Study 1 demonstrated that the SALSA© test was a content valid measure of leadership ability. Results from Study 2 demonstrated that all available items from SALSA© could be used to make two forms of the test that demonstrate good alternate forms reliability. Finally, Study 3 suggests a moderate correlation between the assessment center and situational judgment test. Future research should focus on the underlying issues pertaining to significant group differences between English as primary language and English as second language students. Alternate developmental procedures, especially with alternate form assignment, should also be considered.

Organizational contexts use Situational judgment tests (SJTs) to assess and select individuals for competitive positions. As with other standardized assessments, threats to validity must be identified, examined, and communicated. As such, this research aims to identify the effects of socially desirable responding on the validity of an SJT used in a competitive selection process, and to identify if response latency provides insight into the identification of socially desirable responding. Participants in a competitive organizational selection process were administered an online assessment and the Balanced Inventory of Desirable Responding (BIDR). No significant correlations were identified between social desirability and the online assessment; however, this research provides evidence to suggest that participants who had shorter response latencies were less likely to participate in social desirability responding.

Aufgrund der demografischen Entwicklung in Deutschland ist mit einem wachsenden Anteil von Patienten mit Migrationshintergrund in der stationären Versorgung im Krankenhaus zu rechnen. Gerade in der Pflege ist die Interaktion mit Patienten von besonderer Bedeutung und insbesondere in der Interaktion von Menschen mit unterschiedlichem kulturellen Hintergrund kann es zu Problemen kommen. In solchen Situationen benötigen Pflegekräfte Interkulturelle Kompetenz, die bisher jedoch kaum in arbeitspsychologischen Studien erforscht wurde. Die Forschungsfragen lauten: Wann wird Interkulturelle Kompetenz in der Pflege erforderlich, was zeichnet sie aus und wie kann Interkulturelle Kompetenz in der Pflege messmethodisch erfasst werden? Als Methoden kommen hauptsächlich qualitative Methoden (Fokusgruppen, Leitfadeninterviews) und in geringerem Umfang quantitative Methoden (Fragebogen) zum Einsatz, die in einem Mixed-Method-Forschungsdesign verbunden werden. Es wurden sowohl Pflegekräfte als auch Patienten mit Migrationshintergrund und Experten für interkulturelle Pflege befragt. Bedeutende Erkenntnisse aus der qualitativen Studie sind, neben den typischen interkulturellen Überschneidungssituationen, die Fähigkeit zur interkulturellen Empathie, die Wichtigkeit der Berücksichtigung der religiösen Bedürfnisse der Patienten und die Beachtung von sprachlichen Barrieren. Die Ergebnisse werden in der Diskussion auf ihren jeweiligen Bezugsrahmen (Organisation, Patient, Ressourcen der Pflegekraft) und ihre Pflegespezifität hin analysiert. Hinsichtlich der methodischen Diskussion sind insbesondere die Problematik der Rekrutierung und die angemessene Befragung der Patienten mit Migrationshintergrund zu nennen. Aus einem Teil der qualitativen Ergebnisse wurde der Situative Fragebogen Interkulturelle Kompetenz Pflege (SFIKP) entwickelt. Die vorhandenen Fallgeschichten ergaben einen Schwerpunkt auf türkische und muslimische Patienten. Eine Pilotversion wurde an einer Stichprobe von Pflegekräften erprobt. Nach einer Evaluation der Testkonstruktion kann der SFIKP in seiner jetzigen Form nicht als eigenständiges Messinstrument zur Erfassung der Interkulturellen Kompetenz bei Pflegekräften empfohlen werden. Als Forschungsinstrument oder als Grundlage für Trainings könnte der SFIKP jedoch Verwendung finden. Die Zusammenführung aus qualitativen und quantitativen Ergebnissen hat einige neue Aspekte ergeben. So sollte in der interkulturellen Pflegesituation dem Prozess der Entscheidungs- und Lösungsfindung durch die Pflegekraft besondere Beachtung geschenkt werden. Außerdem wird diskutiert, unter welchen Bedingungen Interkulturelle Kompetenz aus dem Handlungserfolg abgeleitet werden kann, was direkte Auswirkungen auf die Messbarmachung dieses Konstrukts hat.

No description available.

The current study assessed the convergent validity of the Situational Assessment of Leadership – Student Assessment (SALSA©), a situational judgment test (SJT), with multi-source ratings. The SALSA© was administered to ROTC cadets via Blackboard; multi-source ratings, which paralleled the leadership dimensions of the SALSA©, were administered via paper. Each cadet completed the SALSA© and was rated by 10 peers, his/herself, and at least one cadre (superior). SALSA© scores were not correlated with any of the corresponding dimensions on multi-source ratings, with one exception. Cadre ratings of Consideration/Team Skills were positively correlated with SALSA© scores on the same dimension. This finding suggests that the multi-source ratings and the SALSA© are not measuring the same leadership construct. Self-ratings were significantly higher than peer or cadre ratings. Senior ROTC cadets scored significantly higher on SALSA© than did Junior ROTC cadets. Future research should focus on differences between autocratic styles of leadership and democratic styles of leadership and whether different SJTs are needed to measure each style.

The research reported here provides an introduction to a theoretical model of socio-affective competence. This conceptual model of social effectiveness consists of four competencies that are related to the development of effective interpersonal relationships in the workplace. These competencies include: establishing rapport, promoting acceptance of differences, developing trust and cultivating charismatic influence. The socio-affective competence model was formulated in an attempt to integrate research on social and emotional skills that have been linked to performance in organizations. The current research proposed the model and defined its competency areas, designed a socio-affective competence situational judgment test (SAC-SJT), identified the variables that were theoretically related and unrelated to the construct, and provided initial evidence in support of the criterion-related validity of the socio-affective competence framework. Results from two different studies established the foundation of the socio-affective competence nomological network and demonstrated the predictive validity of the SAC-SJT on job performance, relational behaviors, and organizational citizenship performance. The author discusses the benefits of developing interpersonal relationship skills and the relevance of these findings in organizational settings.

Given economic and societal shifts towards globalization, the need to develop effective global leaders is well documented. This thesis explored the development of a prototype instrument for use in global leadership classes or training to assess and/or develop the competencies and decision-making abilities associated with effective global leadership. The format of the instrument was a hybrid of situational judgment tests (SJTs) and culture assimilators and its content was drawn from a real life critical incident as recounted by an expert global leader during an interview using cognitive task analysis techniques. The interview was part of qualitative research that investigated expert cognition displayed by exceptional global leaders. The thesis included a literature review of global leadership research to identify the general competencies, intercultural competencies, and cognitive proficiency of effective global leaders that would serve as a foundation for the domains to be assessed and developed. SJTs and culture assimilators were discussed as format examples for constructing the instrument. The process of creating and refining the tool was then reviewed, which included developing the questions and answers, conducting pre-tests, gathering feedback from subject matter experts, and conducting a content analysis to ensure global leadership and intercultural competencies were addressed. Data collected during the course of development were presented and discussed. Step-by-step instructions (that included potential improvements to the process experimented with to date) were included to guide others in future development. An abridged sample of the instrument was provided.

Introduction : L’approche par compétences est maintenant bien ancrée dans l’enseignement au niveau de la formation médicale postdoctorale. Dans ce contexte, un système de sélection également axé sur les compétences pourrait être avantageux. L’objectif principal de ce projet était de concevoir un TJS ciblant le rôle CanMEDS de collaborateur pour la sélection au niveau postdoctoral en médecine interne (MI) et en médecine familiale (MF). Méthodologie : Des entrevues d’incidents critiques ont été réalisées auprès de résidents juniors en MI ou en MF afin de générer les items du TJS. Trois leaders de l’approche par compétences ont révisé le contenu du test. Les items ont été analysés pour identifier la compétence principale du rôle CanMEDS de collaborateur, le contexte ainsi que les membres de l’équipe interprofessionnelle représentés dans les vignettes. La clé de correction a été déterminée par un panel composé de 11 experts. Cinq méthodes de notation ont été comparées. Résultats : Sept entrevues ont été réalisées. Après révision, 33 items ont été conservés dans le TJS. Les compétences clés du rôle CanMEDS de collaborateur, les contextes et les divers membres de l’équipe interprofessionnelle étaient bien distribués au travers des items. La moyenne des scores des experts variait entre 43,4 et 75,6 % en fonction des différentes méthodes de notation. Le coefficient de corrélation de Pearson entre les cinq méthodes de notation variait entre 0,80 et 0,98. Conclusion : Ce projet démontre la possibilité de concevoir un TJS utilisant le cadre CanMEDS comme trame de fond pour l’élaboration de son contenu. Ce test, couplé à une approche globale de sélection basée sur les compétences, pourrait éventuellement améliorer le pouvoir prédictif du processus de sélection au niveau de la formation médicale postdoctorale. / Background: Competency-based training is well integrated into postgraduate medical education. A competency-based selection system would also be desirable. Primary objective: To develop a situational judgment test (SJT) targeting the CanMEDS Collaborator Role for the admission process in internal medicine (IM) and family medicine (FM) postgraduate training programs. Methods: Interviews using the critical incident technique were conducted with IM and FM residents in order to create items for the SJT. Three experts revised the content of the items. CanMEDS Collaborator Role key competencies, context and type of team members involved were analysed for each item. Answer key was determined by a panel of experts composed of 11 IM and FM physicians using a rate response format. Five absolute and partial credit scoring methods were compared. Results: Seven interviews were completed. After revision, 33 items were kept in the SJT. CanMEDS Collaborator Role key competencies, contexts and team members involved were well distributed over the items. Mean experts’ scores ranged from 43.4% to 75.6% with the different scoring methods. Pearson’s correlation coefficients between the five scoring methods ranged between 0.80-0.98. Conclusion: SJT targeting CanMEDS Framework Roles can help integrate competency-based selection into the postgraduate medical education admission process.

No description available.