Evaluation capacity development (ECD) has been acknowledged as a system of processes to help organizations achieve sustainable evaluation practice. Examining the existing evaluation capacity of an organization before starting an ECD process is necessary and will increase the possibilities of success, determined by the establishment or strengthening of an evaluation system into the organization. In response to this need, this study involved the designing of the Organizational Readiness for Evaluation Capacity Development (ORECD) checklist and its initial validation, using a mixed method research design. The study was conducted in four phases, including: (a) the design of the ORECD checklist based on a review of the literature; (b) a review of the ORECD checklist by five experts to obtain face and content validity evidences, with emphasis on relevance and clarity of the items and how well the items fit the corresponding component; (c) a pretesting about the appropriateness of the wording of the items and format of the ORECD checklist by a sample of doctoral graduate students with formal training in evaluation and professional evaluators; and (d) a field study with 32 nonprofit organizations to determine the utility and benefits of using the ORECD checklist and potential improvements to the instrument. This phase generated information about the psychometric properties as well as consequential validity evidence. Findings indicated that the ORECD checklist has great potential to determine the readiness of an organization to develop evaluation capacity, as demonstrated by the feedback received from various groups of participants, establishing face, content, and consequential validity. Results from the psychometric analysis showed correlations that, for the most part, suggested that the components are measuring aspects of the same construct. In addition, the alpha for most of the components supported the reliability of the ORECD checklist. The two components with alphas close to but below .70 required modifications in order to improve their reliability. Also, it was necessary to modify or reword some of the items. Ongoing efforts should provide information about how the changes made to the ORECD checklist are working and additional validity evidences as the one that can be obtained through factor analysis. This will allow the exploration of the underlying structure of the ORECD checklist and its components. It is expected that the ORECD checklist can be a contribution to the body of literature about ECD helping to address organizational readiness in order to support and sustain the development of evaluation capacity within organizations.

<p>The aim was to study personal and organizational conditions for first-line nurse managers and to identify and assess the skills and abilities important for leadership and management. Interviews were conducted with 5 first-line nurse managers, 5 registered nurses, 5 assistant nurses and one head of department delineating their perceptions of current and ideal roles of first-line nurse managers. Factor analysis was conducted to estimate validity and reliability of the Leadership and Management Inventory, developed in the context of this thesis, in one sample of 149 registered nurses and one sample of 197 health care personnel. Interviews and questionnaires to study expectations, experiences and outcomes of two different development programmes for 13 first-line nurse managers in a Training Programme, 14 in a Leadership Development Programme and 14 in a Comparison group were conducted. Letters and questionnaires from 32 former first-line nurse managers were analysed to describe their reasons for leaving their posts. First-line nurse managers, registered nurses and assistant nurses’ descriptions of the first-line nurse manager’s role were corresponding; the main focus was on service on the ward. The head of department described the first-line nurse manager’s responsibility towards the staff with focus on development and co-operation. Analysis of the Leadership and Management Inventory resulted in three factors: “interpersonal skills and group management”, “achievement orientation” and “overall organizational view and political savvy”. Validity and reliability were considered acceptable. Expectations concerning the development programmes were generally met; improvements corresponding to the content of the programmes were reported. Reasons to leave were personal, organizational and linked to the relationship with the head of department. Conclusion: The first-line nurse managers’ individual experiences, skills, abilities and ambitions are important, but so are the conditions in which she/he practices her/his leadership and management. It is important that the interplay between person and organization functions well.</p>

Aims: The overall aim of this thesis was to explore and describe radiographers‟ professional competence based on patients‟ and radiographers‟ experiences and to develop a context-specific instrument to assess the level and frequency of use of radiographers‟ professional competence. Methods: The design was inductive and deductive. Both qualitative and quantitative methods were used. The data collection methods comprised interviews (Studies I-II) and questionnaires (Studies III-IV). The subjects were patients in study I and radiographers in studies II-IV. In study I, 17 patients were interviewed about their experiences of the encounter during radiographic examinations and treatment. The interviews were analysed using qualitative content analysis. In study II, 14 radiographers were interviewed to identify radiographers‟ areas of competence. The critical incident technique was chosen to analyse the interviews. Studies III and IV were based on a national cross-sectional survey of 406 randomly selected radiographers. Study III consisted of two phases; designing the Radiographer Competence Scale (RCS) and evaluation of its psychometric properties. A 42-item questionnaire was developed and validated by a pilot test (n=16) resulting in the addition of 12 items. Thus the final RCS comprised a 54-item questionnaire, which after psychometric tests was reduced to 28 items. In study IV, the 28-item questionnaire served as data. The level of competencies was rated on a 10-point scale, while their use was rated on a six-point scale. Results: In study I, the female patients‟ comprehensive understanding was expressed as feelings of vulnerability. The encounters were described as empowering, empathetic, mechanical and neglectful, depending on the radiographers‟ skills and attitudes. Study II revealed two main areas of professional competence, direct patient-related and indirect patient-related. The first focused on competencies in the care provided in close proximity to the patient and the second on competencies used in the activities of the surrounding environment. Each of the two main areas was divided into four categories and 31 sub-categories that either facilitated or hindered good nursing care. In study III the analysis condensed the 54-item questionnaire in two steps, firstly by removing 12 items and secondly a further 14 items, resulting in the final 28-item RCS questionnaire. Several factor analyses were performed and a two factor-solution emerged, labelled; “Nurse initiated care” and “Technical and radiographic processes”. The psychometric tests had good construct validity and homogeneity. The result of study IV demonstrated that most competencies in the RCS received high ratings both in terms of level and frequency of use. Competencies e.g. „Adequately informing the patient‟, „Adapting the examination to the patient‟s prerequisites and needs‟ and „Producing accurate and correct images‟ were rated the highest while „Identifying and encountering the patient in a state of shock‟ and „Participating in quality improvement regarding patient safety and care‟ received the lowest ratings. The total score of each of the two dimensions had a low but significant correlation with age and years in present position. The competence level correlated with age and years in present position in both dimensions but not with the use of competencies in the “Nurse initiated care” dimension. Conclusion: This thesis has shown that professional competence is important in the encounter between patient and radiographer. It has also demonstrated that radiographers‟ self-rated professional competence is based on nursing, technological and radiographic knowledge. From a radiographer‟s perspective, „Nurse initiated care‟ and „Technical and Radiographic processes‟ are two core dimensions of Radiographer Competence Scale. The 28-item questionnaire regarding level and frequency of use of competence is feasible to use to measure radiographers‟ professional competence.

The aim was to study personal and organizational conditions for first-line nurse managers and to identify and assess the skills and abilities important for leadership and management. Interviews were conducted with 5 first-line nurse managers, 5 registered nurses, 5 assistant nurses and one head of department delineating their perceptions of current and ideal roles of first-line nurse managers. Factor analysis was conducted to estimate validity and reliability of the Leadership and Management Inventory, developed in the context of this thesis, in one sample of 149 registered nurses and one sample of 197 health care personnel. Interviews and questionnaires to study expectations, experiences and outcomes of two different development programmes for 13 first-line nurse managers in a Training Programme, 14 in a Leadership Development Programme and 14 in a Comparison group were conducted. Letters and questionnaires from 32 former first-line nurse managers were analysed to describe their reasons for leaving their posts. First-line nurse managers, registered nurses and assistant nurses’ descriptions of the first-line nurse manager’s role were corresponding; the main focus was on service on the ward. The head of department described the first-line nurse manager’s responsibility towards the staff with focus on development and co-operation. Analysis of the Leadership and Management Inventory resulted in three factors: “interpersonal skills and group management”, “achievement orientation” and “overall organizational view and political savvy”. Validity and reliability were considered acceptable. Expectations concerning the development programmes were generally met; improvements corresponding to the content of the programmes were reported. Reasons to leave were personal, organizational and linked to the relationship with the head of department. Conclusion: The first-line nurse managers’ individual experiences, skills, abilities and ambitions are important, but so are the conditions in which she/he practices her/his leadership and management. It is important that the interplay between person and organization functions well.

Aim: The overall aim of the present thesis was to examine, develop and evaluate patient participation in emergency department (ED) for promoting the relief of suffering for patients in care relations, from the perspective of patients and caregivers. Method: The explorative studies (I, II) were based on reflective lifeworld approach and analyzed by phenomenographic method. Data were collected from interviews by patients (9) and caregivers (11) about their conception of patient participation in ED. The methodological study (III) performed analyses and were tested for content, construct and criterion validity as well as homogeneity and stability reliability. The sample for study (III, IV) consisted of 356 patients consecutively cared for in EDs in Sweden. In the evaluating study (IV) the questionnaire Patient Participation Emergency Department (PPED) was used. The statistical methods handled were Student’s t-test, one-way ANOVA and Spearman correlation. Findings: The patients’ conception of patient participation means: being acknowledged; struggling to become involved; and having a clear space (I). The caregivers’ conceptions of patient participation can be divided into three different descriptive categories: Caregivers offer the opportunity for participation, Patients demand participation and Mutual participation (II). A 17- item questionnaire was developed. Two separate factor analyses revealed a distinct four- factor solution which was labelled: Fight for participation, Requirement for participation, Mutual participation and Participating in getting basic needs satisfied. Criterion validity presented showed 9 out of 20 correlations equal or above 0.30. Cronbach’s alpha coefficient ranged from 0.63 - 0.84 and test- retest varied between 0.59 and 0.93(III).The results show that patient participation is low in two dimensions (Fight for participation, Participation in getting basic needs satisfied), reasonable in one dimension (Mutual participation), and high in one dimension, Requirement for participation (IV). Conclusions: Participation does occur on occasion when the circumstances are right despite international and national guidelines that lay down the need for patient participation. Patient participation in EDs is perceived when patients are in contact with caregivers and there is space for collaboration in situations of consistency. However, patient participation cannot be offered in a one-sided caring action. In collaboration patient participation contributes to the relief of suffering in the process of health and patients participate when they are allowed to be the point of departure for caring. However, the results point to a lack of strategy for patient participation and for increased patient participation to take place improvements in external organization requirements are required. The results indicate an amplified clarity in how patient participation can be understood for EDs, in education and community and a scientific tested instrument has made it possible to evaluate patient participation.

This research addresses the lack of an existing psychometrically sound Aspergers Syndrome self-screening instrument for adults. Initial instrument development procedures were carried out by creating an item pool using existing Asperger measures. Items were rewritten following common item writing rules suggested by several researchers as reference. Five new domains were created and the items were re-categorized. Expert panel of nine judges specialized in Psychometrics, ASD, School Psychology, and Speech-Language Pathology were asked to rate the relevancy of items to their domains in order to obtain evidence of content validity. These experts were chosen because of their relatedness to Aspergers Syndrome and their expertise in instrument development. First, the quality of the judges ratings were examined to identify any aberrant judges. Ratings were then analyzed using the remaining six judges using three descriptive and three quantitative methods to examine the representativeness and relevancy of each item to their domain. A total of 55 items were identified as satisfactory by the judges. The second part of this study was to compare the content validity analytical methods. It was concluded that the percentage agreement, the content validity index (CVI), and the content validity coefficients (VIK) were the best methods to use in selecting the satisfactory items. This research aims to bring more attention to the importance of psychometric properties in measures for the Autism Spectrum Disorder field. It also hope to shed some light on which content validity analyses would best be used under certain circumstances. Limitations of study and future directions were also discussed.

Background: The Senate of Canada asserts that quality end-of-life care is the right of every Canadian. Yet, little is known about the quality of end-of-life care for dying children and their families. Purpose: The study purpose was to develop and test an instrument to measure parents’ perspectives on the quality of care provided to families before, at the time of, and following the death of a child. Methods: In study Phase I, key components of quality pediatric end-of-life care were synthesized through a systematic review of research literature then validated and extended through focus groups with bereaved parents. In Phase II, instrument items were developed to assess structures, processes, and outcomes important to quality end-of-life care, then tested for content and face validity by health professionals and bereaved parents. In Phase III, the instrument was administered to bereaved mothers from across Canada and psychometric testing conducted. Results: Instrument items were developed based on review of 67 manuscripts and 3 focus groups with 10 parents. The Content Validity Index for the instrument was 0.84 as assessed by 7 health professionals. The instrument was assessed by 6 bereaved parents for face and content validity as well as their cognitive understanding of the items. In the final phase, 128 mothers completed the instrument and 31 of those completed it twice. Initial evidence for test-retest reliability, internal consistency, and construct validity was demonstrated for 7 subscales: Connect with Families, Involve Parents, Share Information with Parents, Share Information among Health Professionals, Support Parents, Provide Care at Death, and Provide Bereavement Follow-up. Additional items with demonstrated content validity only were grouped into three domains: Support the Child, Support Siblings, and Structures of Care. Implications: This study is a significant step forward in comprehensive measurement of the quality of children’s end-of-life care. The instrument provides a mechanism for feedback to health professionals, health systems, and policy makers to improve care provided to families facing the death of a child.

Background: The Senate of Canada asserts that quality end-of-life care is the right of every Canadian. Yet, little is known about the quality of end-of-life care for dying children and their families. Purpose: The study purpose was to develop and test an instrument to measure parents’ perspectives on the quality of care provided to families before, at the time of, and following the death of a child. Methods: In study Phase I, key components of quality pediatric end-of-life care were synthesized through a systematic review of research literature then validated and extended through focus groups with bereaved parents. In Phase II, instrument items were developed to assess structures, processes, and outcomes important to quality end-of-life care, then tested for content and face validity by health professionals and bereaved parents. In Phase III, the instrument was administered to bereaved mothers from across Canada and psychometric testing conducted. Results: Instrument items were developed based on review of 67 manuscripts and 3 focus groups with 10 parents. The Content Validity Index for the instrument was 0.84 as assessed by 7 health professionals. The instrument was assessed by 6 bereaved parents for face and content validity as well as their cognitive understanding of the items. In the final phase, 128 mothers completed the instrument and 31 of those completed it twice. Initial evidence for test-retest reliability, internal consistency, and construct validity was demonstrated for 7 subscales: Connect with Families, Involve Parents, Share Information with Parents, Share Information among Health Professionals, Support Parents, Provide Care at Death, and Provide Bereavement Follow-up. Additional items with demonstrated content validity only were grouped into three domains: Support the Child, Support Siblings, and Structures of Care. Implications: This study is a significant step forward in comprehensive measurement of the quality of children’s end-of-life care. The instrument provides a mechanism for feedback to health professionals, health systems, and policy makers to improve care provided to families facing the death of a child.

This research addresses the lack of an existing psychometrically sound Aspergers Syndrome self-screening instrument for adults. Initial instrument development procedures were carried out by creating an item pool using existing Asperger measures. Items were rewritten following common item writing rules suggested by several researchers as reference. Five new domains were created and the items were re-categorized. Expert panel of nine judges specialized in Psychometrics, ASD, School Psychology, and Speech-Language Pathology were asked to rate the relevancy of items to their domains in order to obtain evidence of content validity. These experts were chosen because of their relatedness to Aspergers Syndrome and their expertise in instrument development. First, the quality of the judges ratings were examined to identify any aberrant judges. Ratings were then analyzed using the remaining six judges using three descriptive and three quantitative methods to examine the representativeness and relevancy of each item to their domain. A total of 55 items were identified as satisfactory by the judges. The second part of this study was to compare the content validity analytical methods. It was concluded that the percentage agreement, the content validity index (CVI), and the content validity coefficients (VIK) were the best methods to use in selecting the satisfactory items. This research aims to bring more attention to the importance of psychometric properties in measures for the Autism Spectrum Disorder field. It also hope to shed some light on which content validity analyses would best be used under certain circumstances. Limitations of study and future directions were also discussed.

Syftet med denna studie var att reliabilitetstesta Alberta Context Tool (ACT) i svensk hälso- och sjukvård och beskriva ortopedsjuksköterskors skattning av kontextuella faktorer såsom ledarskap, arbetskultur, återkoppling, utvecklingsmöjligheter och forskningsanvändning, som kan påverka möjligheten att omsätta forskningsresultat i vårdarbetet. Urvalet bestod av 119 sjuksköterskor som arbetade på ortopediska vårdavdelningar på sex olika sjukhus i mellersta Sverige. ACT är ett frågeformulär framtaget utifrån de senaste årens forskning om vilka faktorer i kontexten som har betydelse för sjuksköterskors forskningsanvändning. Reliabilitetstest gjordes enligt analys med Chronbach`s Alpa och innehållsvaliditet. Resultatet visade att ACT var relevant att användas för sjuksköterskor som arbetar på ortopedisk vårdavdelning i Sverige. Reliabilitetstesten med Chronbach´s Alpa gav värden nära 0,7 för de åtta frågeområden som behandlar kontexten.Sjuksköterskorna rapporterade att det fanns brister i många av de delar av kontexten som enligt forskning visat sig ha betydelse för möjligheten att implementera evidensbaserad vård. Sjuksköterskorna trivdes med sitt arbete och kände att deras kunskaper värderades högt i vårdteamet. Resultatet visade dock att det inte fanns tillräckligt stöd från ledningen för att utveckla vården. De rapporterade att de nästan inte alls fick återkoppling i vårdarbetet. Det saknades stödfunktioner och strategier för att implementering av forskningsresultat skulle vara möjligt att implementera i vårdarbetet. Majoriteten av sjuksköterskorna såg positivt på forskningsanvändning.