Spelling suggestions: "subject:"validity off assessment"" "subject:"validity oof assessment""
1 |
Translation, validation and comparison of three behavioural pain assessment tools for patients who cannot communicate verballyHsiung, Nai-Huan January 2016 (has links)
Aim The thesis set out to examine validations of three observational pain assessment tools and establish nurses’ expectations of them and the factors that might influence them within intensive care unit (ICU) settings. Background The guidelines to pain assessment specific to ICU patients have been of great interest to health professionals over the last 20 years. Pain assessment remains a challenge for most ICU patients due to the difficulty of assessing pain with any precision. Evidence suggests that the Behavioural Pain Scale (BPS) and Critical- Care Pain Observation Tool (CPOT) have demonstrated sound psychometric properties. A review of the relevant literature highlighted the fact that no such studies have yet been conducted with a similar homogenous group in Asia. The Wong-Baker Face Pain Rating Scale (FPRS) is currently widely used for nonverbally communicating patients (NVCPs) with pain in ICU settings, and is even recommended for use with children. Valid assessment tools are required for effective pain assessment in ICU settings, particularly in patients who are experiencing communication difficulties. Design An embedded mixed methods design was employed to: 1) translate Chinese versions of BPS and CPOT, 2) test their validity and reliability of in comparison with FPRS, and 3) establish the nurses’ expectations about the three study scales when undertaking pain assessment by using semi-structured focus group interviews. Methods This thesis initially reviews the literature available to select the most appropriate scales for assessing pain in critically-ill NVCPs. The selected scales were then translated into a Traditional-Chinese version using established procedures for the Taiwanese context. Evaluations of the three pain scales were gathered using quantitative measures of pain scores in NVCPs experiencing painless/painful interventions. These were further compared with a few focus groups to establish the feasibility and utility of the three pain scales. The psychometric properties of the pain scales were assessed for reliability by using internal consistency and inter-rater agreement) and for validity by using content validity, concurrent validity, discriminant validity, and responsiveness. The validity was evaluated using ANOVA to compare the changes between the different procedures. The significance level was set at 0.05. As for the analysis of the qualitative data, this study typically follows the path of aggregating the words into themes of information and presenting the diversity of ideas gathered during the data collection. Results For the 2068 observations in 237 patients, there were no statistical differences between the characteristics of the BPS, CPOT, and FPRS groups. Validity was demonstrated by changes from baseline in the scores of the three groups, which were significantly higher during suction (p < 0.001). In regard to the result for the criterion validity, both BPS and CPOT had moderate positive correlations with FPRS. The internal consistency was excellent; the Cronbach’s α was 0.700 for BPS and 0.821 for CPOT when all items were included. The majority of nurses preferred to use BPS to assess pain in their clinical practice. When the nurses were asked how long they needed and how easy they found it to complete the assessments using these tools, they all agreed that each patient assessments were easier and took the least time when they used FRPS. However, the nurses considered that the most effective pain reaction during nociceptive procedures had been assessed by using BPS. Even though all of the participant nurses stated that CPOT provides a detailed item-description about pain behaviour, it also provided the biggest obstacle to use because of its ambiguous indicators. Conclusions BPS, CPOT and FRPS provide potentially useful measurement scales for assessing pain in ICU NVCPs. However, judging from the inconsistencies between the nurses’ replies, the results could reflect a conflict between the need to use a validated measure of pain for NVCPs on the one hand and managing a heavy workload in the ICU on the other. This study opens up an avenue for investigating further the link between the underlying conceptions of pain behaviour and the effectiveness of pain assessments in NVCPs when using an objective pain measurement.
|
2 |
Enhancing the quality of performance assessment in agriculture in Botswana schoolsMasole, Trust Mbako 10 October 2011 (has links)
The quality of education in Botswana is not yet up to standard as there has been emphasis on attainment of Universal Basic Education. Quality in education encompasses a number of factors such as the development of the relevant curriculum, improvement of teacher preparation, development of appropriate learning materials, and improving the methods of assessing pupils (Grisay&Mählck, 1991, cited in Kellaghan&Geaney, 2003). The quality of what is going on in the classroom is judged by the processes and outcomes that are defined qualitatively. Assessment in Agriculture in Botswana senior schools comprises performance assessment and standardised paper-and-pencil tests. Performance assessment contributes only 20% (MoE&SD, 2001.p.6) yet it is allocated more time than paper-and-pencil tests. The aim of the study therefore was to understand and explore the characteristics and quality processes needed in the performance assessment of Agriculture Form Four students to ensure valid and reliable examinations in Botswana. The study was guided by two research questions. The first research question was: How valid and reliable are the performance assessment processes in Botswana schools? This research question sought to understand how performance assessment was conducted in Botswana schools, and how it compared with the international practice. The second research question was: How can quality assurance processes be developed in order to produce valid and reliable marks for BGCSE Agriculture performance assessment? The intention was to develop quality processes for performance assessment in the context of Form Four Agriculture in Botswana, to ensure valid and reliable marks for certification. A design research was employed in this study in which a baseline survey was conducted and based on the outcome, a quality assurance process was designed which included the development of standard tasks and assessment materials. During the baseline survey, teachers and school administrators completed a questionnaire and were also interviewed. Subsequently, prototypes of exemplar materials were developed iteratively in collaboration with practitioners and formatively evaluated. Feedback from evaluation was incorporated into the redesign and development of successive prototypes. Findings from baseline survey revealed that the conduct of performance assessment in schools was not standardised, primarily due to the absence of assessment policy and procedures to guide its conduct. Implementation of performance assessment was done by teachers who had insufficient training, in large classes with inadequate resources and received very little support from supervisors both internally and externally. Despite all these, insufficient time was allocated for conducting performance assessment, resulting in teachers forming groups most of the time during the conduct of tasks and assigning a single mark for the group based on the quality of the group’s product. However, findings from the intervention study revealed that entrenching quality assurance processes in the system produced valid and reliable performance assessment marks for certification. The characteristics of a quality assurance system for implementation of performance assessment were the presence of an assessment policy; training and accrediting teachers to assess; an efficient internal and external monitoring system; the provision of adequate resources; applying multiple modes of assessment; and multiple rating of the students. / Thesis (PhD)--University of Pretoria, 2011. / Science, Mathematics and Technology Education / unrestricted
|
3 |
Fatigue in chronically critically ill patients following intensive care - reliability and validity of the multidimensional fatigue inventory (MFI-20)Wintermann, Gloria-Beatrice, Rosendahl, Jenny, Weidner, Kerstin, Strauß, Bernhard, Hinz, Andreas, Petrowski, Katja 12 June 2018 (has links)
Background
Fatigue often occurs as long-term complication in chronically critically ill (CCI) patients after prolonged intensive care treatment. The Multidimensional Fatigue Inventory (MFI-20) has been established as valid instrument to measure fatigue in a wide range of medical illnesses. Regarding the measurement of fatigue in CCI patients, the psychometric properties of the MFI-20 have not been investigated so far. Thus, the present study examines reliability and validity of the MFI-20 in CCI patients.
Methods
A convenience sample of n = 195 patients with Critical Illness Polyneuropathy (CIP) or Myopathy (CIM) were recruited via personal contact within four weeks (t1) following the transfer from acute care ICU to post-acute ICU at a large rehabilitation hospital. N = 113 (median age 61.1 yrs., 72.6% men) patients were again contacted via telephone three (t2) and six (t3) months following the transfer to post-acute ICU. The MFI-20, the Euro-Quality of Life (EQ-5D-3 L) and the Structured Clinical Interview for the Diagnostic and Statistical Manual of mental disorders DSM-IV (SCID-I) were applied within this prospective cohort study.
Results
The internal consistency Cronbach’s α was adequate for the MFI-total and all but the subscale Reduced Motivation (RM) (range: .50–.91). Item-to-total correlations (range: .22–.80) indicated item redundancy for the subscale RM. Confirmatory Factor analyses (CFAs) revealed poor model fit for the original 5-factor model of the MFI-20 (t2/t3, Confirmatory Fit Index, CFI = .783/ .834; Tucker-Lewis Index, TLI = .751/ .809; Root Mean Square Error of Approximation, RMSEA = .112/ .103). Among the alternative models (1-, 2-, 3-factor models), the data best fit to a 3-factor solution summarizing the highly correlated factors General −/ Physical Fatigue/ Reduced Activity (GF/ PF/ RA) (t2/ t3, CFI = .878/ .896, TLI = .846/ .869, RMSEA = .089/ .085, 90% Confidence Interval .073–.104/ .066–.104). The MFI-total score significantly correlated with the health-related quality of life (range: −.65-(−).66) and the diagnosis of major depression (range: .27–.37).
Conclusions
In the present sample of CCI patients, a reliable and valid factor structure of the MFI-20 could not be ascertained. Especially the subscale RM should be revised. Since the factors GF, PF and RA cannot be separated from each other and the unclear factorial structure in the present sample of CCI patients, the MFI-20 is not recommended for use in this context.
|
Page generated in 0.0987 seconds