31 |
Applications of the Flexilevel test to assessment in higher educationPyper, Andrew Richard January 2016 (has links)
The work reported in this dissertation investigates the potential for embedding Computerised Adaptive Testing (CAT) in students' and tutors' educational experiences. It seems that the tailored assessments that CAT can provide would be of real educational value in a range of contemporary Higher Education settings, however the resource requirements of some forms of CAT are prohibitive for making CAT assessments available to students across their studies. A form of CAT that is less resource intensive than other forms, the Flexilevel test, was selected for this programme of research to investigate its effectiveness in real educational contexts and explore possible applications for the approach. Ten empirical studies and a real data simulation study were conducted to test the effectiveness of the approach. It was found to show statistically significant correlations with other forms of assessment - in particular conventional Computer Based Testing (CBT) assessments, which is commonly used in contemporary educational settings. Another strand of work concerned the attitudes of stakeholders to the approach. Part of this work was carried out through the empirical studies, and further studies including interviews were also undertaken to explore the views of academic staff and students to the use of the Flexilevel test. Both groups were positive about the use of the Flexilevel test and this was taken to support the idea that academic staff and students would accept the use of the Flexilevel test in their educational experiences. In terms of both effectiveness and the acceptability of the approach to academic staff and students, the Flexilevel test was found to be a good candidate for embedding CAT in real educational contexts in Higher Education.
|
32 |
Assessing the factor structure of the South African Personality Inventory by employing a dichotomous and a polytomous response scalePrinsloo, Dalinda January 2013 (has links)
In a multicultural society such as South Africa, there is a need for valid and reliable instruments measuring personality. Most personality instruments currently used in South Africa are imported from abroad and therefore have limited utility in the South African context as they have been developed for a specific group. The introduction of technology has resulted in personality measuring instruments increasingly being administered by means of computer-based assessments. The dramatic increase in computer-based assessments has sparked debate regarding the use of various response scale categories in personality assessment.
The present study, which forms part of the broader South African Personality Inventory (SAPI) project, focused on the preliminary qualitative personality structure produced by the SAPI project, which is categorised into nine clusters. The current study aimed to determine whether a dichotomous or a polytomous response scale administered by means of computer-based assessments would be more suitable for measuring the preliminary personality structure of the SAPI. The participants were first- and second-year undergraduate students enrolled at a tertiary institution (N = 490). The inventory consisted of 262 closed-ended personality statements and was administered in both the dichotomous (“agree” and “disagree”) and polytomous (“strongly agree”, “agree”, “somewhat agree/disagree”, “strongly disagree” and “disagree”) response scale form.
The results, which were based on an exploratory factor analysis, revealed that 37.2% of the items in the dichotomous response scale were problematic, whereas only 3.6% of the items in the polytomous response scale were problematic. By comparing the factor structures of the dichotomous and polytomous response scales, the polytomous response scale was determined to be more suitable for measuring the preliminary personality structure of the SAPI.
The conclusion was based on two specific criteria. Firstly, the factor structure across the polytomous response scale loaded similarly to the qualitative personality structure that was conceptualised in the first phase of the SAPI project. Secondly, Cronbach alpha coefficients, ranging from 0.60 to 0.87 across the nine factors, with the exception of the Integrity and Openness clusters with values of 0.45 and 0.53 respectively, for the polytomous response scale were higher than those yielded by the dichotomous response scale. / Mini Dissertation (MCom (Industrial Psychology))--University of Pretoria, 2013. / Human Resource Management / MCom (Industrial Psychology) / unrestricted
|
33 |
The construction and evaluation of a dynamic computerised adaptive test for the measurement of learning potentialDe Beer, Marie 03 1900 (has links)
Recent political and social changes in South Africa have created the need for culture-fair tests for cross-cultural measurement of cognitive ability. This need has been highlighted by the professional, legal and research communities. For cognitive assessment, dynamic assessment is more equitable because it involves a test-train-retest procedure, which shows what performance levels individuals are able to attain when relevant training is provided. Following Binet’s thinking, dynamic assessment aims to identify those individuals who are likely to benefit from additional training. The theoretical basis for learning potential assessment is Vygotsky’s concept of the zone of proximal development.
This thesis describes the development, standardisation and evaluation of the Learning Potential Computerised Adaptive Test (LPCAT), for measuring learning potential in the culturally diverse South African population by means of nonverbal figural items. In accordance with Vygotsky’s view, learning potential is defined as a combination of present performance and the extent to which performance is increased after relevant training. This definition allows for comparison of individuals at different levels of initial performance and with different measures of improvement. Computerised adaptive testing based on item response theory, as used in the LPCAT, is uniquely suitable for increasing both measurement accuracy and testing efficiency of dynamic testing, two aspects that have been identified as problematic. The LPCAT pretest and the post-test are two separate adaptive tests, hence eliminating the role of memory in post-test performance. Several multicultural groups were used for item analysis and test validation. The results support the LPCAT as a culture-fair measure of learning potential in the nonverbal general reasoning domain. For examinees with a wide range of ability levels, LPCAT scores correlate strongly with academic performance. For African examinees, poor proficiency in English (the language of teaching) hampers academic performance. The LPCAT ensures the equitable measurement of learning potential, independent of language proficiency and prior scholastic learning and can be used to help select candidates for further training or developmental opportunities. / Psychology / D. Litt. et Phil. (Psychology)
|
34 |
The relationship between learning potential, English language proficiency and work-related training test resultsSchoeman, Adele 11 1900 (has links)
Continuous change and competition in the working environment necessitate increased
efficiency and productivity which require different and enhanced skills and abilities. It is
therefore important that the right people with the right skills are selected and employees are
developed to enable them to meet the organisational and national demands of the future.
This dissertation investigates the relationship between learning potential, English
language proficiency and work-related training test results to establish why some production
employees perform better on work-related training test results than others.
The results indicate that there is no significant relationship between the work-related training
test results and either learning potential or English language proficiency. There is, however, a
significant correlation between learning potential and English language proficiency. It might be
worthwhile exploring the availability and adequacy of assessors
as well as the motivational level of the production employees as factors that influence the
progress made with work-related training test results. / Industrial and Organisational Psychology / MCOM (Industrial Psychology)
|
35 |
The relationship between learning potential, English language proficiency and work-related training test resultsSchoeman, Adele 11 1900 (has links)
Continuous change and competition in the working environment necessitate increased
efficiency and productivity which require different and enhanced skills and abilities. It is
therefore important that the right people with the right skills are selected and employees are
developed to enable them to meet the organisational and national demands of the future.
This dissertation investigates the relationship between learning potential, English
language proficiency and work-related training test results to establish why some production
employees perform better on work-related training test results than others.
The results indicate that there is no significant relationship between the work-related training
test results and either learning potential or English language proficiency. There is, however, a
significant correlation between learning potential and English language proficiency. It might be
worthwhile exploring the availability and adequacy of assessors
as well as the motivational level of the production employees as factors that influence the
progress made with work-related training test results. / Industrial and Organisational Psychology / MCOM (Industrial Psychology)
|
36 |
The construction and evaluation of a dynamic computerised adaptive test for the measurement of learning potentialDe Beer, Marie 03 1900 (has links)
Recent political and social changes in South Africa have created the need for culture-fair tests for cross-cultural measurement of cognitive ability. This need has been highlighted by the professional, legal and research communities. For cognitive assessment, dynamic assessment is more equitable because it involves a test-train-retest procedure, which shows what performance levels individuals are able to attain when relevant training is provided. Following Binet’s thinking, dynamic assessment aims to identify those individuals who are likely to benefit from additional training. The theoretical basis for learning potential assessment is Vygotsky’s concept of the zone of proximal development.
This thesis describes the development, standardisation and evaluation of the Learning Potential Computerised Adaptive Test (LPCAT), for measuring learning potential in the culturally diverse South African population by means of nonverbal figural items. In accordance with Vygotsky’s view, learning potential is defined as a combination of present performance and the extent to which performance is increased after relevant training. This definition allows for comparison of individuals at different levels of initial performance and with different measures of improvement. Computerised adaptive testing based on item response theory, as used in the LPCAT, is uniquely suitable for increasing both measurement accuracy and testing efficiency of dynamic testing, two aspects that have been identified as problematic. The LPCAT pretest and the post-test are two separate adaptive tests, hence eliminating the role of memory in post-test performance. Several multicultural groups were used for item analysis and test validation. The results support the LPCAT as a culture-fair measure of learning potential in the nonverbal general reasoning domain. For examinees with a wide range of ability levels, LPCAT scores correlate strongly with academic performance. For African examinees, poor proficiency in English (the language of teaching) hampers academic performance. The LPCAT ensures the equitable measurement of learning potential, independent of language proficiency and prior scholastic learning and can be used to help select candidates for further training or developmental opportunities. / Psychology / D. Litt. et Phil. (Psychology)
|
37 |
Užsakymų priėmimo kompiuterizuota darbo vieta pieno perdirbimo įmonėje / The computerized point of order processing at the dairying plantPankauskienė, Dalia 16 August 2007 (has links)
Darbe išanalizuota IS kūrimo principai ir problemos, pieno perdirbimo įmonės veikla. Pasirinktos užsakymų priėmimo sistemos projektavimo ir projekto realizavimo priemonės. Atliktas užsakymų priėmimo IS projektavimas. Sukurta duomenų bazė, kurios pagalba suprojektuota užsakymų priėmimo kompiuterizuota darbo vieta pieno perdirbimo įmonėje. / Company’s business computerization stands for creating and installing an information system which would satisfy all company’s needs. Such system’s creation and installation involves analysis of company’s demands, specification of them, physical and logical design, realization, testing and also subsequent maintenance and development.The main aim of this work is to design such information system which would be suitable for dairying plant. The system’s “Order Processing” interaction with other information systems that are used in the company would allow optimizing production coverage, cost and most important the quality of services.The deep analysis has been done in the dairying plant. Operating database systems have been reviewed.Testing of this system was performed by using virtual data.
|
38 |
Development and assessment of computer-game-like tests of human cognitive abilities.McPherson, Jason January 2008 (has links)
The present thesis describes the development and assessment of two computer-game-like tests designed to measure two cognitive abilities currently of considerable interest to many researchers: processing speed (Gs) and working memory (WM). It is hoped that such tests could provide a unique and important addition to the range of tests currently employed by researchers interested in these constructs. The results of five separate studies are presented across three published papers. In Paper 1-Study 1 (N = 49) a speeded computerized coding test (Symbol Digit) using the mouse as the response device was assessed. Because speeded tests are thought to be highly sensitive to response methods (Mead & Drasgow, 1994) it was deemed important to first assess how a mouse response method might affect the underlying construct validity of a speeded coding test independently of whether it was game-like. Factor analytic results indicated that the computerized coding test loaded strongly on the same factor as paper-andpencil measures of Gs. For Paper 2-Study 1 (N = 68) a more computer-game-like version of Symbol Digit was developed, Space Code. Development of Space Code involved the provision of a cover story, the replacing of code symbols with ‘spaceship’ graphics, the situating of the test within an overall ‘spaceship cockpit’, and numerous other graphical and aural embellishments to the task. Factor analytic results indicated that Space Code loaded strongly on a Gs factor but also on a factor comprised of visuo-spatial (Gv) ability tests. This finding was further investigated in the subsequent study. Paper 2-Study 2 (N = 74) involved a larger battery of ability marker tests and a range of additional computer-game-like elements were added to Space Code. Space Code included a scoring system, a timer with additional voice synthesized countdowns, aversive feedback for errors, and background music. Factor analysis indicated that after a general factor was extracted Space Code loaded on the same factor as paper-and-pencil measures of Gs and did not load on a factor comprised of non-speeded Gv tests. Paper 3-Study 1 (N = 74) was aimed at assessing a computer-game-like test of WM (Space Matrix) and further assessing Space Code within a broader network of tests. Space Matrix used a dual task format combining a simple version of Space Code with a visually presented memory task based on the Dot Matrix test (Miyake, Friedman, Rettinger, Shah, & Hegarty, 2001). The cover story and scoring system for Space Code was expanded to incorporate this additional memory element. Factor analysis indicated that Space Matrix was loaded on the same first order factor as standard WM tests and the Raven’s Advanced Progressive Matrices (Gf). Space Code was substantially loaded on the second order factor but was weakly loaded on each of two first order factors interpreted as Gs and WM/Gf. A final study is presented (Paper 3-Study2) in which Space Code and Space Matrix was administered to a school aged sample (N=94). Space Matrix exhibited construct validity as well as predictive validity (as a predictor of school grades), while results for Space Code were less encouraging. Space Matrix and Raven’s Progressive Matrices showed comparable relationships to school grades for Mathematics, English and Science subjects. It is concluded that the development of computer-game-like tests represents a promising new format for research and applied assessment of known cognitive abilities. / http://proxy.library.adelaide.edu.au/login?url= http://library.adelaide.edu.au/cgi-bin/Pwebrecon.cgi?BBID=1342350 / Thesis (Ph.D.) -- University of Adelaide, School of Psychology, 2008
|
39 |
Development and assessment of computer-game-like tests of human cognitive abilities.McPherson, Jason January 2008 (has links)
The present thesis describes the development and assessment of two computer-game-like tests designed to measure two cognitive abilities currently of considerable interest to many researchers: processing speed (Gs) and working memory (WM). It is hoped that such tests could provide a unique and important addition to the range of tests currently employed by researchers interested in these constructs. The results of five separate studies are presented across three published papers. In Paper 1-Study 1 (N = 49) a speeded computerized coding test (Symbol Digit) using the mouse as the response device was assessed. Because speeded tests are thought to be highly sensitive to response methods (Mead & Drasgow, 1994) it was deemed important to first assess how a mouse response method might affect the underlying construct validity of a speeded coding test independently of whether it was game-like. Factor analytic results indicated that the computerized coding test loaded strongly on the same factor as paper-andpencil measures of Gs. For Paper 2-Study 1 (N = 68) a more computer-game-like version of Symbol Digit was developed, Space Code. Development of Space Code involved the provision of a cover story, the replacing of code symbols with ‘spaceship’ graphics, the situating of the test within an overall ‘spaceship cockpit’, and numerous other graphical and aural embellishments to the task. Factor analytic results indicated that Space Code loaded strongly on a Gs factor but also on a factor comprised of visuo-spatial (Gv) ability tests. This finding was further investigated in the subsequent study. Paper 2-Study 2 (N = 74) involved a larger battery of ability marker tests and a range of additional computer-game-like elements were added to Space Code. Space Code included a scoring system, a timer with additional voice synthesized countdowns, aversive feedback for errors, and background music. Factor analysis indicated that after a general factor was extracted Space Code loaded on the same factor as paper-and-pencil measures of Gs and did not load on a factor comprised of non-speeded Gv tests. Paper 3-Study 1 (N = 74) was aimed at assessing a computer-game-like test of WM (Space Matrix) and further assessing Space Code within a broader network of tests. Space Matrix used a dual task format combining a simple version of Space Code with a visually presented memory task based on the Dot Matrix test (Miyake, Friedman, Rettinger, Shah, & Hegarty, 2001). The cover story and scoring system for Space Code was expanded to incorporate this additional memory element. Factor analysis indicated that Space Matrix was loaded on the same first order factor as standard WM tests and the Raven’s Advanced Progressive Matrices (Gf). Space Code was substantially loaded on the second order factor but was weakly loaded on each of two first order factors interpreted as Gs and WM/Gf. A final study is presented (Paper 3-Study2) in which Space Code and Space Matrix was administered to a school aged sample (N=94). Space Matrix exhibited construct validity as well as predictive validity (as a predictor of school grades), while results for Space Code were less encouraging. Space Matrix and Raven’s Progressive Matrices showed comparable relationships to school grades for Mathematics, English and Science subjects. It is concluded that the development of computer-game-like tests represents a promising new format for research and applied assessment of known cognitive abilities. / http://proxy.library.adelaide.edu.au/login?url= http://library.adelaide.edu.au/cgi-bin/Pwebrecon.cgi?BBID=1342350 / Thesis (Ph.D.) -- University of Adelaide, School of Psychology, 2008
|
40 |
Development and assessment of computer-game-like tests of human cognitive abilities.McPherson, Jason January 2008 (has links)
The present thesis describes the development and assessment of two computer-game-like tests designed to measure two cognitive abilities currently of considerable interest to many researchers: processing speed (Gs) and working memory (WM). It is hoped that such tests could provide a unique and important addition to the range of tests currently employed by researchers interested in these constructs. The results of five separate studies are presented across three published papers. In Paper 1-Study 1 (N = 49) a speeded computerized coding test (Symbol Digit) using the mouse as the response device was assessed. Because speeded tests are thought to be highly sensitive to response methods (Mead & Drasgow, 1994) it was deemed important to first assess how a mouse response method might affect the underlying construct validity of a speeded coding test independently of whether it was game-like. Factor analytic results indicated that the computerized coding test loaded strongly on the same factor as paper-andpencil measures of Gs. For Paper 2-Study 1 (N = 68) a more computer-game-like version of Symbol Digit was developed, Space Code. Development of Space Code involved the provision of a cover story, the replacing of code symbols with ‘spaceship’ graphics, the situating of the test within an overall ‘spaceship cockpit’, and numerous other graphical and aural embellishments to the task. Factor analytic results indicated that Space Code loaded strongly on a Gs factor but also on a factor comprised of visuo-spatial (Gv) ability tests. This finding was further investigated in the subsequent study. Paper 2-Study 2 (N = 74) involved a larger battery of ability marker tests and a range of additional computer-game-like elements were added to Space Code. Space Code included a scoring system, a timer with additional voice synthesized countdowns, aversive feedback for errors, and background music. Factor analysis indicated that after a general factor was extracted Space Code loaded on the same factor as paper-and-pencil measures of Gs and did not load on a factor comprised of non-speeded Gv tests. Paper 3-Study 1 (N = 74) was aimed at assessing a computer-game-like test of WM (Space Matrix) and further assessing Space Code within a broader network of tests. Space Matrix used a dual task format combining a simple version of Space Code with a visually presented memory task based on the Dot Matrix test (Miyake, Friedman, Rettinger, Shah, & Hegarty, 2001). The cover story and scoring system for Space Code was expanded to incorporate this additional memory element. Factor analysis indicated that Space Matrix was loaded on the same first order factor as standard WM tests and the Raven’s Advanced Progressive Matrices (Gf). Space Code was substantially loaded on the second order factor but was weakly loaded on each of two first order factors interpreted as Gs and WM/Gf. A final study is presented (Paper 3-Study2) in which Space Code and Space Matrix was administered to a school aged sample (N=94). Space Matrix exhibited construct validity as well as predictive validity (as a predictor of school grades), while results for Space Code were less encouraging. Space Matrix and Raven’s Progressive Matrices showed comparable relationships to school grades for Mathematics, English and Science subjects. It is concluded that the development of computer-game-like tests represents a promising new format for research and applied assessment of known cognitive abilities. / http://proxy.library.adelaide.edu.au/login?url= http://library.adelaide.edu.au/cgi-bin/Pwebrecon.cgi?BBID=1342350 / Thesis (Ph.D.) -- University of Adelaide, School of Psychology, 2008
|
Page generated in 0.0897 seconds