Through the evolution and proliferation of the Internet, distance and online education have become more prevalent in modern society. Synchronous web-based professional development continues to gain popularity. Although online education has grown in popularity and breadth, there has been a lack of research about the impact of synchronous web-based professional development. By using Kirkpatrick and Kirkpatrick's (2006) Four Levels of Evaluation, this study examined the impact of webinar professional development at a National Science Foundation Advanced Technology Center. Findings indicate that although the factors that contribute to learning in a web-based environment were present, there was a lack of evidence about the actual outcomes of participation in a synchronous web-based professional development. To address the lack of evidence, a new model of Comprehensive Synchronous Web-based Professional Development evaluation and implementation is proposed in the discussion.

Bibliography: leaves 207-224 / Abstracts and keywords following the Appendices / This thesis evaluates Ethiopian higher learning institutes’ digital libraries (DLs) for their usability and usefulness. The outcome contributes knowledge by helping to propel development efforts; satisfy DL stakeholders; provide information and fill information gaps; serve as cross-reference for academicians and researchers in the discipline; make decisions and solve managerial issues in DLs of the developing world; and provide scientific interests and merits for the advancement of information systems. When undertaking usability and usefulness evaluation research in DLs, there is no agreed-upon established conceptual framework that guides researchers in the developing world. Therefore, the overall objective of this research is to propose a framework for DL evaluation that fits into the context of developing countries. As the study is concerned with users’ internal attributes, the interpretive research paradigm is applied. A qualitative research approach is employed and a case study research design is followed. Multiple data-collection techniques, namely semi-structured interviews (17 respondents), open-ended questionnaires (17 respondents) and observations (4 observations) are employed. The study encompasses four public university DLs in Ethiopia. The participants have a positive perception of all attributes of usability. Most of the attributes of usefulness are also perceived positively, except coverage. The major challenges encountered by participants are network accessibility, interruption and speed, and access restrictions imposed on some DL content. DL benefits include easy access to the DL content, enhanced teaching and research, lower cost and easy sharing of contents. The expectations of users are ensuring resource availability and sustainability, overcoming the absence of user feedback and federated search problems, and improving network infrastructure and speed. The interaction triptych framework (ITF), which is used in the current study, is a well-known framework that is commonly implemented by researchers. However, since it does not incorporate the contextual situation of developing countries, ITF has some limitations. Therefore, based on the output of this empirical research and considering the usability and usefulness themes of ITF and its relationships with other socio-technical and contextual themes, a contextual DL evaluation framework is proposed. The proposed framework emphasises the social, institutional and contextual aspects of DLs. The proposed framework has six DL components, namely: DL user; content and collection; system and technology; services and support; user interface; and context. The proposed framework is called a digital library components interaction evaluation framework. / Lo mqondo uhlaziya imitapo yolwazi yedijithali (i-DLs) yezikhungo zokufunda ephezulu zase-Ethiopia ngokusebenziseka kwazo nokuba wusizo. Umphumela unikela ngolwazi ngokusiza ukuhambisa imizamo yentuthuko; ukwanelisa ababambiqhaza be-DL; ukuhlinzeka ngolwazi nokugcwalisa izikhala zolwazi; ukusebenza okubhekiswe kukho kwezifundiswa nabaphenyi emkhakheni; yenza izinqumo futhi ixazulule izingqinamba zokuphatha kuma-DL wezwe elisathuthuka; futhi unikeze izintshisekelo zesayensi kanye nokufaneleka ekuthuthukisweni kwezinhlelo zolwazi. Lapho wenza ucwaningo lokusebenziseka neliwusizo okuhlaziya kuma-DL, akukho luhlaka lomqondo okuvunyelwene ngalo oluhola abacwaningi ezweni elisathuthuka. Ngakho-ke, inhloso ephelele yalolu cwaningo ukuphakamisa uhlaka lokuhlaziya kwe-DL oluhambisana nomongo wamazwe asathuthuka. Njengoba ucwaningo luphathelene nezimpawu zangaphakathi zabasebenzisi, inqubo yocwaningo ehumushekayo iyasetshenziswa. Indlela yokucwaninga esezingeni elifanele iyasetshenziswa bese kulandelwa ukwakheka kocwaningo lwesifundo. Kusetshenziswa amasu amaningi wokuqoqa imininingwane, njengezingxoxo ezihlelwe kahle (abaphenduli abayi-17), imibuzo evulekile (abaphenduli abayi-17) kanye nokubhekwayo (okubhekwayo oku-4). Lolu cwaningo luhlanganisa ama-DL amane wemfundo ephakeme yomphakathi wase-Ethiopia. Abahlanganyeli banombono omuhle wazo zonke izici zokusebenziseka. Iningi lezimpawu eziwusizo zibonwa kahle futhi, ngaphandle kokumbozwa. Izinselela ezinkulu ababambiqhaza abahlangabezana ngazo ukufinyeleleka kwenethiwekhi, ukuphazamiseka nejubane, nemikhawulo yokufinyelela ebekiwe kokunye okuqukethwe kwe-DL. Izinzuzo ze-DL zifaka ukufinyelela okulula kokuqukethwe kwe-DL, ukufundiswa okuthuthukisiwe nocwaningo, izindleko eziphansi nokwabelana okulula kokuqukethwe. Okulindelwe abasebenzisi ukuqinisekisa ukutholakala kwezinsiza nokusimama, ukunqoba ukungabi bikho kwempendulo yomsebenzisi nezinkinga zokusesha ezihlanganisiwe, nokwenza ngcono ingqalasizinda yenethiwekhi nejubane. Uhlaka lokusebenzisana lwe-triptych (ITF), olusetshenziswa ocwaningweni lwamanje, uhlaka olwaziwa kakhulu olusetshenziswa ngokuvamile ngabaphenyi. Kodwa-ke, njengoba lungafaki isimo somongo samazwe asathuthuka, i-ITF inemikhawulo ethile. Ngakho-ke, ngokuya ngokukhishwa kwalolu cwaningo olunamandla kanye nokubheka ukusebenziseka nosizo lwezindikimba ze-ITF kanye nobudlelwano bayo nezinye izingqikithi zomphakathi nezobuchwepheshe nezingqikithi zomongo, kuhlongozwa uhlaka lokuhlaziya lomongo lwe-DL. Uhlaka oluhlongozwayo lugcizelela izici zenhlalo, zesikhungo nezingqikithi zomongo zama-DL. Uhlaka oluhlongozwayo lunezingxenye eziyisithupha ze-DL, okuyilezi: Umsebenzisi we-DL; okuqukethwe neqoqo; uhlelo nobuchwepheshe; izinsizakalo nokwesekwa; isikhombimsebenzisi somsebenzisi nomongo. Uhlaka oluhlongozwayo lubizwa ngohlaka lokuhlaziya kokusebenzisana kokuqukethwe komtapo wolwazi wedijithali. / Hierdie proefskrif evalueer Ethiopië se hoër leerinstellings se digitale biblioteke (DBe) ten opsigte van hulle bruikbaarheid en nuttigheid. Die uitkoms dra by tot kennis wat kan help om die ontwikkelingspogings aan te dryf; om belanghebbers van digitale biblioteke tevrede te hou; om inligting te verskaf en inligtingsgapings te vul; deur te dien as kruisverwysing vir akademici en navorsers in die vakgebied; om besluite te neem en bestuursaangeleenthede in digitale biblioteke van die ontwikkelende wêreld op te los; en om wetenskaplike belange en meriete vir die bevordering van inligtingstelsels te voorsien. Wanneer bruikbaarheids- en nuttigheidsevalueringsnavorsing in digitale biblioteke onderneem word, is daar geen ooreengekome, gevestigde raamwerk wat leiding aan navorsers in die ontwikkelende wêreld kan gee nie. Die algehele doelwit van hierdie navorsing was derhalwe om ’n raamwerk vir die evaluaering van digitale biblioteke voor te stel wat in die konteks van ontwikkelende lande pas. Omdat die studie gemoeid is met gebruikers se interne eienskappe, is die vertolkende paradigma gebruik. ’n Kwalitatiewe navorsingsbenadering is gebruik en ’n gevallestudie-navorsingsontwerp is gevolg. Veelvuldige data-insamelingstegnieke, naamlik semigestruktureerde onderhoude (17 respondente), oop vraelyste (17 respondente) en waarnemings (vier waarnemigs), is ingespan. Die studie sluit vier openbare universiteite se digitale biblioteke in Ethiopië in. Die deelnemers het ’n positiewe persepsie van al die eienskappe van bruikbaarheid. Die meeste van die eienskappe van nuttigheid word ook as positief waargeneem, met die uitsluiting van voorsiening. Die grootste uitdagings wat die deelnemers ervaar het, was netwerktoeganklikheid, -onderbrekings en -spoed en die toegangbeperkings wat sommige digitale biblioteke oplê. Voordele van digitale biblioteke sluit die volgende in: toegang tot digitalebiblioteekinhoud; beter onderrig en navorsing; laer koste; en die maklike deel van inhoud met ander. Die verwagtings van gebruikers verseker hulpbronbeskikbaarheid en -volhoubaarheid, en om die afwesigheid van gebruikersterugvoer en gefedereerde soekprobleme en die verbetering van netwerkinfrastruktuur en -spoed te oorkom. Die interaksietriptiekraamwerk (ITF) wat in hierdie studie gebruik is, is ’n bekende raamwerk wat algemeen deur navorsers geïmplementeer word. Omdat dit egter nie die kontekstuele situasie van ontwikkelende lande inkorporeer nie, het ITF sekere beperkings. Gebaseer op die uitset van hierdie empiriese navorsing en met die inagneming van die bruikbaarheids- en nuttigheidstemas van ITF en sy verhouding met ander sosio-tegniese en kontekstuele temas, word ’n kontekstuele digitalebiblioteekraamwerk derhalwe voorgestel. Die voorgestelde raamwerk beklemtoon die sosiale, institusionele en kontekstuele aspekte van digitale biblioteke. Die voorgestelde raamwerk het ses digitalebiblioteekkomponente, naamlik: digitalebiblioteekgebruiker; inhoud en insameling; stelsel en tegnologie; dienste en ondersteuning; gebruikerkoppelvlak; en konteks. Die voorgestelde raamwerk word ’n interaksie-evalueringsraamwerk vir digitalebiblioteekkomponente genoem. / School of Computing / D. Phil. (Information Systems)

Dissertation / This dissertation proposes a generic methodology for evaluating intelligent tutoring systems (ITSs), and applies it to the evaluation of the SQL-Tutor, an ITS for the database language SQL. An examination of the historical development, theory and architecture of intelligent tutoring systems, as well as the theory, architecture and behaviour of the SQL-Tutor sets the context for this study. The characteristics and criteria for evaluating computer-aided instruction (CAl) systems are considered as a background to an in-depth investigation of the characteristics and criteria appropriate for evaluating ITSs. These criteria are categorised along internal and external dimensions with the internal dimension focusing on the intrinsic features and behavioural aspects of ITSs, and the external dimension focusing on its educational impact. Several issues surrounding the evaluation of ITSs namely, approaches, methods, techniques and principles are examined, and integrated within a framework for assessing the added value of ITS technology for instructional purposes. / Educational Studies / M. Sc. (Information Systems)

Chemnitz, Techn. Univ., Studienarb., 2007.

Dissertation / This dissertation proposes a generic methodology for evaluating intelligent tutoring systems (ITSs), and applies it to the evaluation of the SQL-Tutor, an ITS for the database language SQL. An examination of the historical development, theory and architecture of intelligent tutoring systems, as well as the theory, architecture and behaviour of the SQL-Tutor sets the context for this study. The characteristics and criteria for evaluating computer-aided instruction (CAl) systems are considered as a background to an in-depth investigation of the characteristics and criteria appropriate for evaluating ITSs. These criteria are categorised along internal and external dimensions with the internal dimension focusing on the intrinsic features and behavioural aspects of ITSs, and the external dimension focusing on its educational impact. Several issues surrounding the evaluation of ITSs namely, approaches, methods, techniques and principles are examined, and integrated within a framework for assessing the added value of ITS technology for instructional purposes. / Educational Studies / M. Sc. (Information Systems)

The mining industry in South Africa contributes significantly to the national economy. Despite stringent safety legislation, mining accidents cause numerous fatalities and injuries. Inadequate or insufficient training is often cited as a root cause of accidents. Conventional class-based safety training has not reduced the incidence of accidents significantly. By contrast, virtual reality training tools can provide simulated exposure to real-world working conditions without the associated risks. This study describes the application of design-based research (DBR) in the design and development of two desktop virtual reality (VR) systems for safety training in the South African mining industry. The results of a usability context analysis were applied in the design of a VR prototype on generic hazards recognition and rectification, which was used and evaluated at South Africa‘s largest platinum mine site. A case study was conducted to investigate the causes and occurrences of falls of ground, which resulted in the design and development of a second VR prototype focusing on identifying and addressing underground geological conditions. DBR was also used in the generation of an evaluation framework for evaluating VR training systems, namely the Desktop VR Evaluation Framework (DEVREF), which is the major deliverable of the research. DEVREF can make a major contribution to the domain of e-training in mines and is transferable and customisable beyond its initial application. The process flow of the research thus moved beyond merely providing a solution to a complex real-world problem and became a classic DBR study with dual outcomes, namely a practical real-world solution in the form of two VR training systems and a theoretical contribution in the form of the DEVREF evaluation framework. DEVREF evaluates the design of desktop VR training systems in the categories of instructional design, usability, VR systems design, and context-specific criteria for mining. The use of DEVREF is demonstrated by reporting the application of its criteria in evaluating the two VR training systems. Heuristic evaluation, end-user surveys, and interviews were used as evaluation methods. A third contribution is methodological, in that this work proposes a new DBR process model and an interaction design lifecycle model suitable for VR training systems. / Computing / D. Phil. (Information Systems)