Undergraduate software engineering learners demonstrate a lack of motivation with face-to-face classroom education. Limited access to the Internet via PCs and laptops, hinders effective communication and collaboration. However, the majority of learners enrolled for studies in tertiary education, have cellphones and are proficient in the use of digital technology. A technology-enhanced m-learning solution is indicated. This research project evaluates the usability and user experience of an m-learning environment, custom-designed for a tertiary educational context and delivered by mobile handheld devices, features a synthesized framework of categories and criteria, and determines the nature and scope of an emergent digital divide. A design-based research model suited to the context of the study is implemented, gathering quantitative and qualitative data from experts and learners by survey questionnaires. Analysis of data highlights usability and UX problems, provides insight into an emergent digital divide and suggests guidelines specific to the design of m-learning implementations. / Educational Studies / M. Sc. (Information Systems)

Cette thèse en informatique se situe dans le domaine des Environnements Informatiques pour l’Apprentissage Humain (EIAH). Dans ce cadre, nous avons abordé la question de la personnalisation de l’apprentissage. Nos travaux de recherche consistaient à identifier un processus qui permette à la fois de personnaliser des séances de travail sur papier et des séances de travail sur des logiciels pédagogiques. Nous souhaitions que ce processus permette de prendre en compte les spécificités de chaque apprenant en s’appuyant sur son profil, mais qu’il prenne également en compte les buts et les habitudes pédagogiques des enseignants. Enfin, nous souhaitions que ce processus soit implémentable dans un système externe aux logiciels à personnaliser. Notre problématique s’est donc décomposée en trois points : comment exploiter les profils d’apprenants pour prendre en compte les individualités des apprenants ? Comment adapter une activité pour prendre en compte les besoins et habitudes pédagogiques d’un enseignant ? Et enfin, comment attribuer une activité à un apprenant ? Pour répondre au premier point, nous avons proposé le modèle cPMDL. Ce complément du langage de modélisation des profils PMDL permet de contraindre les profils des apprenants afin de sélectionner ceux ayant les caractéristiques requises par les contraintes. cPMDL nous permet donc d’exploiter les informations contenues dans les profils au sein du processus de personnalisation. Pour répondre au deuxième point, nous avons proposé l’approche GEPPETO. Cette approche s’appuie sur des modèles et des processus génériques permettant d’adapter les activités en fonction des intentions pédagogiques des enseignants grâce à la définition de contraintes sur les activités. Nous avons décliné cette approche pour permettre l’adaptation des activités papier (GEPPETOP), ainsi que pour l’adaptation des activités logicielles et de la configuration des environnements qui les supportent (GEPPETOS). Pour répondre au troisième point, nous avons proposé le modèle PERSUA2 qui permet de lier les contraintes sur profils de cPMDL aux contraintes sur activités de GEPPETO. Ces liens, nommés règles d’affectation, sont ensuite hiérarchisés selon leur degré de priorité pour former une stratégie pédagogique qui sera associée { un ou plusieurs contextes d’utilisation. Nous avons mis en oeuvre ces différentes contributions théoriques dans Adapte, un module de l’environnement informatique du projet PERLEA. Le rôle de cet environnement est d’assister l’enseignant dans la gestion de profils créés par l’enseignant lui-même ou issus de logiciels pédagogiques. Adapte est l’une des exploitations possibles des profils : le module réalisé permet de fournir à chaque apprenant des activités adaptées à son profil tout en respectant les choix pédagogiques de son enseignant. Ces activités peuvent être des activités papier proposées par le système ou des activités logicielles personnalisées par Adapte, mais effectuées dans un autre EIAH. Ce module, pleinement opérationnel, a montré la faisabilité technique de nos contributions théoriques et nous a permis de conduire des mises à l'essai auprès d'enseignants / This thesis in computer science belongs to the field of Interactive Learning Environments (ILE). In this context, we have addressed the issue of personalization of learning. Our research has consisted in identifying a process allowing one to personalize both paper working sessions and working sessions on educational software. Our goal was to design a process able to take into account the specificities of each learner, based on their profiles, but also to take into account the pedagogical goals and habits of teachers. Moreover, we had to design this process such as it could be easily implemented in a software external to the system being personalized. Our problem was therefore decomposed into three points: how to use learners’ profiles to take the individuality of learners into account? How to adapt a pedagogical activity to take the teaching needs and habits of a teacher into account? And finally, how to assign an activity to a learner? To answer the first point, we have proposed the cPMDL model. This complement of the profiles modelling language PMDL allows one to constrain the learners’ profiles to select those with the characteristics required by the constraints. cPMDL allows us to exploit the information contained in the profiles during the personalization process. To answer the second point, we have proposed the GEPPETO approach. This approach relies on generic models and processes to adapt activities according to the teachers' intentions, by defining constraints on activities. We have instantiated this approach to enable on the one hand the adaptation of paper activities (GEPPETOP) and on the other hand to enable the adaptation of software activities and the adaptation of configuration of environments that support them (GEPPETOS). To address the third point, we have proposed the PERSUA2 model which links cPMDL constraints on profiles with GEPPETO constraints on activities. Next, these links, called assignment rules, are organized into a hierarchy according to their priority degree in order to form a pedagogical strategy. This pedagogical strategy is then associated with one or more contexts of use. We have implemented these different theoretical contributions in Adapte, a module of the environment associated to the PERLEA project. The role of this environment is to assist teachers in the management of profiles created by themselves or coming from pedagogical software. Adapte is one of the possible uses of profiles: the module developed provides each learner with activities suited to their profiles, while respecting the teaching choices of the teacher. These activities may be paper activities proposed by the system or software activities personalized by Adapte but made within another ILE. This module, fully operational, has demonstrated the technical feasibility of our theoretical contributions and has allowed us to conduct experiment with teachers.

Le point de départ de cette thèse a pour origine les difficultés constatées dans la communauté EIAH pour concevoir des applications éducatives exploitant des informations géographiques. A terme, il s'agit de proposer une nouvelle plateforme susceptible de rendre possible et opérationnel la conception d'applications Web géographiques portées par des utilisateurs non-informaticiens de façon autonome. La proposition scientifique est basée sur un processus de conception piloté par les contenus et par les interactions. Il est opérationnalisé dans une plateforme nommée WINDMash offrant aux concepteurs un environnement visuel de spécification et d'évaluation des interactions. Nous proposons un modèle unifié sous-jacent de description des applications Web géographiques comportant trois facettes qui permettent de représenter les contenus géographiques manipulés, de les afficher sur une interface graphique et de décrire le comportement de l’application (scénario d’interaction) à l'aide d'un langage visuel dont le formalisme graphique est inspiré du diagramme de séquence UML. En utilisant des techniques d'Ingénierie Dirigée par les Modèles, la plateforme WINDMash permet de générer automatiquement le code de l'application finale sur la base des instances de trois facettes du modèle unifié. La plateforme WINDMash utilise pour cela l’API WIND (Web INteraction Design) que nous avons programmée. Les concepteurs peuvent ainsi prototyper rapidement des applications Web géographiques correspondant à leurs besoins. / The starting point of this thesis is to deal with the difficulties encountered in the TEL community for designing educational applications exploiting geographic information. Ultimately, it is to provide a new framework allowing for the operational design of geographic Web applications for experts in the domain (and particularly for teachers). The scientific proposal is based on a design process driven by contents and interaction. It is operationalized on a framework called WINDMash offering designers a visual environment for simply specifying and immediately evaluating interactions. The unified model for describing geographic Web applications has three parts: one for representing geographic contents, one for displaying them on a graphical user interface (GUI) and one for describing the behaviour of the application using a visual language whose graphical formalism is based on the UML diagram sequence. Using Model-Driven Engineering (MDE) techniques, the WINDMash framework can automatically generate the code of the final application based on the instances of three parts of the unified model. The WINDMash framework used for this the WIND API (Web INteraction Design) that we programmed. Designers can thus rapidly prototype geographic Web applications corresponding to their needs.

North-West University in South Africa is committed to expanding use of learning technologies for contact and distance education students by augmenting the existing NWU teaching and learning policy with an e-learning policy. The School of Continuing Teacher Education at North-West University is currently training about 24 000 in-service teacher students through Open Distance Learning. Only a few students submit assignments in typed format and seldom electronically. Students rarely use electronic technologies to augment their learning, and the SCTE employs few to support students. This does not comply with the South African Government’s policy on e-Education that demands information and communication technology mastery in teacher training. The aim of this research was integration of learning technologies in open distance learning at SCTE NWU through recommendations compiled in a sociologically transformative emergent implementation framework. The researcher followed a concurrent mixed-method sociologically transformative approach, focussing on the use of technology for social empowerment to cross the digital divide, through a theoretical lens of ICT for development. The lived experience in the natural setting of distance education students, lecturers, and involved stakeholders was used as initial data collection, informed by a continuous literature study of emergent learning technology use. Purposeful sampling was used during participant selection. The role of the researcher was that of participant observer, interviewer, and human instrument, from a position of methodological pragmatism as a method of inquiry. Using a design-based research approach, the thesis addresses the main research question through five research papers; each addressing one of the sub-questions as design-based research cycles, while collectively addressing the research problem to address the main research question. Nonstandardised measuring instruments were developed based on themes identified from literature and the analysis of qualitative data. Significant barriers to population-wide ICT adoption exist. Strong intentions of perseverance in attaining functional computer literacy are evident. Support and enablement are required to promote trust to attempt using computers, necessary to obtain self-confidence through accomplishment. In this way perseverance to attain functional computer literacy may be cultivated. The study presents a model for intention to use, confidence, trust and perseverance in attaining computer literacy competence with statistically significant standardised regression weights. In terms of affective responses of students during computer literacy training, a twodimensional model for computer literacy learning emotions is presented. Perceptions during professional development produced a model for faculty development towards socially transformative learning technology integration for open distance learning. The researcher also presents a people-technology interaction in teaching and learning model in the fifth paper. A distinction is made between reactionary interventions and pre-emptive unobtrusive seamless support, based on requirements identified through bottom-up feedback listening to latent requests of participants. Technology-enhanced learning integration should be legitimised through visible commitment from the university as institution. Lecturer training, innovative planning of time issues, acquisition of appropriate infrastructure, buying in from the institution and IT support services, and support of teacher-students are all essential for evolvement towards an e-mature organisation for the delivery of ODL to vast numbers of newly industrialised context clients. / Thesis (PhD (Curriculum Development Innovation and Evaluation))--North-West University, Potchefstroom Campus, 2013

North-West University in South Africa is committed to expanding use of learning technologies for contact and distance education students by augmenting the existing NWU teaching and learning policy with an e-learning policy. The School of Continuing Teacher Education at North-West University is currently training about 24 000 in-service teacher students through Open Distance Learning. Only a few students submit assignments in typed format and seldom electronically. Students rarely use electronic technologies to augment their learning, and the SCTE employs few to support students. This does not comply with the South African Government’s policy on e-Education that demands information and communication technology mastery in teacher training. The aim of this research was integration of learning technologies in open distance learning at SCTE NWU through recommendations compiled in a sociologically transformative emergent implementation framework. The researcher followed a concurrent mixed-method sociologically transformative approach, focussing on the use of technology for social empowerment to cross the digital divide, through a theoretical lens of ICT for development. The lived experience in the natural setting of distance education students, lecturers, and involved stakeholders was used as initial data collection, informed by a continuous literature study of emergent learning technology use. Purposeful sampling was used during participant selection. The role of the researcher was that of participant observer, interviewer, and human instrument, from a position of methodological pragmatism as a method of inquiry. Using a design-based research approach, the thesis addresses the main research question through five research papers; each addressing one of the sub-questions as design-based research cycles, while collectively addressing the research problem to address the main research question. Nonstandardised measuring instruments were developed based on themes identified from literature and the analysis of qualitative data. Significant barriers to population-wide ICT adoption exist. Strong intentions of perseverance in attaining functional computer literacy are evident. Support and enablement are required to promote trust to attempt using computers, necessary to obtain self-confidence through accomplishment. In this way perseverance to attain functional computer literacy may be cultivated. The study presents a model for intention to use, confidence, trust and perseverance in attaining computer literacy competence with statistically significant standardised regression weights. In terms of affective responses of students during computer literacy training, a twodimensional model for computer literacy learning emotions is presented. Perceptions during professional development produced a model for faculty development towards socially transformative learning technology integration for open distance learning. The researcher also presents a people-technology interaction in teaching and learning model in the fifth paper. A distinction is made between reactionary interventions and pre-emptive unobtrusive seamless support, based on requirements identified through bottom-up feedback listening to latent requests of participants. Technology-enhanced learning integration should be legitimised through visible commitment from the university as institution. Lecturer training, innovative planning of time issues, acquisition of appropriate infrastructure, buying in from the institution and IT support services, and support of teacher-students are all essential for evolvement towards an e-mature organisation for the delivery of ODL to vast numbers of newly industrialised context clients. / Thesis (PhD (Curriculum Development Innovation and Evaluation))--North-West University, Potchefstroom Campus, 2013

<p>Развој&nbsp; проширене&nbsp; и&nbsp; виртуелне&nbsp; реалности&nbsp; у&nbsp; последњих неколико година створио је могућности за укључивање и примену ових технологија на свим нивоима образовања. Бројна истраживања истичу да&nbsp; имерзивне&nbsp; технологије&nbsp; могу&nbsp; позитивно&nbsp; утицати&nbsp; на исходе&nbsp; учења&nbsp; и&nbsp; мотивисаност&nbsp; ученика.&nbsp; Такође, географија&nbsp; се&nbsp; често&nbsp; издваја&nbsp; као&nbsp; предмет&nbsp; који посебно&nbsp; може&nbsp; да&nbsp; искористи&nbsp; те&nbsp; потенцијале&nbsp; за унапређење&nbsp; и&nbsp; осавремењавање&nbsp; наставне&nbsp; праксе. Међутим,&nbsp; поставља&nbsp; се&nbsp; питање&nbsp; спремности наставника&nbsp; и&nbsp; студената&nbsp; географије&nbsp; (наставног усмерења)&nbsp; да&nbsp; организују&nbsp; наставу&nbsp; са&nbsp; мобилним&nbsp; и имерзивним&nbsp; технологијама.&nbsp; Притом,&nbsp; неопходно&nbsp; је свеобухватно&nbsp; сагледати&nbsp; позитивне&nbsp; и&nbsp; негативне факторе који утичу или могу утицати на интеграцију ових технологија у географско образовање. Сходно<br />наведеном,&nbsp; ова&nbsp; дисертација&nbsp; разматра&nbsp; како,&nbsp; када&nbsp; и зашто користити проширену и виртуелну реалност у настави и учењу географије.</p> / <p>Razvoj&nbsp; proširene&nbsp; i&nbsp; virtuelne&nbsp; realnosti&nbsp; u&nbsp; poslednjih nekoliko godina stvorio je mogućnosti za uključivanje i primenu ovih tehnologija na svim nivoima obrazovanja. Brojna istraživanja ističu da&nbsp; imerzivne&nbsp; tehnologije&nbsp; mogu&nbsp; pozitivno&nbsp; uticati&nbsp; na ishode&nbsp; učenja&nbsp; i&nbsp; motivisanost&nbsp; učenika.&nbsp; Takođe, geografija&nbsp; se&nbsp; često&nbsp; izdvaja&nbsp; kao&nbsp; predmet&nbsp; koji posebno&nbsp; može&nbsp; da&nbsp; iskoristi&nbsp; te&nbsp; potencijale&nbsp; za unapređenje&nbsp; i&nbsp; osavremenjavanje&nbsp; nastavne&nbsp; prakse. Međutim,&nbsp; postavlja&nbsp; se&nbsp; pitanje&nbsp; spremnosti nastavnika&nbsp; i&nbsp; studenata&nbsp; geografije&nbsp; (nastavnog usmerenja)&nbsp; da&nbsp; organizuju&nbsp; nastavu&nbsp; sa&nbsp; mobilnim&nbsp; i imerzivnim&nbsp; tehnologijama.&nbsp; Pritom,&nbsp; neophodno&nbsp; je sveobuhvatno&nbsp; sagledati&nbsp; pozitivne&nbsp; i&nbsp; negativne faktore koji utiču ili mogu uticati na integraciju ovih tehnologija u geografsko obrazovanje. Shodno<br />navedenom,&nbsp; ova&nbsp; disertacija&nbsp; razmatra&nbsp; kako,&nbsp; kada&nbsp; i zašto koristiti proširenu i virtuelnu realnost u nastavi i učenju geografije.</p> / <p>In&nbsp; recent&nbsp; years,&nbsp; the&nbsp; development&nbsp; of&nbsp; augmented&nbsp; and&nbsp; virtual&nbsp; reality&nbsp; has&nbsp; created&nbsp; opportunities&nbsp; for&nbsp; integration and use of these technologies at all levels of&nbsp; education.Numerous&nbsp; studies&nbsp; showed&nbsp; that&nbsp; immersive&nbsp; technologies have the potential to improve student learning outcomes and&nbsp; motivation.&nbsp; Geography&nbsp; is&nbsp; also&nbsp; often&nbsp; indicated&nbsp; as&nbsp; a subject&nbsp; that&nbsp; can&nbsp; utilize&nbsp; these&nbsp; potentials&nbsp; to&nbsp; improve&nbsp; and modernize&nbsp; teaching&nbsp; practice.&nbsp; However,&nbsp; the&nbsp; integration raises the question of the readiness of geography pre- and in-service&nbsp; teachers&nbsp; to&nbsp; organize&nbsp; classes&nbsp; with&nbsp; mobile&nbsp; and immersive technologies. Also, a comprehensive overlook regarding the positive and negative factors that influence or&nbsp; may influence the integration of these technologies in geographic&nbsp; education&nbsp; is&nbsp; necessary.&nbsp; Accordingly,&nbsp; this dissertation&nbsp; examines&nbsp; how,&nbsp; when,&nbsp; and&nbsp; why&nbsp; to&nbsp; use augmented and virtual reality in geography teaching and&nbsp; learning.</p>

Undergraduate software engineering learners demonstrate a lack of motivation with face-to-face classroom education. Limited access to the Internet via PCs and laptops, hinders effective communication and collaboration. However, the majority of learners enrolled for studies in tertiary education, have cellphones and are proficient in the use of digital technology. A technology-enhanced m-learning solution is indicated. This research project evaluates the usability and user experience of an m-learning environment, custom-designed for a tertiary educational context and delivered by mobile handheld devices, features a synthesized framework of categories and criteria, and determines the nature and scope of an emergent digital divide. A design-based research model suited to the context of the study is implemented, gathering quantitative and qualitative data from experts and learners by survey questionnaires. Analysis of data highlights usability and UX problems, provides insight into an emergent digital divide and suggests guidelines specific to the design of m-learning implementations. / Educational Studies / M. Sc. (Information Systems)

[ES] En los últimos años, el aprendizaje profundo ha cambiado significativamente el panorama en diversas áreas del campo de la inteligencia artificial, entre las que se incluyen la visión por computador, el procesamiento del lenguaje natural, robótica o teoría de juegos. En particular, el sorprendente éxito del aprendizaje profundo en múltiples aplicaciones del campo del procesamiento del lenguaje natural tales como el reconocimiento automático del habla (ASR), la traducción automática (MT) o la síntesis de voz (TTS), ha supuesto una mejora drástica en la precisión de estos sistemas, extendiendo así su implantación a un mayor rango de aplicaciones en la vida real. En este momento, es evidente que las tecnologías de reconocimiento automático del habla y traducción automática pueden ser empleadas para producir, de forma efectiva, subtítulos multilingües de alta calidad de contenidos audiovisuales. Esto es particularmente cierto en el contexto de los vídeos educativos, donde las condiciones acústicas son normalmente favorables para los sistemas de ASR y el discurso está gramaticalmente bien formado. Sin embargo, en el caso de TTS, aunque los sistemas basados en redes neuronales han demostrado ser capaces de sintetizar voz de un realismo y calidad sin precedentes, todavía debe comprobarse si esta tecnología está lo suficientemente madura como para mejorar la accesibilidad y la participación en el aprendizaje en línea. Además, existen diversas tareas en el campo de la síntesis de voz que todavía suponen un reto, como la clonación de voz inter-lingüe, la síntesis incremental o la adaptación zero-shot a nuevos locutores. Esta tesis aborda la mejora de las prestaciones de los sistemas actuales de síntesis de voz basados en redes neuronales, así como la extensión de su aplicación en diversos escenarios, en el contexto de mejorar la accesibilidad en el aprendizaje en línea. En este sentido, este trabajo presta especial atención a la adaptación a nuevos locutores y a la clonación de voz inter-lingüe, ya que los textos a sintetizar se corresponden, en este caso, a traducciones de intervenciones originalmente en otro idioma. / [CA] Durant aquests darrers anys, l'aprenentatge profund ha canviat significativament el panorama en diverses àrees del camp de la intel·ligència artificial, entre les quals s'inclouen la visió per computador, el processament del llenguatge natural, robòtica o la teoria de jocs. En particular, el sorprenent èxit de l'aprenentatge profund en múltiples aplicacions del camp del processament del llenguatge natural, com ara el reconeixement automàtic de la parla (ASR), la traducció automàtica (MT) o la síntesi de veu (TTS), ha suposat una millora dràstica en la precisió i qualitat d'aquests sistemes, estenent així la seva implantació a un ventall més ampli a la vida real. En aquest moment, és evident que les tecnologies de reconeixement automàtic de la parla i traducció automàtica poden ser emprades per a produir, de forma efectiva, subtítols multilingües d'alta qualitat de continguts audiovisuals. Això és particularment cert en el context dels vídeos educatius, on les condicions acústiques són normalment favorables per als sistemes d'ASR i el discurs està gramaticalment ben format. No obstant això, al cas de TTS, encara que els sistemes basats en xarxes neuronals han demostrat ser capaços de sintetitzar veu d'un realisme i qualitat sense precedents, encara s'ha de comprovar si aquesta tecnologia és ja prou madura com per millorar l'accessibilitat i la participació en l'aprenentatge en línia. A més, hi ha diverses tasques al camp de la síntesi de veu que encara suposen un repte, com ara la clonació de veu inter-lingüe, la síntesi incremental o l'adaptació zero-shot a nous locutors. Aquesta tesi aborda la millora de les prestacions dels sistemes actuals de síntesi de veu basats en xarxes neuronals, així com l'extensió de la seva aplicació en diversos escenaris, en el context de millorar l'accessibilitat en l'aprenentatge en línia. En aquest sentit, aquest treball presta especial atenció a l'adaptació a nous locutors i a la clonació de veu interlingüe, ja que els textos a sintetitzar es corresponen, en aquest cas, a traduccions d'intervencions originalment en un altre idioma. / [EN] In recent years, deep learning has fundamentally changed the landscapes of a number of areas in artificial intelligence, including computer vision, natural language processing, robotics, and game theory. In particular, the striking success of deep learning in a large variety of natural language processing (NLP) applications, including automatic speech recognition (ASR), machine translation (MT), and text-to-speech (TTS), has resulted in major accuracy improvements, thus widening the applicability of these technologies in real-life settings. At this point, it is clear that ASR and MT technologies can be utilized to produce cost-effective, high-quality multilingual subtitles of video contents of different kinds. This is particularly true in the case of transcription and translation of video lectures and other kinds of educational materials, in which the audio recording conditions are usually favorable for the ASR task, and there is a grammatically well-formed speech. However, although state-of-the-art neural approaches to TTS have shown to drastically improve the naturalness and quality of synthetic speech over conventional concatenative and parametric systems, it is still unclear whether this technology is already mature enough to improve accessibility and engagement in online learning, and particularly in the context of higher education. Furthermore, advanced topics in TTS such as cross-lingual voice cloning, incremental TTS or zero-shot speaker adaptation remain an open challenge in the field. This thesis is about enhancing the performance and widening the applicability of modern neural TTS technologies in real-life settings, both in offline and streaming conditions, in the context of improving accessibility and engagement in online learning. Thus, particular emphasis is placed on speaker adaptation and cross-lingual voice cloning, as the input text corresponds to a translated utterance in this context. / Pérez González De Martos, AM. (2022). Deep Neural Networks for Automatic Speech-To-Speech Translation of Open Educational Resources [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/184019 / TESIS / Premios Extraordinarios de tesis doctorales

Tesis por compendio / [ES] Durante la última década, los medios de comunicación han experimentado una revolución, alejándose de la televisión convencional hacia las plataformas de contenido bajo demanda. Además, esta revolución no ha cambiado solamente la manera en la que nos entretenemos, si no también la manera en la que aprendemos. En este sentido, las plataformas de contenido educativo bajo demanda también han proliferado para proporcionar recursos educativos de diversos tipos. Estas nuevas vías de distribución de contenido han llegado con nuevos requisitos para mejorar la accesibilidad, en particular las relacionadas con las dificultades de audición y las barreras lingüísticas. Aquí radica la oportunidad para el reconocimiento automático del habla (RAH) para cumplir estos requisitos, proporcionando subtitulado automático de alta calidad. Este subtitulado proporciona una base sólida para reducir esta brecha de accesibilidad, especialmente para contenido en directo o streaming. Estos sistemas de streaming deben trabajar bajo estrictas condiciones de tiempo real, proporcionando la subtitulación tan rápido como sea posible, trabajando con un contexto limitado. Sin embargo, esta limitación puede conllevar una degradación de la calidad cuando se compara con los sistemas para contenido en diferido u offline. Esta tesis propone un sistema de RAH en streaming con baja latencia, con una calidad similar a un sistema offline. Concretamente, este trabajo describe el camino seguido desde el sistema offline híbrido inicial hasta el eficiente sistema final de reconocimiento en streaming. El primer paso es la adaptación del sistema para efectuar una sola iteración de reconocimiento haciendo uso de modelos de lenguaje estado del arte basados en redes neuronales. En los sistemas basados en múltiples iteraciones estos modelos son relegados a una segunda (o posterior) iteración por su gran coste computacional. Tras adaptar el modelo de lenguaje, el modelo acústico basado en redes neuronales también tiene que adaptarse para trabajar con un contexto limitado. La integración y la adaptación de estos modelos es ampliamente descrita en esta tesis, evaluando el sistema RAH resultante, completamente adaptado para streaming, en conjuntos de datos académicos extensamente utilizados y desafiantes tareas basadas en contenidos audiovisuales reales. Como resultado, el sistema proporciona bajas tasas de error con un reducido tiempo de respuesta, comparables al sistema offline. / [CA] Durant l'última dècada, els mitjans de comunicació han experimentat una revolució, allunyant-se de la televisió convencional cap a les plataformes de contingut sota demanda. A més a més, aquesta revolució no ha canviat només la manera en la que ens entretenim, si no també la manera en la que aprenem. En aquest sentit, les plataformes de contingut educatiu sota demanda també han proliferat pera proporcionar recursos educatius de diversos tipus. Aquestes noves vies de distribució de contingut han arribat amb nous requisits per a millorar l'accessibilitat, en particular les relacionades amb les dificultats d'audició i les barreres lingüístiques. Aquí radica l'oportunitat per al reconeixement automàtic de la parla (RAH) per a complir aquests requisits, proporcionant subtitulat automàtic d'alta qualitat. Aquest subtitulat proporciona una base sòlida per a reduir aquesta bretxa d'accessibilitat, especialment per a contingut en directe o streaming. Aquests sistemes han de treballar sota estrictes condicions de temps real, proporcionant la subtitulació tan ràpid com sigui possible, treballant en un context limitat. Aquesta limitació, però, pot comportar una degradació de la qualitat quan es compara amb els sistemes per a contingut en diferit o offline. Aquesta tesi proposa un sistema de RAH en streaming amb baixa latència, amb una qualitat similar a un sistema offline. Concretament, aquest treball descriu el camí seguit des del sistema offline híbrid inicial fins l'eficient sistema final de reconeixement en streaming. El primer pas és l'adaptació del sistema per a efectuar una sola iteració de reconeixement fent servir els models de llenguatge de l'estat de l'art basat en xarxes neuronals. En els sistemes basats en múltiples iteracions aquests models son relegades a una segona (o posterior) iteració pel seu gran cost computacional. Un cop el model de llenguatge s'ha adaptat, el model acústic basat en xarxes neuronals també s'ha d'adaptar per a treballar amb un context limitat. La integració i l'adaptació d'aquests models és àmpliament descrita en aquesta tesi, avaluant el sistema RAH resultant, completament adaptat per streaming, en conjunts de dades acadèmiques àmpliament utilitzades i desafiants tasques basades en continguts audiovisuals reals. Com a resultat, el sistema proporciona baixes taxes d'error amb un reduït temps de resposta, comparables al sistema offline. / [EN] Over the last decade, the media have experienced a revolution, turning away from the conventional TV in favor of on-demand platforms. In addition, this media revolution not only changed the way entertainment is conceived but also how learning is conducted. Indeed, on-demand educational platforms have also proliferated and are now providing educational resources on diverse topics. These new ways to distribute content have come along with requirements to improve accessibility, particularly related to hearing difficulties and language barriers. Here is the opportunity for automatic speech recognition (ASR) to comply with these requirements by providing high-quality automatic captioning. Automatic captioning provides a sound basis for diminishing the accessibility gap, especially for live or streaming content. To this end, streaming ASR must work under strict real-time conditions, providing captions as fast as possible, and working with limited context. However, this limited context usually leads to a quality degradation as compared to the pre-recorded or offline content. This thesis is aimed at developing low-latency streaming ASR with a quality similar to offline ASR. More precisely, it describes the path followed from an initial hybrid offline system to an efficient streaming-adapted system. The first step is to perform a single recognition pass using a state-of-the-art neural network-based language model. In conventional multi-pass systems, this model is often deferred to the second or later pass due to its computational complexity. As with the language model, the neural-based acoustic model is also properly adapted to work with limited context. The adaptation and integration of these models is thoroughly described and assessed using fully-fledged streaming systems on well-known academic and challenging real-world benchmarks. In brief, it is shown that the proposed adaptation of the language and acoustic models allows the streaming-adapted system to reach the accuracy of the initial offline system with low latency. / Jorge Cano, J. (2022). Streaming Automatic Speech Recognition with Hybrid Architectures and Deep Neural Network Models [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/191001 / Compendio

Recent research has persistently emphasized that education is broken and that the solutions lie with technological resources in educational institutions and teaching methods (Teräs et al., 2020), which has generated a techno-solutionism approach of Edtech companies (Mirrlees &amp; Alvi, 2019). The outbreak of COVID-19 exposed significant challenges and limitations when adapting education to the digital environment highlighting a need for a deeper understanding of the integration of technology with education. While some scholars focus on technological artefacts as an object of study at the intersection between neuroscience and technology (Healy, 1998), others focus on the importance of pedagogy and the challenges of researching pedagogy in a context of rapidly increasing technological advancement (Hellstén &amp; Reid, 2008).Through investigating Brazilian teachers’ experiences and challenges of integrating technology within higher education before and during the pandemic, the study contributes to furthering understanding of the intersection between pedagogy and technology. The application of an exploratory sequential mixed-methods design contextualizes the teachers’ voices and enables contrast with the existing literature in international contexts. The study’s findings suggest that most of the teachers included technology in their classes to some extent. The teachers’ personal preferences and course discipline, however, can influence how they would incorporate technological resources in higher education. Moreover, the university’s policies and support structures also influence teachers’ decisions and motivations regarding technology integration. The study recontextualized the growing discussion in global research surrounding education and technology by using prominent scholars in the field to form a foundation through which to understand if similar issues may also appear in the Brazilian context. The main differences in the findings of this research set the case of Brazil apart in that the teachers noticed that the course discipline can be a factor in deciding whether or not to use technological resources in their classes at Brazilian institutions. The discussion about the course discipline did not appear in the international literature review focusing on technology-enhanced learning and teachers’ attitudes toward technology integrations. Moreover, this research facilitated the creation of the Inverted Mirror instrument, which was developed during the literature review process to create a visualization of comparisons. The Inverted Mirror instrument is used here to compare and visualize what is unseen or hidden during the comparison of teacher experiences in order to explain what occurs when technology is used in the classroom.