Classical value estimation reinforcement learning algorithms do not perform very well in dynamic environments. On the other hand, the reinforcement learning of animals is quite flexible: they can adapt to dynamic environments very quickly and deal with noisy inputs very effectively. One feature that may contribute to animals' good performance in dynamic environments is that they learn and perceive the time to reward. In this research, we attempt to learn and perceive the time to reward and explore situations where the learned time information can be used to improve the performance of the learning agent in dynamic environments. The type of dynamic environments that we are interested in is that type of switching environment which stays the same for a long time, then changes abruptly, and then holds for a long time before another change. The type of dynamics that we mainly focus on is the time to reward, though we also extend the ideas to learning and perceiving other criteria of optimality, e.g. the discounted return, so that they can still work even when the amount of reward may also change. Specifically, both the mean and variance of the time to reward are learned and then used to detect changes in the environment and to decide whether the agent should give up a suboptimal action. When a change in the environment is detected, the learning agent responds specifically to the change in order to recover quickly from it. When it is found that the current action is still worse than the optimal one, the agent gives up this time's exploration of the action and then remakes its decision in order to avoid longer than necessary exploration. The results of our experiments using two real-world problems show that they have effectively sped up learning, reduced the time taken to recover from environmental changes, and improved the performance of the agent after the learning converges in most of the test cases compared with classical value estimation reinforcement learning algorithms. In addition, we have successfully used spiking neurons to implement various phenomena of classical conditioning, the simplest form of animal reinforcement learning in dynamic environments, and also pointed out a possible implementation of instrumental conditioning and general reinforcement learning using similar models.

La thèse, intitulée « Essai sur la Théorie de l’Actualisation : Utilité Escomptée Subjective et Sensibilité à la Variation », s’inscrit dans le périmètre de recherche associé à la théorie de la décision intertemporelle et s’engage précisément dans deux sentiers qui ont été, jusqu’à présent, relativement peu exploités. D’une part, elle s’interroge sur la diversité observée – et modélisée – des mécanismes d’actualisation en cherchant à expliquer une telle diversité sur la base d’une structure comportementale unique (Partie I. Une investigation de l’actualisation). D’autre part, face à cette diversité croissante des mécanismes d’actualisation recensés, la thèse s’interroge sur la condition de cohérence temporelle en cherchant à caractériser des préférences temporelles cohérentes sur la base de la même structure comportementale définie dans la première partie (Partie II. Une investigation de la cohérence temporelle). / The thesis, entitled “Essay on the Discounting Theory: Subjective Discounted Utility and Variation Sensibility”, gathers a set of theoretical works related to Intertemporal Decision Theory. In particular, two unexploited fields are investigated. On one hand, the thesis explains the great heterogeneity in discounting by a single behavioral pattern called time perception. A general axiomatic model, the Subjective Discounted Utility, generalizes any Discounted Utility model by associating each discount mechanism to a unique time perception (Part I. An Investigation of Discounting). Many applications are dedicated to extreme time horizons. On the other hand, the Subjective Discounted Utility model is applied to a general study of time consistent preferences. Axiomatic conditions are defined on time preferences to characterize time consistent and time inconsistent preferences (Part II. An Investigation of Time Consistency).

The diploma thesis investigates the subjective perception of time, especially the exactness of the interval length estimation, subjective passage of time, in relation to the time perspective, the level of difficulty in emotion regulation and age. Furthermore, the thesis investigates differences in retrospective and prospective paradigm in interval length estimate. Research was conducted online, with a total number of 180 respondents. Data collection had occurred during a 4 month period. Main instruments were the Czech versions of the ZTPI - Zimbardo's time perspective inventory and the DERS-SF-CZ - Difficulty in emotion regulation scale; moreover, for the declaration of subjective passage of time was employed a method of verbal estimation. Subjective interval length was registered after finishing rewriting of two short texts. The results have showed statistically significant relationships between subjective passage of time and age; between the level of difficulty in emotion regulation and subjective passage of time. Amongst the persons orientated onto positive and negative past, there was found a significant relationship between the subjective passage of time and the difficulty in emotion regulation. Results have also shown that the interval length is overestimated in both, prospective and...

Not available / text

Not available / text

No description available.

Personer med kognitiva nedsättningar tillhör en av de största grupperna av funktionsnedsatta personer. Premium Comai är ett hjälpmedel för att hjälpa personer med kognitiva nedsättningar att bli mer självständiga i deras vardag. Denna målgrupp har framförallt svårigheter med de exekutiva funktionerna så till exempel att minnas saker de ska genomföra eller att uppfatta hur lång tid aktiviteter tar. Denna studie undersöker hur användandet av en digital kalender som hjälpmedel för personer med kognitiva nedsättningar ser ut och hur användare av upplever hjälpmedlet, om de upplever att det hjälper dem planera sin tid och att komma ihåg. För att undersöka detta intervjuades användare av Premium Comai, där intervjutekniken var semistrukturerade intervjuer. Användare upplever att hjälpmedlet är enkelt att använda och att det hjälper dem planera sin tid. Premium Comai skapar trygghet. / People with cognitive impairments belong to one of the largest groups of disabled persons. Premium Comai is a tool to help people with cognitive impairments to become more independent in their daily lives. These peoples have particular difficulties with the executive functions such as remembering things or to perceive the time an activity will take. This study examines how the use of a digital calendar that is accessible for people with cognitive impairments, how users perceive the means, if they feel it helps them manage their time and to remember. To examine this, users of Premium Comai were interviewed, using semi-structured interviews. Users perceive that the device is easy to use and it helps them to plan their time. Premium Comai makes users feel safe.

Les patients schizophrènes souffrent de graves déficits de mémoire autobiographique. Cela a un impact direct sur leur identité personnelle et leur statut fonctionnel dans la vie quotidienne. A travers 3 études, nous avons montré que l’ensemble des caractéristiques subjectives du rappel des souvenirs est perturbé chez les patients schizophrènes (distorsion de la perception du temps subjectif, moindre fréquence de la perspective visuelle Acteur). L’altération de ces aspects subjectifs serait liée au manque de spécificité et de détails des souvenirs. Ce sont ces détails qui rendent le rappel des souvenirs vivace. Aussi, nous avons testé l’efficacité d’une méthode qui a montré que les déficits de récupération stratégique de ces détails pouvaient être corrigés. Les patients sont capables d’améliorer le rappel des détails de leurs souvenirs si une aide appropriée leur est fournie. Une thérapie de remédiation cognitive basée sur cette méthode pourrait être proposée aux patients schizophrènes. / Patients with schizophrenia suffer from severe autobiographical memory deficits. These have a significant impact on patients’ personal identity and functional status in daily life. Through three studies, we showed that all the subjective characteristics of autobiographical recall are impaired in patients with schizophrenia (distorted perception of subjective time, memory recall less associated with Field visual perspective). The impairment of these subjective aspects of autobiographical recall was linked to the lack of specificity of memories and low level of details in patients’ memories. It is these details which allow vivid memory recall. Hence, we tested the effectiveness of a method which showed that deficits in the strategic retrieval of memory details could be remediated. Patients are able to improve the recall of their memory details when given the necessary means to do so. A cognitive remediation therapy, based on this method, could be set up with patients with schizophrenia.

Questa tesi presenta i risultati teorici, metodologici ed empirici di una ricerca di dottorato incentrata sul tema della percezione del tempo nell’esperienza cinematografica. La prima parte fornisce un’introduzione teorica al tema. Il Capitolo 1 precisa il taglio e l’oggetto della ricerca. Il Capitolo 2 presenta i principali modelli teorici di percezione del tempo. Il Capitolo 3 si concentra sulla percezione del tempo nel contesto cinematografico. La seconda parte comprende gli esperimenti condotti nel corso della ricerca. Il Capitolo 4 illustra il primo esperimento. Attraverso misure comportamentali, questo studio ha indagato gli effetti sulla stima di durata e sulla percezione del passaggio del tempo di due variabili cinematografiche: il tipo di azione rappresentata e lo stile di montaggio. Il Capitolo 5 presenta il secondo esperimento. Tramite un metodo chiamato micro-fenomenologia, questo studio ha esplorato i processi esperienziali che fondano i compiti di stima di durata e percezione del passaggio del tempo. Il Capitolo 6 descrive il terzo esperimento. Attraverso una tecnica di neurostimolazione (tDCS), questo studio ha testato il coinvolgimento di una specifica area cerebrale (Area Supplementare Motoria) negli stessi compiti temporali. La terza parte riassume i risultati della ricerca (Capitolo 7) e discute possibili futuri sviluppi di quest’ultima (Capitolo 8). / This dissertation presents the theoretical, methodological, and empirical results of a doctoral research concerning time perception in the experience of cinema. The first part provides a theoretical introduction to the topic. Chapter 1 carves out the dissertation’s precise angle and object. Chapter 2 presents the main models of subjective time perception. Chapter 3 restricts the scope to time perception in the specific context of cinema. The second part reports about the three experiments conducted during the research. Chapter 4 introduces the first experiment. By using behavioural measures, this study addressed the effects on duration estimation and time passage perception of two cinematographic variables: the type of represented action and the style of editing. Chapter 5 presents the second experiment. By adopting a method called micro-phenomenology, this study explored the processes underlying the performance of the duration estimation and time passage perception tasks. Chapter 6 is devoted to the third experiment. By using a neurostimulation technique (tDCS), this study tested the involvement of a specific brain area (the Supplementary Motor Area) in the same timing tasks. The third part summarizes the essential findings of the research (Chapter 7) and re-opens it to some of its possible future developments (Chapter 8).

Tid verkar vara en försummad faktor gällande hälsa och livsstil. WHO använder tidsbegreppet för att mäta ohälsa och mortalitet. Mätmetoder som DALY, HALE och YLL inbegriper tid, mätt i livslängd och tid i livskvalitet. Däremot saknas tidsbegreppet i litteratur gällande hälsoresurser, hälsans determinanter och i olika interventioner. I litteratur som beforskar empowerment nämns inte tid som en faktor. Däremot finns det forskning i andra discipliner som stöder att tid är en hälsofaktor. Tid i en hälsa- och livsstilskontext skulle kunna delas upp i fyra olika dimensioner i den subjektiva tidsuppfattningen: perceptuell, reflexiv, intersubjektiv och cirkadisk tidsuppfattning. Denna uppsats har avgränsats till att beforska vilket samband som finns mellan dessa olika temporala modaliteter och empowerment. En begreppsanalys enligt Walker och Avant (2014) har gjorts med en litteratursökning där tid och empowerment var sökbegrepp vilket resulterade i tolv artiklar. Resultatet visar på att i synnerhet reflexiv och intersubjektiv tidsuppfattning påverkar empowerment-relaterade processer och utfall. Perceptuell och cirkadisk tidsuppfattning påverkas av empowermentrelaterade processer men är även ramverk för dessa. Olika antecedenter har identifierats vilka är strukturella faktorer, grupp, beslut och plats.