<p>Connectionist models have been criticized for not being able to form compositional representations of recursive data structures such as trees and lists, a matter that has been addressed by models as Elman networks, RAAM and B-RAAM. These architectures seem to have common features with the human short-term memory regarding recall. Both show a strong recency effect; however, the human memory also exhibits a primacy effect due to rehearsal. The problem is that the connectionist models do not have the primacy aspect, which complicates the learning of long-term dependencies. A long-term dependency is when items presented early should affect the behaviour of the model. Learning long-term dependencies is a problem that is hard to address within these architectures.</p><p>Delay-lines might be used as a mechanism for implementing rehearsal within connectionist models. However, it has not been clarified how the use of delay-lines affects the recency and the primacy aspect. In this thesis, delay-lines are introduced in B-RAAM. This study investigates how the primacy and the recency aspect are affected by the use of delay-lines, aiming to improve the ability to identify long-term dependencies. The results show that by using delay-lines, B-RAAM has both primacy and recency.</p>
| Identifer | oai:union.ndltd.org:UPSALLA/oai:DiVA.org:his-1016 |
| Date | January 2005 |
| Creators | Eriksson, Timea |
| Publisher | University of Skövde, School of Humanities and Informatics, Skövde : Institutionen för kommunikation och information |
| Source Sets | DiVA Archive at Upsalla University |
| Language | English |
| Detected Language | English |
| Type | Student thesis, text |
Page generated in 0.0051 seconds