University of British Columbia
Towards implementing deep learning in analog hardware using forward mode predictive coding
Abstract
dc:descriptionThis thesis presents a learning framework that integrates predictive coding and forward mode gradient estimation to enable parallelizable local learning in neural networks – designed specifically for analog hardware implementation. Unlike backpropagation, which is optimized for digital architectures and relies on partial derivative transmission against the direction of inference, this method restructures the network into locally controlled units that compute updates in the forward direction, aligning naturally with feedback control. While forward mode gradients and predictive coding are not inherently faster than backpropagation on digital systems, the combination of the two is well-suited to analog circuits, which offer potential improvements in speed and efficiency. The novel algorithm can successfully learn nonlinear functions such as XOR and sequence prediction tasks by forecasting video frames. These results mark an important step toward building fully online, analog-learning systems capable of real-time adaptation.
Degree
thesis:*- Name thesis:degree_name
- Master of Applied Science - MASc
- Level thesis:degree_level
- master's
- Discipline thesis:degree_discipline
- Electrical and Computer Engineering
- Grantor dc:publisher
- University of British Columbia
- Year dc:date
- 2026
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Turek, Cedar Frederic
- Contributors dc:contributor
-
- Lemieux, Guy
- Wood, Frank D.
Rights
dc:rights- Statement dc:rights
-
- Attribution-NonCommercial-NoDerivatives 4.0 International
- Language dc:language
- eng
Identifiers
dc:identifier.*- Handle dc:identifier
- http://hdl.handle.net/2429/93497