Back to search

University of British Columbia

Offloading embedding lookups to processing-in-memory for deep learning recommender models

Abstract

dc:description

Recommender systems are an essential part of many industries and businesses. Generating accurate recommendations is critical for user engagement and business revenue. Currently, deep learning recommender models are commonly used, but they face challenges in processing and representing categorical data, which is a significant portion of the data used by these models. Embedding layers are often used to handle these complications by storing the numerical representation of different categories of a feature in a reduced vector space. Vectors representing all the categories of a feature in the reduced vector space will be stored in a tabular structure named embedding table. The operation of fetching the vector representation of a category from the embedding table and pooling them is called embedding lookup. However, embedding lookups have large memory footprints and require high memory bandwidth, leading to high latency and low throughput. We have developed a new system called PIM-Rec to address these challenges by using the first commercially available Processing-In-Memory (PIM) capable DRAM modules for embedding lookups. PIM-Rec is the first system to use such DRAM modules, and it has shown an 80% decrease in end-to-end inference cycle latency and an 80% increase in latency-bound throughput compared to the standard CPU-only implementation. PIM DRAM modules are a good candidate for handling embedding lookups, especially with the recent drastic size increase of embedding tables. Although PIM-Rec faced obstacles, it offers a realistic solution and analysis while discovering the obstacles and projecting them. This new system provides a promising solution for improving the efficiency of recommender systems and reducing the load they incur in data centers.

Degree

thesis:*
Name thesis:degree_name
Master of Applied Science - MASc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Electrical and Computer Engineering
Grantor dc:publisher
University of British Columbia
Year dc:date
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zarif, Niloofar
Contributors dc:contributor
  • Fedorova, Alexandra

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/85552

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Zarif, Niloofar. Offloading embedding lookups to processing-in-memory for deep learning recommender models. master's thesis, University of British Columbia, 2023. http://hdl.handle.net/2429/85552