Back to search

University of British Columbia

Investigation of different social agents in reinforcement learning for autonomous driving training in simulation

Abstract

dc:description

Automated driving has been pursued for more than fifty years, but with the widespread adoption of machine learning to train autonomous driving agents, simulators have begun to play an increasing role in the development and deployment of autonomous vehicles because they are not only faster, cheaper, and safer than physical experiments, but also more controllable, observable, and repeatable. In order to create realistic simulations, it is critical to have a good ``social agent'' to control the action of the other vehicles in the simulation. To date, however, no systematic comparison between different social agents has been performed. Here we describe a series of experiments which trained reinforcement learning (RL) agents in the SMARTS (Scalable Multi-Agent RL Training School) traffic simulation environment with three different social agents, and performed a comparison of the performance of the resulting RL agent. Along with SMARTS supported social agents SUMO (Simulation of Urban Mobility) and ZOO (provided by SMARTS), we integrated the DRIVE social agent (provided by Inverted AI) into the simulator for this study. The RL agents were trained and tested in six different task scenarios on five different maps. Overall, the experimental results show that RL agents trained in the environment with the DRIVE social agent performed more consistently on criteria including completion rate, collision rate and off-road rate, indicating DRIVE's heightened behavioral diversity and meaningful interactivity with the ego vehicle. We further conducted an analysis of some of the characteristics of the traffic generated by the different social agents: Traffic density, traffic speed and acceleration distribution, and average neighbor distance.

Degree

thesis:*
Name thesis:degree_name
Master of Science - MSc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Computer Science
Grantor dc:publisher
University of British Columbia
Year dc:date
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Tian, Yuan
Contributors dc:contributor
  • Mitchell, Ian M.

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/87226

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Tian, Yuan. Investigation of different social agents in reinforcement learning for autonomous driving training in simulation. master's thesis, University of British Columbia, 2023. http://hdl.handle.net/2429/87226