Back to search

Georgia Institute of Technology

Interpretation, grounding and imagination for machine intelligence

Abstract

dc:description.abstract

Understanding how to model computer vision and natural language jointly is a long-standing challenge in artificial intelligence. In this thesis, I study how modeling vision and language using semantic and pragmatic considerations can help derive more human-like inferences from machine learning models. Specifically, I consider three related problems: interpretation, grounding and imagination. In interpretation, the goal is to get machine learning models to understand an image and describe its contents using natural language in a contextually relevant manner. In grounding, I study how to connect natural language to referents in the physical world, and understand if this can help learn common sense. Finally, in imagination, I study how to ‘imagine’ visual concepts completely and accurately across the full range and (potentially unseen) compositions of their visual attributes. This thesis analyzes these problems from computational as well as algorithmic perspectives and suggests exciting directions for future work.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Interactive Computing
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2018

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Vedantam, Shanmukha Ramak
Advisor dc:contributor.advisor
  • Parikh, Devi
Committee members dc:contributor.committeemember
  • Batra, Dhruv
  • Eisenstein, Jacob
  • Zitnick, C Lawrence
  • Murphy, Kevin

Subjects

dc:subject × 3

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/60799

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Vedantam, Shanmukha Ramak. Interpretation, grounding and imagination for machine intelligence. Doctoral thesis, Georgia Institute of Technology, 2018. http://hdl.handle.net/1853/60799