Distributed Representations for Arithmetic Word Problems

Sowmya Somasundaram, Deepak Padmanabhan, Savitha Sam Abraham

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We consider the task of learning distributed representations for arithmetic word problems. We outline the characteristics of the domain of arithmetic word problems that make generic text embedding methods inadequate, necessitating a specialized representation learning method to facilitate the task of retrieval across a wide range of use cases within online learning platforms. Our contribution is two-fold; first, we propose several ’operators’ that distil knowledge of the domain of arithmetic word problems and schemas into word problem transformations. Second, we propose a novel neural architecture that combines LSTMs with graph convolutional networks to leverage word problems and their operator-transformed versions to learn distributed representations for word problems. While our target is to ensure that the distributed representations are schema-aligned, we do not make use of schema labels in the learning process, thus yielding an unsupervised representation learning method. Through an evaluation on retrieval over a publicly available corpus of word problems, we illustrate that our framework is able to consistently improve upon contemporary generic text embeddings in terms of schema-alignment.
Original languageEnglish
Title of host publicationProceedings of the Thirty-Fourth AAAI International Conference on Artificial Intelligence (AAAI-20)
ISBN (Electronic) 978-1-57735-809-1
Publication statusAccepted - 11 Nov 2019
EventThe Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20) - New York, United States
Duration: 07 Feb 202012 Feb 2020
https://aaai.org/Conferences/AAAI-20/

Publication series

NameProceedings of the AAAI Conference on Artificial Intelligence (AAAI)
PublisherAAAI
ISSN (Print)2159-5399

Conference

ConferenceThe Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20)
Abbreviated titleAAAI-20
CountryUnited States
CityNew York
Period07/02/202012/02/2020
Internet address

Cite this

Somasundaram, S., Padmanabhan, D., & Sam Abraham, S. (Accepted/In press). Distributed Representations for Arithmetic Word Problems. In Proceedings of the Thirty-Fourth AAAI International Conference on Artificial Intelligence (AAAI-20) (Proceedings of the AAAI Conference on Artificial Intelligence (AAAI)).