TY - CONF
T1 - Representation of Word Meaning in the Intermediate Projection Layer of a Neural Language Model
AU - Derby, Steven
AU - Miller, Paul
AU - Murphy, Brian
AU - Devereux, Barry
PY - 2019/6/29
Y1 - 2019/6/29
N2 - In this work, we evaluate latent semantic knowledge present in the LSTM activation patterns produced before and after the word of interest. We evaluate whether these activations predict human similarity ratings, human-derived property knowledge, and brain imaging data. In this way, we test the model{'}s ability to encode important semantic information relevant to word prediction, and it{'}s relationship with human cognitive semantic representations.
AB - In this work, we evaluate latent semantic knowledge present in the LSTM activation patterns produced before and after the word of interest. We evaluate whether these activations predict human similarity ratings, human-derived property knowledge, and brain imaging data. In this way, we test the model{'}s ability to encode important semantic information relevant to word prediction, and it{'}s relationship with human cognitive semantic representations.
UR - http://www.mendeley.com/research/representation-word-meaning-intermediate-projection-layer-neural-language-model
UR - http://www.mendeley.com/research/representation-word-meaning-intermediate-projection-layer-neural-language-model
U2 - 10.18653/v1/w18-5449
DO - 10.18653/v1/w18-5449
M3 - Paper
ER -