Emergent Predication Structure in Hidden State Vectors of Neural Readers

11/23/2016
by   Hai Wang, et al.
0

A significant number of neural architectures for reading comprehension have recently been developed and evaluated on large cloze-style datasets. We present experiments supporting the emergence of "predication structure" in the hidden state vectors of these readers. More specifically, we provide evidence that the hidden state vectors represent atomic formulas Φ[c] where Φ is a semantic property (predicate) and c is a constant symbol entity identifier.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset