
Dr. John Hale presented a poster on "Text Genre & Training Data Size in Human-Like Parsing" along with Adhiguna Kuncoro (DeepMind & Oxford), Keith B. Hall (Google NYC), Chris Dyer (DeepMind), and Jonathan Brennan (University of Michigan) at the 2019 Conference on Empirical Methods in Natural Language Processing in Hong Kong, November 3-7 2019.
Abstract: Domain-specific training typically makes NLP systems work better. We show that this extends to cognitive modeling as well by relating the states of a neural phrase-structure parser to electrophysiological measures from human participants. These measures were recorded as participants listened to a spoken recitation of the same literary text that was supplied as input to the neural parser. Given more training data, the system derives a better cognitive model –- but only when the training examples come from the same textual genre. This finding is consistent with the idea that humans adapt syntactic expectations to particular genres during language comprehension (Kaan and Chun, 2018; Branigan and Pickering, 2017).