Me

I am a research scientist at Google. My research focuses on natural language understanding and machine learning. Prior to this, I completed my PhD at the University of Washington while working with Luke Zettlemoyer.

Publications

Neural Data Augmentation via Example Extrapolation
Kenton Lee*, Kelvin Guu*, Luheng He*, Tim Dozat*, Hyung Won Chung* * Equal contribution

CAPWAP: Captioning with a Purpose
Adam Fisch, Kenton Lee, Ming-Wei Chang, Jonathan H. Clark, Regina Barzilay
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020

Exploring Unexplored Generalization Challenges for Cross-Database Semantic Parsing
Alane Suhr, Ming-Wei Chang, Peter Shaw, Kenton Lee
In Proceedings of the Conference of Association for Computational Linguistics (ACL), 2020

Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering
Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
In Proceedings of the Conference of Association for Computational Linguistics (ACL), 2020

REALM: Retrieval-Augmented Language Model Pre-Training
Kelvin Guu,* Kenton Lee,* Zora Tung, Panupong Pasupat, Ming-Wei Chang * Equal contribution
In Proceedings of the International Conference on Machine Learning (ICML), 2020

Latent Retrieval for Weakly Supervised Open Domain Question Answering
Kenton Lee, Ming-Wei Chang, Kristina Toutanova
In Proceedings of the Conference of Association for Computational Linguistics (ACL), 2019
[bib]

Zero-Shot Entity Linking by Reading Entity Descriptions
Lajanugen Logeswaran, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, Jacob Devlin, Honglak Lee
In Proceedings of the Conference of Association for Computational Linguistics (ACL), 2019

BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions
Christopher Clark, Kenton Lee, Ming-Wei Chang, Tom Kwiatkowski, Michael Collins, Kristina Toutanova
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2019
[slides]

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2019 Best Paper Award
[code]

Natural Questions: a Benchmark for Question Answering Research
Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, Slav Petrov
In Transactions of the Association for Computational Linguistics (TACL), 2019

Syntactic Scaffolds for Semantic Structures
Swabha Swayamdipta, Sam Thomson, Kenton Lee, Luke Zettlemoyer, Chris Dyer, Noah A. Smith
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2018

Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling
Luheng He, Kenton Lee, Omer Levy, Luke Zettlemoyer
In Proceedings of the Conference of Association for Computational Linguistics (ACL), 2018
[code]

Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum
Omer Levy, Kenton Lee, Nicholas FitzGerald, Luke Zettlemoyer
In Proceedings of the Association for Computational Linguistic (ACL), 2018
[code]

Higher-order Coreference Resolution with Coarse-to-fine Inference
Kenton Lee, Luheng He, Luke Zettlemoyer
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2018
[code] [bib] [slides]

Deep Contextualized Word Representations
Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, Luke Zettlemoyer
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2018 Best Paper Award
[bib]

End-to-end Neural Coreference Resolution
Kenton Lee, Luheng He, Mike Lewis, Luke Zettlemoyer
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2017
[code] [bib] [slides]

Deep Semantic Role Labeling: What Works and What's Next
Luheng He, Kenton Lee, Mike Lewis, Luke Zettlemoyer
In Proceedings of the Association for Computational Linguistic (ACL), 2017
[code] [bib]

Learning Recurrent Span Representations for Extractive Question Answering
Kenton Lee, Shimi Salant, Tom Kwiatkowski, Ankur Parikh, Dipanjan Das, Jonathan Berant
[code]

Global Neural CCG Parsing with Optimality Guarantees
Kenton Lee, Mike Lewis, Luke Zettlemoyer
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2016 Best Paper Award
[code] [bib] [slides]

LSTM CCG Parsing
Mike Lewis, Kenton Lee, Luke Zettlemoyer
In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2016
[code] [bib]

Broad-coverage CCG Semantic Parsing with AMR
Yoav Artzi, Kenton Lee, Luke Zettlemoyer
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2015 Best Paper Award
[code] [bib] [supplementary material] [slides]

Event Detection and Factuality Assessment with Non-Expert Supervision
Kenton Lee, Yoav Artzi, Yejin Choi, Luke Zettlemoyer
In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2015
[bib] [data] [poster] [slides]

Programming by Demonstration with Situated Semantic Parsing (Extended abstract)
Yoav Artzi, Maxwell Forbes, Kenton Lee, Maya Cakmak
In Artificial Intelligence and Human-Robot Interaction AAAI Fall Symposium, 2014

Context-dependent Semantic Parsing for Time Expressions
Kenton Lee, Yoav Artzi, Jesse Dodge, Luke Zettlemoyer
In Proceedings of the Association for Computational Linguistic (ACL), 2014
[demo] [code] [tool] [slides] [bib]

Sorry Dave, I’m Afraid I Can’t Do That: Explaining Unachievable Robot Tasks Using Natural Language
Vasumathi Raman, Constantine Lignos, Cameron Finucane, Kenton Lee, Mitch Marcus, Hadas Kress-Gazit
In Robotics: Science and Systems (RSS), 2013

Legibility and Predictability of Robot Motion
Anca D. Dragan, Kenton Lee, Siddhartha S. Srinivasa
In ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2013

Legible User Input for Intent Prediction (Late-breaking report)
Kenton Lee, Anca D. Dragan, Siddhartha S. Srinivasa
In ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2013

Teleoperation with Intelligent and Customizable Interfaces
Anca D. Dragan, Kenton Lee, Siddhartha S. Srinivasa
In Journal of Human-Robot Interaction (JHRI), 2013

SP4: Scalable Programmable Packet Processing Platform (Demonstration)
Harjot Gill, Dong Lin, Lohi Sarna, Robert Mead, Kenton Lee, Boon Thau Loo
In ACM SIGCOMM Conference on Data Communication, 2012