Thomas Kollar aka thomas kollar, tom kollar, tom, tkollar

Research Scientist

Work History

Amazon Inc.
Senior Scientist
Machine Learning and Natural Language Processing for Amazon Echo.

Amazon Inc.
Research Scientist
Machine Learning and Natural Language Processing for Amazon Echo

Apple Inc.
Research Scientist
Machine Learning and Natural Language Processing for Siri

Carnegie Mellon University
Postdoctoral Fellow
Grounded Language Understanding, Natural Language Processing, Machine Learning, Robotics, Artificial Intelligence

Massachusetts Institute of Technology
Graduate Student
Grounded Language Understanding, Natural Language Processing, Machine Learning, Robotics, Artificial Intelligence

University of Rochester
B.S. Computer Science; B.A. Mathematics

Show More ▼

About me

I am currently a senior research scientist in the robotics group at the Toyota Research Institute. I was previously a research scientist in Alexa Machine Learning working on natural language understanding. I was previously a Research Scientist at Apple Inc., developing algorithms for natural language processing and machine learning to improve the accuracy and performance of Siri.

Before industry, I was a Postdoctoral Fellow at Carnegie Mellon University, working at the intersection of perception, robotics, machine learning and natural language processing. I hold a Ph.D. and M.S. in Computer Science, both from MIT, a B.S. in Computer Science, with highest honors, from the University of Rochester, and a B.A. in Mathematics from the University of Rochester. I was general chair of the HRI Pioneers Workshop at the 6th ACM/IEEE International Conference on Human-Robot Interaction. As an undergraduate, I developed an hors d'oeuvre-serving robot to compete in the AAAI robotics competition. I am a member of IEEE, AAAI, and Sigma Xi.


Nicholas Roy, Stefanie Tellex, Felix Duvallet, Matt Walter, Sachi Hemachandra, Manuela Veloso, Jayant Krishnamurthy, Grant Strimel, Deb Roy, Mehdi Samadi, Daniele Nardi, Tony Stentz, Alvaro Soto, Seth Teller, Emma Brunskill Emma Strubell Vittorio Perera Tagyoung Chung

Selected Publications

Generalized Grounding Graphs: A Probabilistic Framework for Understanding Grounded Commands
Thomas Kollar, Stefanie Tellex, Matthew R. Walter, Albert Huang, Abraham Bachrach, Sachi Hemachandra, Emma Brunskill, Ashis Banerjee, Deb Roy, Seth Teller, Nicholas Roy
Submitted to JAIR, expected 2018 | pdf | arxiv

Multi-task learning for parsing the Alexa Meaning Representation Language
Vittorio Perera, Tagyoung Chung, Thomas Kollar, Emma Strubell
AAAI 2018 | pdf

Learning Task Knowledge from Dialog and Web Access
Vittorio Perera, Robin Soetens, Thomas Kollar, Mehdi Samadi, Yichao Sun, Daniele Nardi, Rene van de Molengraft, Manuela Veloso
Robotics, 2015 | pdf

Grounding Verbs of Motion in Natural Language Commands to Robots
Thomas Kollar, Stefanie Tellex, Deb Roy, Nicholas Roy
Experimental Robotics, 79:31-47, 2014 | pdf

Toward Interactive Grounded Language Acquisition
Thomas Kollar, Jayant Krishnamurthy and Grant Strimel
In Proceedings, Robotics: Science and Systems, 2013 | pdf

Jointly Learning to Parse and Perceive: Connecting Natural Language to the Physical World
Jayant Krishnamurthy and Thomas Kollar
Transactions of the Association for Computational Linguistics, 2013 | pdf

Imitation Learning for Natural Language Direction Following through Unknown Environments
Felix Duvallet, Thomas Kollar, Anthony Stentz
In Proceedings, International Conference on Robotics and Automation (ICRA) 2013 | pdf
Best Cognitive Robotics Paper Nominee

Clarifying Commands with Information-Theoretic Human-Robot Dialog
R. Deits, S. Tellex, P. Thaker, D. Simeonov, T. Kollar and N. Roy.
Journal of Human Robot Interaction, 2(2):58-79, 2013 | pdf

Indoor scene recognition by a mobile robot through adaptive object detection
P. Espinace, T. Kollar, N. Roy, A. Soto
Robots and Autonomous Systems, 61(9):932-947, 2013 | pdf

Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation
Thomas Kollar, Stefanie Tellex, Steven Dickerson, Matthew R. Walter, Ashis Gopal Banerjee, Seth Teller, Nicholas Roy
Proceedings of the National Conference on Artificial Intelligence (AAAI), 2011 | pdf
(25% acceptance)

Approaching the Symbol Grounding Problem with Probabilistic Graphical Models
S. Tellex, T. Kollar, S. Dickerson, M. R. Walter, A. G. Banerjee, S. Teller, and N. Roy
AI Magazine. 32(4):64-76, 2011 | pdf

Following and Interpreting Narrated Guided Tours
S. Hemachandra, T. Kollar, N. Roy and S. Teller
International Conference on Robotics and Automation (ICRA), 2011 | pdf

Grounding Spatial Language for Video Search
Stefanie Tellex, Thomas Kollar, George Shaw, Nicholas Roy and Deb Roy
Proceedings of the Twelfth International Conference on Multimodal Interfaces (ICMI), 2010 | pdf
Best Student Paper (44% acceptance; 25% for oral)

Toward Understanding Natural Language Directions
Thomas Kollar, Stefanie Tellex, Deb Roy, and Nick Roy
Proceedings of Human Robot Interaction Conference, 2010 | pdf
(21% acceptance)

Utilizing object-object and object-scene context when planning to find things
Thomas Kollar and Nick Roy
Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2009. | pdf

Trajectory Optimization using Reinforcement Learning for Map Exploration
Thomas Kollar and Nick Roy
International Journal of Robotics Research, 2008. | pdf


Learning to understand spatial language for robotic navigation and mobile manipulation
Thomas Kollar
Ph.D. thesis, Massachusetts Institute of Technology, 2011.



General: gmail

(mobile phone)
US: phone