Adam Coates
My homepage has moved to: www.apcoates.com
Formerly: Director of the Silicon Valley AI Lab at Baidu.
Post-doctoral researcher at Stanford University in Computer Science.
Visiting Scholar: Indiana University, Bloomington in Informatics.
Research: Deep learning and feature learning; HPC systems for ML; Perception and vision; Reinforcement learning.
E-mail:
Twitter: @AdamPaulCoates
"Why a four year old child could understand this. Run out and get me a four year old child..." -- Groucho Marx

Quick links to projects/papers: Baidu Deep Voice,   Baidu Deep Speech,   DL on COTS HPC,   Stanford AI Robot (STAIR),   Stanford Autonomous Helicopter.


Selected Publications:
Deep Voice: Real-time Neural Text-to-Speech, Sercan Arik, Mike Chrzanowski, Adam Coates, Gregory Diamos, Andrew Gibiansky, Yongguo Kang, Xian Li, John Miller, Jonathan Raiman, Shubho Sengupta, Mohammad Shoeybi. Arxiv Pre-print: arxiv
Slides and code from DeepSpeech at the Bay Area DL School: Slides, Code.
Persistent RNNs: Stashing recurrent weights on-chip, Greg Diamos, Shubho Sengupta, Bryan Catanzaro, Mike Chrzanowski, Adam Coates, Erich Elsen, Jesse Engel, Awni Hannun, Sanjeev Satheesh. In ICML 2016 (PDF)
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin, Dario Amodei, Rishita Anubhai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse Engel, Linxi Fan, Christopher Fougner, Tony Han, Awni Hannun, Billy Jun, Patrick LeGresley, Libby Lin, Sharan Narang, Andrew Ng, Sherjil Ozair, Ryan Prenger, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Yi Wang, Zhiqian Wang, Chong Wang, Bo Xiao, Dani Yogatama, Jun Zhan, Zhenyao Zhu. Arxiv Pre-print: arxiv
An Empirical Evaluation of Deep Learning on Highway Driving, Brody Huval, Tao Wang, Sameep Tandon, Jeff Kiske, Will Song, Joel Pazhayampallil, Mykhaylo Andriluka, Pranav Rajpurkar, Toki Migimatsu, Royce Cheng-Yue, Fernando Mujica, Adam Coates, Andrew Y. Ng Arxiv Pre-print: arxiv
I was coorganizer of the Deep Learning Workshop at NIPS 2014.
Deep Learning with COTS HPC, Adam Coates, Brody Huval, Tao Wang, David J. Wu, Andrew Y. Ng and Bryan Catanzaro. In ICML 2013. (PDF)
Some mentions: Wired, CNET, Register.
Emergence of Object-Selective Features in Unsupervised Feature Learning, Adam Coates, Andrej Karpathy, and Andrew Y. Ng. In NIPS 2012. (PDF)
End-to-End Text Recognition with Convolutional Neural Networks, Tao Wang, David J. Wu, Adam Coates, and Andrew Y. Ng. In ICPR 2012. (PDF)
Learning Feature Representations with K-means, Adam Coates and Andrew Y. Ng. In Neural Networks: Tricks of the Trade, Reloaded, Springer LNCS, 2012. (PDF)
Additional references:
Barrow, H.G. "Learning receptive fields." Proceedings of the IEEE First Annual Conference on Neural Networks. Vol. 4. 1987.
Davies, M., and Mitianoudis, N. "Simple mixture model for sparse overcomplete ICA." IEEE Vision, Image and Signal Processing 151.1, 35-43, 2004. (PDF)
Hyvarinen, A. "Independent Component Analysis in the Presence of Gaussian Noise by Maximizing Joint Likelihood." Neurocomputing, 22:49-67, 1998. (PDF),
Demystifying Unsupervised Feature Learning, Adam Coates. PhD thesis. Stanford University (2012). (PDF)
Selecting Receptive Fields in Deep Networks, Adam Coates and Andrew Y. Ng. In NIPS 2011. (PDF)
The Importance of Encoding Versus Training with Sparse Coding and Vector Quantization, Adam Coates and Andrew Y. Ng. In ICML 28, 2011. (PS, PDF, Demo Code)
On Optimization Methods for Deep Learning, Quoc V. Le, Jiquan Ngiam, Adam Coates, Abhik Lahiri, Bobby Prochnow, Andrew Y. Ng. In ICML 28, 2011. (PDF)
Text Detection and Character Recognition in Scene Images with Unsupervised Feature Learning, Adam Coates, Blake Carpenter, Carl Case, Sanjeev Satheesh, Bipin Suresh, Tao Wang, David J. Wu, Andrew Y. Ng. To appear in ICDAR, 2011. (PDF) Best Student Paper Award
An Analysis of Single-Layer Networks in Unsupervised Feature Learning, Adam Coates, Honglak Lee, and Andrew Y. Ng. In AISTATS 14, 2011. (PDF, Demo Code, STL-10 dataset)
A previous version appeared in NIPS Workshop on Deep Learning and Unsupervised Feature Learning, 2010. (PDF)
Autonomous Sign Reading for Semantic Mapping, Carl Case, Bipin Suresh, Adam Coates and Andrew Y. Ng. In ICRA, 2011. (PDF)
Sub-meter Indoor Localization in Unmodified Environments with Inexpensive Sensors, Morgan Quigley, David Stavens, Adam Coates and Sebastian Thrun. In IROS 2010.   (PDF)
Multi-Camera Object Detection for Robotics, Adam Coates and Andrew Y. Ng. In ICRA 2010.   (PS, PDF)
Talk: Scalable Learning in Computer Vision, Adam Coates, Honglak Lee, Rajat Raina, and Andrew Y. Ng. At NIPS Workshops, 2009.   (PPTX, VideoLectures.net)
Scalable Learning for Object Detection with GPU Hardware, Adam Coates, Paul Baumstarck, Quoc Le, and Andrew Y. Ng. In IROS 2009.   (PS, PDF)

Helicopters:
Autonomous Helicopter Aerobatics through Apprenticeship Learning, Pieter Abbeel, Adam Coates, and Andrew Y. Ng.
In International Journal of Robotics Research (IJRR), Nov. 2010, vol. 29, no. 13, 1608-1639 (PDF, website).
Apprenticeship learning for helicopter control, Adam Coates, Pieter Abbeel, and Andrew Y. Ng. In Communications of the ACM; July 2009.   (ACM)
Learning for Control from Muliple Demonstrations, Adam Coates, Pieter Abbeel, and Andrew Y. Ng. In ICML 25, 2008.   (PDF  | PS)
Talk slides, Supplementary Material (Videos). Best Paper Award: Best Application
Autonomous Autorotation of an RC Helicopter, Pieter Abbeel, Adam Coates, and Andrew Y. Ng. In International Symposium on Experimental Robotics, 2008.   (PDF)
Supplementary Material (Videos).
Space-indexed Dynamic Programming: Learning to Follow Trajectories, Zico Kolter, Adam Coates, Andrew Y. Ng, Yi Gu, and Charles DuHadway. In ICML 25, 2008.   (PDF  | PS)
An Application of Reinforcement Learning to Aerobatic Helicopter Flight, Pieter Abbeel, Adam Coates, Morgan Quigley, and Andrew Y. Ng. In NIPS 19, 2007.   (PDF  | PS)
Discriminative training of Kalman filters, Pieter Abbeel, Adam Coates, Mike Montemerlo, Andrew Y. Ng and Sebastian Thrun. In Proceedings of Robotics: Science and Systems, 2005.   (PDF  | PS)
Autonomous Helicopter Tracking and Localization Using a Self-Calibrating Camera Array, Masa Matsuoka, Surya Singh, Alan Chen, Adam Coates, Andrew Y. Ng and Sebastian Thrun. In Proceedings of the Fifth International Conference on Field Service Robotics, 2005.   (PDF  | PS)
Inverted autonomous helicopter flight via reinforcement learning, Andrew Y. Ng, Adam Coates, Mark Diel, Varun Ganapathi, Jamie Schulte, Ben Tse, Eric Berger and Eric Liang. In International Symposium on Experimental Robotics, 2004.   (PDF  | PS)

"In theory there is no difference between theory and practice. In practice there is." -- Yogi Berra

STL-10 dataset
Handy code snippets