User:TranslationTechGroup/LearningDeep

A collocation of resources for neural networks and deep learning.

Articles

 * Wikipedia article on neural networks
 * WikiBooks article on neural networks
 * blog article "Deep Learning, NLP, and Representations"

Academic/High Level

 * Coling 2014 - Tutorial on using neural networks for NLP by Tomáš Mikolov
 * NAACL 2013 - Deep Learning Tutorial by Richard Socher & Chris Manning

Brief Intros

 * Lisbon Machine Learning Summer School 2014

Coding/Hands-on

 * Code as you go Tutorial by LISA Lab (a brief intro/summary here)
 * Kaggle Challenge with BoW Word2Vec
 * Using convolutional neural nets to detect facial keypoints tutorial
 * Easy read and code exercises for NN and DL ("If you go through this entire book+code and you still don't understand about neural network and how it works, Liling owes you a beer.")

In-Depth

 * Unsupervised Feature learning and Deep Learning Resources by Andrew Ng's group at Stanford

Books

 * A Brief Introduction to Neural Networks by D. Kriesel, in both English and German. Everything you ever wanted to know about neural networks.
 * Deep Learning: Methods and Applications by Li Deng and Dong Yu at MSR
 * An Introduction to Statistical Learning, a general, gentle intro to machine learning
 * The Elements of Statistical Learning, a more in-depth book on machine learning
 * A Course in Machine Learning Hal Daumé III's Book to machine learning (cute hand-drawings)

Courses

 * Coursera - Neural Networks for Machine Learning by Geoffrey Hinton
 * Coursera - Machine Learning by Andrew Ng
 * Caltech - Machine Learning by Yaser Abu-Mostafa
 * Udacity - Artificial Intelligence by Peter Norvig and Sebastian Thrun
 * Udacity - Machine Learning by Charles Isbell and Michael Littman

Papers

 * "Sequence to Sequence Learning with Neural Networks", Sutskever et al., NIPS 2014. Authors apply a special kind of recurrent neural network (LSTM - Long Short-Term Memory) for machine translation. First author is a former PhD student of G. Hinton.
 * Is deep learning really necessary for word embeddings?
 * Deep Speech

Vectors

 * word2vec - Computes word vectors
 * GloVe - Computes word vectors

Language Models

 * Listing of several neural net language models, and other types of LMs as well

Neural Net Architecture

 * Lasagne

Machine Learning

 * Awesome Machine Learning - Words cannot comprehend, it's just awesome
 * Theano - Python optimization library

Applications

 * Neural Talk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.
 * NLP-Net Neural Net applications for POS and SRL