Machine Learning Surveys
A curated list of Machine Learning related surveys, overviews and books.
If you want to contribute to this list (please do), check How to Contribute wiki or contact me @ML_Review.
Table of Contents
- Active Learning
- Bioinformatics
- Classification
- Clustering
- Computer Vision
- Deep Learning
- Dimensionality Reduction
- Ensemble Learning
- Metric Learning
- Monte Carlo
- Multi-Armed Bandit
- Multi-View Learning
- Natural Language Processing
- Physics
- Probabilistic Models
- Recommender Systems
- Reinforcement Learning
- Robotics
- Semi-Supervised Learning
- Submodular Functions
- Transfer Learning
- Unsupervised Learning
Active Learning
- Active Learning Literature Survey (2010) [B Settles] [67pp]
Bioinformatics
- Introduction to Bioinformatics (2013) [A Lesk] [255pp] 📚
- Bioinformatics - an Introduction for Computer Scientists (2004) [J Cohen] [37pp]
- Opportunities and Obstacles for Deep Learning in Biology and Medicine (2017) [T Ching, DS Himmelstein, BK Beaulieu-jones] [102pp]
Classification
- Supervised Machine Learning: A Review of Classification Techniques (2007) [SB Kotsiantis, I Zaharakis, P Pintelas] [20pp]
- Web Page Classification: Features and Algorithms (2009) [X Qi, BD Davison] [31pp]
Clustering
- Data Clustering: 50 Years Beyond K-Means (2010) [AK Jain] [16pp] ⭐
- A Tutorial on Spectral Clustering (2007) [U VON Luxburg] [32pp]
- Handbook of Blind Source Separation: Independent Component Analysis and Applications (2010) [P Comon, C Jutten] [65pp] 📚
- Survey of Clustering Algorithms (2005) [R Xu, D Wunsch] [34pp]
- A Survey of Clustering Data Mining Techniques (2006) [P Berkhin] [56pp]
- Clustering (2008) [R Xu, D Wunsch] [341pp] 📚
Computer Vision
- Pedestrian Detection: An Evaluation of the State of the Art (2012) [P Dollar, C Wojek, B Schiele] [19pp] ⭐
- Computer Vision: Algorithms and Applications (2010) [R Szeliski] [874pp] 📚 ⭐
- A Survey of Appearance Models in Visual Object Tracking (2013) [X Li] [42pp] ⭐
- Object Tracking: A Survey (2006) [A Yilmaz] [45pp]
- Head Pose Estimation in Computer Vision: A Survey (2009) [E Murphy-chutorian, MM Trivedi] [20pp]
- A Survey of Recent Advances in Face Detection (2010) [C Zhang, Z Zhang] [17pp]
- Monocular Model-Based 3d Tracking of Rigid Objects: A Survey (2005) [V Lepetit] [91pp]
- A Survey on Face Detection in the Wild: Past, Present and Future (2015) [S Zafeiriou, C Zhang, Z Zhang] [50pp]
- A Review on Deep Learning Techniques Applied to Semantic Segmentation (2017) [A Garcia-garcia, S Orts-escolano] [23pp]
- Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art (2017) [D Russo, B VAN Roy, A Kazerouni, I Osband] [67pp]
- Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art (2017) [J Janai, F Güney, A Behl, A Geiger] [14pp]
Deep Learning
- Deep Learning (2016) [IJ Goodfellow, Y Bengio, A Courville] [800pp] 📚 ⭐⭐
- Deep Learning in Neural Networks: An Overview (2015) [J Schmidhuber] [88pp] ⭐⭐
- Learning Deep Architectures for Ai (2009) [Y Bengio] [71pp] ⭐
- Tutorial on Variational Autoencoders (2016) [C Doersch] [65pp] ⭐
- Deep Reinforcement Learning: An Overview (2017) [ Y Li] [30pp]
- NIPS 2016 Tutorial: Generative Adversarial Networks (2016) [I Goodfellow] [57pp]
- Opportunities and Obstacles for Deep Learning in Biology and Medicine (2017) [T Ching, DS Himmelstein, BK Beaulieu-jones] [102pp]
- A Review on Deep Learning Techniques Applied to Semantic Segmentation (2017) [A Garcia-garcia, S Orts-escolano] [23pp]
- Deep Learning for Video Game Playing (2017) [N Justesen, P Bontrager, J Togelius, S Risi] [16pp]
- Deep Learning Techniques for Music Generation (2017) [JP Briot, G Hadjeres, F PACHET ] [108pp]
Dimensionality Reduction
- Dimensionality Reduction: A Comparative Review (2009) [L VAN DER Maaten, E Postma] [36pp]
- Dimension Reduction: A Guided Tour (2010) [CJC Burges] [64pp]
Ensemble Learning
- Ensemble Methods: Foundations and Algorithms (2012) [ZH Zhou] [234pp]
- Ensemble Approaches for Regression: A Survey (2012) [J Mendes-moreira, C Soares, AM Jorge] [40pp]
Metric Learning
- A Survey on Metric Learning for Feature Vectors and Structured Data (2014) [A Bellet] [59pp]
- Metric Learning: A Survey (2012) [B Kulis] [80pp]
Monte Carlo
- Geometric Integrators and the Hamiltonian Monte Carlo Method (2017) [N Bou-rabee, JM Sanz-serna] [92pp]
Multi-Armed Bandit
- Regret Analysis of Stochastic and Nonstochastic Multi-Armed Bandit Problems (2012) [S Bubeck, N Cesa-bianchi] [130pp] ⭐
- A Survey of Online Experiment Design With the Stochastic Multi-Armed Bandit (2015) [G Burtini, J Loeppky, R Lawrence] [49pp]
- A Tutorial on Thompson Sampling (2017) [D Russo, B VAN Roy, A Kazerouni, I Osband] [39pp]
Multi-View Learning
- A Survey on Multi-View Learning (2013) [C Xu] [59pp]
- A Survey of Multi-View Machine Learning (2013) [S Sun] [13pp]
Natural Language Processing
- A Primer on Neural Network Models for Natural Language Processing (2016) [Y Goldberg] [76pp] ⭐
- Probabilistic Topic Models (2012) [DM Blei] [16pp] ⭐
- Natural Language Processing (Almost) From Scratch (2011) [R Collobert] [45pp] ⭐
- Opinion Mining and Sentiment Analysis (2008) [B Pang, L Lee] [94pp] ⭐
- Survey of the State of the Art in Natural Language Generation: Core Tasks, Applications and Evaluation (2017) [A Gatt, E Krahmer] [111pp] ⭐
- Opinion Mining and Sentiment Analysis (2012) [B Liu, L Zhang] [38pp]
- Neural Machine Translation and Sequence-to-Sequence Models: A Tutorial (2017) [G Neubig] [65pp]
- Machine Learning in Automated Text Categorization (2002) [F Sebastiani] [55pp]
- Statistical Machine Translation (2009) [P Koehn] [149pp] 📚
- Statistical Machine Translation (2008) [A Lopez] [55pp]
- Machine Transliteration Survey (2011) [S Karimi, F Scholer, A Turpin] [46pp]
- Neural Machine Translation and Sequence-to-Sequence Models: A Tutorial (2017) [G Neubig] [57pp]
Physics
- Machine Learning & Artificial Intelligence in the Quantum Domain (2017) [V Dunjko, HJ Briegel] [106pp]
Probabilistic Models
- Graphical Models, Exponential Families, and Variational Inference (2008) [MJ Wainwright, MI Jordan] [305pp]
- An Introduction to Conditional Random Fields (2011) [C Sutton] [90pp]
- An Introduction to Conditional Random Fields for Relational Learning (2006) [C Sutton] [35pp]
- An Introduction to Mcmc for Machine Learning (2003) [C Andrieu, N DE Freitas, A Doucet, MI Jordan] [39pp]
- Introduction to Probability Models (2014) [SM Ross] [801pp] 📚
Recommender Systems
- Introduction to Recommender Systems Handbook (2011) [F Ricci, L Rokach, B Shapira] [845pp] 📚 ⭐
- Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions (2008) [G Adomavicius, A Tuzhilin] [43pp] ⭐
- Matrix Factorization Techniques for Recommender Systems (2009) [Y Koren, R Bell, C Volinsky] [8pp] ⭐
- A Survey of Collaborative Filtering Techniques (2009) [X Su, TM Khoshgoftaar] [20pp]
Reinforcement Learning
- Reinforcement Learning in Robotics: A Survey (2013) [J Kober, JA Bagnell, J Peterskober] [74pp] ⭐
- Deep Reinforcement Learning: An Overview (2017) [ Y Li] [30pp]
- Reinforcement Learning: An Introduction (2016) [RS Sutton, AG Barto] [398pp] 📚
- Bayesian Reinforcement Learning: A Survey (2016) [M Ghavamzadeh, S Mannor, J Pineau] [147pp]
- Reinforcement Learning: A Survey (1996) [LP Kaelbling, ML Littman, AW Moore] [49pp]
- Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art (2017) [J Janai, F Güney, A Behl, A Geiger] [14pp]
- Deep Learning for Video Game Playing (2017) [N Justesen, P Bontrager, J Togelius, S Risi] [16pp]
Robotics
- Reinforcement Learning in Robotics: A Survey (2013) [J Kober, JA Bagnell, J Peterskober] [74pp] ⭐
- A Survey of Robot Learning From Demonstration (2009) [BD Argall, S Chernova, M Veloso] [15pp]
Semi-Supervised Learning
- Semi-Supervised Learning Literature Survey (2008) [X Zhu] [59pp]
Submodular Functions
- Learning With Submodular Functions: A Convex Optimization Perspective (2013) [F Bach] [173pp]
- Submodular Function Maximization (2012) [A Krause, D Golovin] [28pp]
Transfer Learning
- A Survey on Transfer Learning (2010) [SJ Pan, Q Yang] [15pp] ⭐
- Transfer Learning for Reinforcement Learning Domains: A Survey (2009) [ME Taylor, P Stone] [53pp]
Unsupervised Learning
- Tutorial on Variational Autoencoders (2016) [C Doersch] [65pp] ⭐
