With a special focus on the theory and mathematical aspects, this graduate textbook introduces a wide range of methods and algorithms for machine learning and pattern recognition. By comparing different algorithms and their respective strengths and efficiencies, the reader gains insights into the mathematical intricacies and which algorithm is suitable for his specific application.