Machine Learning ― A Practical Approach on the Statistical Learning Theory

This book presents the Statistical Learning Theory in a detailed and easy to understand way, by using practical examples, algorithms and source codes. It can be used as a textbook in graduation or undergraduation courses, for self-learners, or as reference with respect to the main theoretical concepts of Machine Learning. Fundamental concepts of Linear Algebra and Optimization applied to Machine Learning are provided, as well as source codes in R, making the book as self-contained as possible.

It starts with an introduction to Machine Learning concepts and algorithms such as the Perceptron, Multilayer Perceptron and the Distance-Weighted Nearest Neighbors with examples, in order to provide the necessary foundation so the reader is able to understand the Bias-Variance Dilemma, which is the central point of the Statistical Learning Theory.

Afterwards, we introduce all assumptions and formalize the Statistical Learning Theory, allowing the practical study of different classification algorithms. Then, we proceed with concentration inequalities until arriving to the Generalization and the Large-Margin bounds, providing the main motivations for the Support Vector Machines. 

From that, we introduce all necessary optimization concepts related to the implementation of Support Vector Machines. To provide a next stage of development, the book finishes with a discussion on SVM kernels as a way and motivation to study data spaces and improve classification results.

Rodrigo Fernandes de Mello is Associate Professor with the Department of Computer Science, at the Institute of Mathematics and Computer Sciences, University of Sao Paulo, Sao Carlos, SP, Brazil. He obtained his PhD degree from the University of Sao Paulo. His research interests include the Statistical Learning Theory, Machine Learning, Data Streams, and Applications in Dynamical Systems concepts. He has published more than 100 papers including journals and conferences, supported and organized international conferences, besides serving as Editor of International Journals.

Moacir Antonelli Ponti is Associate Professor with the Department of Computer Science, at the Institute of Mathematics and Computer Sciences, University of Sao Paulo, Sao Carlos, Brazil, and was visiting researcher at the Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey. He obtained his PhD from the Federal University of Sao Carlos. His research interests include Pattern Recognition and Computer Vision, as well as Signal, Image and Video Processing.