A Brief Overview of Practical Optimization Algorithms in the Context of Relaxation

摘要

Optimization is an indispensable part of machine learning. There have been various optimization algorithms, typically introduced independently in textbooks and scatter across vast materials, making the beginners hard to have a global picture. In this talk, by explaining how to relax some aspects of optimization procedures I will briefly introduce some practical optimization algorithms in a systematic way.