转载:Why machine learning algorithms are hard to tune and how to fix it

Posted Neo_DH

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了转载:Why machine learning algorithms are hard to tune and how to fix it相关的知识,希望对你有一定的参考价值。

Key point

  • We often optimize a Linear combinations of losses and hope to simultaneously reduce both \\(L_1\\) and \\(L_0\\) losses, but that this linear combination is actually precarious and treacherous.
  • Authours showed that when the pareto curve is concave, only one of these two losses was considered and this linear combination was valid in convex pareto curve.
  • In fact, We can\'t figure out the property of the pareto curve.
  • We can reformulate the linear combination losses as a constraint optimization problem, e.g., restricting \\(L_0\\leq \\epsilon\\)
  • By doing so, authors gave three possible solutions.

References

以上是关于转载:Why machine learning algorithms are hard to tune and how to fix it的主要内容,如果未能解决你的问题,请参考以下文章

Python Machine Learning

Machine Learning学习目录

Adaboost

COMPSCI 361 Machine Learning 重点解析

machine learning in action , part 1

Advice for students of machine learning--转