转载:Why machine learning algorithms are hard to tune and how to fix it
Posted Neo_DH
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了转载:Why machine learning algorithms are hard to tune and how to fix it相关的知识,希望对你有一定的参考价值。
Key point
- We often optimize a Linear combinations of losses and hope to simultaneously reduce both \\(L_1\\) and \\(L_0\\) losses, but that this linear combination is actually precarious and treacherous.
- Authours showed that when the pareto curve is concave, only one of these two losses was considered and this linear combination was valid in convex pareto curve.
- In fact, We can\'t figure out the property of the pareto curve.
- We can reformulate the linear combination losses as a constraint optimization problem, e.g., restricting \\(L_0\\leq \\epsilon\\)
- By doing so, authors gave three possible solutions.
References
以上是关于转载:Why machine learning algorithms are hard to tune and how to fix it的主要内容,如果未能解决你的问题,请参考以下文章
COMPSCI 361 Machine Learning 重点解析