Regularization and model selection
2018-03-04 19:36
447 查看
Suppose we are trying select among several different models for a learning problem.For instance, we might be using a polynomial regression model hθ(x) = g(θ0 + θ1x + θ2x2 + · · · + θkxk ),and wish to decide if k should be 0, 1, . . . , or 10. How can we automatically select a model that represents a good tradeoff between the twin evils of bias and variance?Alternatively, suppose we want to automatically choose the bandwidth parameter τ for locally weighted regression, or the parameter C for our l1-regularized SVM. How can we do that?
假设我们正在努力为某个学习问题从几个不同的模型做选择。例如,我们可能正在使用一种多项式回归模型hθ(x) = g(θ0 + θ1x + θ2x2 + · · · + θkxk ),并且希望决定k是应该为0,1,...,或者10。那么我们怎么自动选择一个好的模型从而实现偏差和过拟合之间好的权衡?或者,假设我们想为自动为局部加权回归选择带宽参数τ,或者为我们的l1-正规化SVM选择参数C。我们怎么做到这一点呢?
For the sake of concreteness, in these notes we assume we have some finite set of models M = {M1, . . . , Md} that we’re trying to select among. For instance, in our first example above, the model Mi would be an i-th order polynomial regression model. (The generalization to infinite M is not hard.2 )
为了具体地考虑,在这些笔记中我们假设我们有一些有限的模型M={M1,...,Md},我们要从中选择。
假设我们正在努力为某个学习问题从几个不同的模型做选择。例如,我们可能正在使用一种多项式回归模型hθ(x) = g(θ0 + θ1x + θ2x2 + · · · + θkxk ),并且希望决定k是应该为0,1,...,或者10。那么我们怎么自动选择一个好的模型从而实现偏差和过拟合之间好的权衡?或者,假设我们想为自动为局部加权回归选择带宽参数τ,或者为我们的l1-正规化SVM选择参数C。我们怎么做到这一点呢?
For the sake of concreteness, in these notes we assume we have some finite set of models M = {M1, . . . , Md} that we’re trying to select among. For instance, in our first example above, the model Mi would be an i-th order polynomial regression model. (The generalization to infinite M is not hard.2 )
为了具体地考虑,在这些笔记中我们假设我们有一些有限的模型M={M1,...,Md},我们要从中选择。
相关文章推荐
- 规则化和模型选择(Regularization and model selection)
- 规则化和模型选择(Regularization and model selection)
- 规则化和模型选择Regularization and model selection
- 规则化和模型选择(Regularization and model selection)
- 规则化和模型选择(Regularization and model selection)
- Andrew Ng机器学习公开课笔记 -- Regularization and Model Selection
- 规则化和模型选择(Regularization and model selection)
- 正规化和模型选择(Regularization and model selection)
- 【机器学习-斯坦福】学习笔记9 规则化和模型选择(Regularization and model selection)
- 规则化和模型选择(Regularization and model selection)
- 正则化和模型选择(Regularization and model selection)
- 规则化和模型选择(Regularization and model selection)
- 规则化和模型选择(Regularization and model selection)
- 规则化和模型选择(Regularization and model selection)
- 模型评估与选择(Model Evaluation and Selection)
- issue4:model selection in frequentist and Bayesian
- 2.9 Model Selection and the Bias–Variance Tradeoff
- 机器学习 4 model selection and feature selection
- Spark2 Model selection and tuning 模型选择与调优
- Model selection and tuning 模型选择与调优