Hyperparameters in Machine Learning
2016-09-13 10:41
260 查看
In machine learning, we use the term hyperparameter to distinguish from standard model parameters. So, it is worth to first understand what those are.
So, how are hyperparameters decided? That is probably beyond the scope of this question, but suffice to say that, broadly speaking, this is done by setting different values for those hyperparameters, training different models, and deciding which ones work best by testing them.
So, to summarize. Hyperparameters:
Define higher level concepts about the model such as complexity, or capacity to learn.
Cannot be learned directly from the data in the standard model training process and need to be predefined.
Can be decided by setting different values, training different models, and choosing the values that test better
Number of leaves or depth of a tree
Number of latent factors in a matrix factorization
Learning rate (in many models)
Number of hidden layers in a deep neural network
Number of clusters in a k-means clustering
Standard Parameters
A machine learning model is the definition of a mathematical formula with a number of parameters that need to be learned from the data. That is the crux of machine learning: fitting a model to the data. This is done through a process known as model training. In other words, by training a model with existing data, we are able to fit the model parameters.Hyperparameters
However, there is another kind of parameters that cannot be directly learned from the regular training process. These parameters express “higher-level” properties of the model such as its complexity or how fast it should learn. They are called hyperparameters. Hyperparameters are usually fixed before the actual training process begins.So, how are hyperparameters decided? That is probably beyond the scope of this question, but suffice to say that, broadly speaking, this is done by setting different values for those hyperparameters, training different models, and deciding which ones work best by testing them.
So, to summarize. Hyperparameters:
Define higher level concepts about the model such as complexity, or capacity to learn.
Cannot be learned directly from the data in the standard model training process and need to be predefined.
Can be decided by setting different values, training different models, and choosing the values that test better
Some Examples
Some examples of hyperparameters:Number of leaves or depth of a tree
Number of latent factors in a matrix factorization
Learning rate (in many models)
Number of hidden layers in a deep neural network
Number of clusters in a k-means clustering
Give a Practical Examples
Reference
https://www.quora.com/What-are-hyperparameters-in-machine-learning相关文章推荐
- What are hyperparameters in machine learning?
- 机器学习中的超参数(Hyperparameters in machine learning)
- Machine Learning in Action 学习笔记-(2)kNN k近邻算法
- machine learning in action 之一 —— 环境配置
- 《Neural Network and Deep Learning》学习笔记-hyper-parameters
- MachineLearningInAction
- How to set up Hyper-V virtual machine in Windows 2012R2
- How To Load CSV Machine Learning Data in Weka (如何在Weka中加载CSV机器学习数据)
- 《Machine Learning in&…
- Machine Learning in Gradient Descent
- Machine learning in 10 pictures
- Machine Learning in Action 学习笔记-(1)
- (转)8 Tactics to Combat Imbalanced Classes in Your Machine Learning Dataset
- Machine Learning in R for beginners
- 《MachineLearningInAction》之绘制决策树
- machine learning in coding(python):pandas数据包DataFrame数据结构简介
- scikit-learn: machine learning in Python系列(一)
- 《Machine Learning in Action》 读书笔记之一:K近邻分类器算法
- Passing Multiple Parameters in NavigateURL Property of Hyperlink
- Introducing: Machine Learning in R(转)