No Free Lunch
2017-06-02 10:17
260 查看
In machine learning, there’s something called the “No Free Lunch” theorem. In a nutshell, it states that no one algorithm works best for every problem, and it’s especially relevant for supervised learning (i.e. predictive modeling).
For example, you can’t say that neural networks are always better than decision trees or vice-versa. There are many factors at play, such as the size and structure of your dataset.
As a result, you should try many different algorithms
for your problem, while using a hold-out “test set” of data to evaluate performance and select the winner.
![](https://elitedatascience.com/wp-content/uploads/2017/05/no-free-lunch-cartoon.jpg)
Of course, the algorithms you try must be appropriate for your problem, which is where picking the right machine learning task comes in. As an analogy, if you need to clean your house, you might use a vacuum, a broom, or a mop, but you wouldn't
bust out a shovel and start digging.
For example, you can’t say that neural networks are always better than decision trees or vice-versa. There are many factors at play, such as the size and structure of your dataset.
As a result, you should try many different algorithms
for your problem, while using a hold-out “test set” of data to evaluate performance and select the winner.
![](https://elitedatascience.com/wp-content/uploads/2017/05/no-free-lunch-cartoon.jpg)
Of course, the algorithms you try must be appropriate for your problem, which is where picking the right machine learning task comes in. As an analogy, if you need to clean your house, you might use a vacuum, a broom, or a mop, but you wouldn't
bust out a shovel and start digging.
相关文章推荐
- No free lunch in search and optimization
- 没有免费的午餐定理 NFL:(No Free Lunch Theorem)
- no free lunch
- No Free Lunch 定理
- 没有免费的午餐理论 No Free Lunch Theorem
- 机器学习---“没有免费的午餐”(no free lunch)定理简单易懂的解释
- No Free Lunch
- 规模机器学习系统中的No Free Lunch | CCTC 2017 AI专场干货分享
- The “no-free-lunch” theorems
- Map Reduce - the Free Lunch is not over?
- CFree 提示no newline at the end of file
- K-means clustering is not a free lunch
- c语言,for循环中使用malloc和free出现运行错误:no source available...
- The Free Lunch Is Over: A Fundamental Turn Toward Concurrency in Software by Herb Sutter
- Map Reduce – the Free Lunch is not over?(转自Meng Yan ( 孟岩 )’s Weblog)
- 【转载】Free Lunch is Over(免费午餐已经结束了)
- Freeform Excel Worksheet (No OLE or EXCEL required)
- C-free提示warning: no newline at end of file
- 【转】最近值得推荐的两篇文章《Map Reduce - the Free Lunch is not over?》以及《函数式编程另类指南》
- 【原创翻译】The Free Lunch Is Over