AutoML相关论文
本文为Awesome-AutoML-Papers的译文。
1、AutoML简介
Machine Learning几年来取得的不少可观的成绩,越来越多的学科都依赖于它。然而,这些成果都很大程度上取决于人类机器学习专家来完成如下工作:
- 数据预处理 Preprocess the data
- 选择合适的特征 Select appropriate features
- 选择合适的模型族 Select an appropriate model family
- 优化模型参数 Optimize model hyperparameters
- 模型后处理 Postprocess machine learning models
- 分析结果 Critically analyze the results obtained
随着大多数任务的复杂度都远超非机器学习专家的能力范畴,机器学习应用的不断增长使得人们对现成的机器学习方法有了极大的需求。因为这些现成的机器学习方法使用简单,并且不需要专业知识。我们将由此产生的研究领域称为机器学习的逐步自动化。
AutoML借鉴了机器学习的很多知识,主要包括:
- 贝叶斯优化 Bayesian optimization
- 结构化数据的大数据的回归模型 Regression models for structured data and big data
- 元学习 Meta learning
- 迁移学习 Transfer learning
- 组合优化 Combinatorial optimization.
2、目录
- Papers
- Tutorials
- Articles
- Slides
- Books
- Projects
- Prominent Researchers
Papers
Automated Feature Engineering
Expand Reduce
- 2017 | AutoLearn — Automated Feature Generation and Selection | Ambika Kaul, et al. | ICDM |
PDF
- 2017 | One button machine for automating feature engineering in relational databases | Hoang Thanh Lam, et al. | arXiv |
PDF
- 2016 | Automating Feature Engineering | Udayan Khurana, et al. | NIPS |
PDF
- 2016 | ExploreKit: Automatic Feature Generation and Selection | Gilad Katz, et al. | ICDM |
PDF
- 2015 | Deep Feature Synthesis: Towards Automating Data Science Endeavors | James Max Kanter, Kalyan Veeramachaneni | DSAA |
PDF
- 2017 | AutoLearn — Automated Feature Generation and Selection | Ambika Kaul, et al. | ICDM |
Hierarchical Organization of Transformations
- 2016 | Cognito: Automated Feature Engineering for Supervised Learning | Udayan Khurana, et al. | ICDMW |
PDF
- 2016 | Cognito: Automated Feature Engineering for Supervised Learning | Udayan Khurana, et al. | ICDMW |
Meta Learning
- 2017 | Learning Feature Engineering for Classification | Fatemeh Nargesian, et al. | IJCAI |
PDF
- 2017 | Learning Feature Engineering for Classification | Fatemeh Nargesian, et al. | IJCAI |
Reinforcement Learning
Evolutionary Algorithms
Local Search
- 2017 | Simple and Efficient Architecture Search for Convolutional Neural Networks | Thomoas Elsken, et al. | ICLR |
PDF
- 2017 | Simple and Efficient Architecture Search for Convolutional Neural Networks | Thomoas Elsken, et al. | ICLR |
Meta Learning
- 2016 | Learning to Optimize | Ke Li, Jitendra Malik | arXiv |
PDF
- 2016 | Learning to Optimize | Ke Li, Jitendra Malik | arXiv |
Reinforcement Learning
Transfer Learning
2017 | Learning Transferable Architectures for Scalable Image Recognition | Barret Zoph, et al. | arXiv |
PDF
Frameworks
- 2017 | Google Vizier: A Service for Black-Box Optimization | Daniel Golovin, et al. | KDD |
PDF
- 2017 | ATM: A Distributed, Collaborative, Scalable System for Automated Machine Learning | T. Swearingen, et al. | IEEE |
PDF
2015 | AutoCompete: A Framework for Machine Learning Competitions | Abhishek Thakur, et al. | ICML |
PDF
Hyperparameter Optimization
Bayesian Optimization
- 2016 | Bayesian Optimization with Robust Bayesian Neural Networks | Jost Tobias Springenberg, et al. | NIPS |
PDF
- 2016 | Scalable Hyperparameter Optimization with Products of Gaussian Process Experts | Nicolas Schilling, et al. | PKDD |
PDF
- 2016 | Taking the Human Out of the Loop: A Review of Bayesian Optimization | Bobak Shahriari, et al. | IEEE |
PDF
- 2016 | Towards Automatically-Tuned Neural Networks | Hector Mendoza, et al. | JMLR |
PDF
- 2016 | Two-Stage Transfer Surrogate Model for Automatic Hyperparameter Optimization | Martin Wistuba, et al. | PKDD |
PDF
- 2015 | Efficient and Robust Automated Machine Learning |
PDF
- 2015 | Hyperparameter Optimization with Factorized Multilayer Perceptrons | Nicolas Schilling, et al. | PKDD |
PDF
- 2015 | Hyperparameter Search Space Pruning - A New Component for Sequential Model-Based Hyperparameter Optimization | Martin Wistua, et al. |
PDF
- 2015 | Joint Model Choice and Hyperparameter Optimization with Factorized Multilayer Perceptrons | Nicolas Schilling, et al. | ICTAI |
PDF
- 2015 | Learning Hyperparameter Optimization Initializations | Martin Wistuba, et al. | DSAA |
PDF
- 2015 | Scalable Bayesian optimization using deep neural networks | Jasper Snoek, et al. | ACM |
PDF
- 2015 | Sequential Model-free Hyperparameter Tuning | Martin Wistuba, et al. | ICDM |
PDF
- 2013 | Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms |
PDF
- 2013 | Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures | J. Bergstra | JMLR |
PDF
- 2012 | Practical Bayesian Optimization of Machine Learning Algorithms |
PDF
- 2011 | Sequential Model-Based Optimization for General Algorithm Configuration(extended version) |
PDF
- 2016 | Bayesian Optimization with Robust Bayesian Neural Networks | Jost Tobias Springenberg, et al. | NIPS |
Evolutionary Algorithms
Lipschitz Functions
- 2017 | Global Optimization of Lipschitz functions | C´edric Malherbe, Nicolas Vayatis | arXiv |
PDF
- 2017 | Global Optimization of Lipschitz functions | C´edric Malherbe, Nicolas Vayatis | arXiv |
Local Search
- 2009 | ParamILS: An Automatic Algorithm Configuration Framework | Frank Hutter, et al. | JAIR |
PDF
- 2009 | ParamILS: An Automatic Algorithm Configuration Framework | Frank Hutter, et al. | JAIR |
Meta Learning
- 2008 | Cross-Disciplinary Perspectives on Meta-Learning for Algorithm Selection |
PDF
- 2008 | Cross-Disciplinary Perspectives on Meta-Learning for Algorithm Selection |
Particle Swarm Optimization
- 2017 | Particle Swarm Optimization for Hyper-parameter Selection in Deep Neural Networks | Pablo Ribalta Lorenzo, et al. | GECCO |
PDF
- 2008 | Particle Swarm Optimization for Parameter Determination and Feature Selection of Support Vector Machines | Shih-Wei Lin, et al. | Expert Systems with Applications |
PDF
- 2017 | Particle Swarm Optimization for Hyper-parameter Selection in Deep Neural Networks | Pablo Ribalta Lorenzo, et al. | GECCO |
Random Search
Transfer Learning
- 2016 | Efficient Transfer Learning Method for Automatic Hyperparameter Tuning | Dani Yogatama, Gideon Mann | JMLR |
PDF
- 2016 | Flexible Transfer Learning Framework for Bayesian Optimisation | Tinu Theckel Joy, et al. | PAKDD |
PDF
- 2016 | Hyperparameter Optimization Machines | Martin Wistuba, et al. | DSAA |
PDF
2013 | Collaborative Hyperparameter Tuning | R´emi Bardenet, et al. | ICML |
PDF
Miscellaneous
- 2016 | Efficient Transfer Learning Method for Automatic Hyperparameter Tuning | Dani Yogatama, Gideon Mann | JMLR |
- 2018 | Accelerating Neural Architecture Search using Performance Prediction | Bowen Baker, et al. | ICLR |
PDF
2017 | Automatic Frankensteining: Creating Complex Ensembles Autonomously | Martin Wistuba, et al. | SIAM |
PDF
Tutorials
Bayesian Optimization
2010 | A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning |
PDF
Meta Learning
2008 | Metalearning - A Tutorial |
PDF
Articles
Bayesian Optimization
2016 | Bayesian Optimization for Hyperparameter Tuning |
Link
Meta Learning
- 2017 | Why Meta-learning is Crucial for Further Advances of Artificial Intelligence? |
Link
2017 | Learning to learn |
Link
Slides
Automated Feature Engineering
Automated Feature Engineering for Predictive Modeling | Udyan Khurana, etc al. |
PDF
Hyperparameter Optimization
Bayesian Optimization
- Bayesian Optimisation |
PDF
A Tutorial on Bayesian Optimization for Machine Learning |
PDF
Books
Meta Learning
- 2009 | Metalearning - Applications to Data Mining | Springer |
PDF
Projects
- Advisor |
Python
|Open Source
|Code
- auto-sklearn |
Python
|Open Source
|Code
- Auto-WEKA |
Java
|Open Source
|Code
- Hyperopt |
Python
|Open Source
|Code
- Hyperopt-sklearn |
Python
|Open Source
|Code
- SigOpt |
Python
|Commercial
|Link
- SMAC3 |
Python
|Open Source
|Code
- RoBO |
Python
|Open Source
|Code
- BayesianOptimization |
Python
|Open Source
|Code
- Scikit-Optimize |
Python
|Open Source
|Code
- HyperBand |
Python
|Open Source
|Code
- BayesOpt |
C++
|Open Source
|Code
- Optunity |
Python
|Open Source
|Code
- TPOT |
Python
|Open Source
|Code
- ATM |
Python
|Open Source
|Code
- Cloud AutoML |
Python
|Commercial
|Link
- H2O |
Python
|Commercial
|Link
- DataRobot |
Python
|Commercial
|Link
- MLJAR |
Python
|Commercial
|Link
- MateLabs |
Python
|Commercial
|Link
AutoML相关论文的更多相关文章
- 【转载】 AutoML相关论文
原文地址: https://www.cnblogs.com/marsggbo/p/9308518.html ---------------------------------------------- ...
- Kintinuous 相关论文 Volume Fusion 详解
近几个月研读了不少RGBD-SLAM的相关论文,Whelan的Volume Fusion系列文章的效果确实不错,而且开源代码Kintinuous结构清晰,易于编译和运行,故把一些学习时自己的理解和经验 ...
- sketch 相关论文
sketch 相关论文 Sketch Simplification We present a novel technique to simplify sketch drawings based on ...
- Neural ODE相关论文摘要翻译
*****仅供个人学习记录***** Neural Ordinary Differential Equations[2019] 论文地址:[1806.07366] Neural Ordinary Di ...
- ACL2016信息抽取与知识图谱相关论文掠影
实体关系推理与知识图谱补全 Unsupervised Person Slot Filling based on Graph Mining 作者:Dian Yu, Heng Ji 机构:Computer ...
- SDN网络虚拟化、资源映射等相关论文粗读
1. Control Plane Latency with SDN Network Hypervisors: The Cost of Virtualization 年份:2016 来源:IEEE NE ...
- 带状态论文粗读(三)[引用openstate的相关论文阅读]
一 文章名称:FLOWGUARD: Building Robust Firewalls for Software-Defined Networks 发表时间:2014 期刊来源:--- 解决问题: 一 ...
- 2017年研究生数学建模D题(前景目标检测)相关论文与实验结果
一直都想参加下数学建模,通过几个月培训学到一些好的数学思想和方法,今年终于有时间有机会有队友一起参加了研究生数模,but,为啥今年说不培训直接参加国赛,泪目~_~~,然后比赛前也基本没看,直接硬刚.比 ...
- MR 图像分割 相关论文摘要整理
<多分辨率水平集算法的乳腺MR图像分割> 针对乳腺 MR 图像信息量大.灰度不均匀.边界模糊.难分割的特点, 提出一种多分辨率水平集乳腺 MR图像分割算法. 算法的核心是首先利用小波多尺度 ...
随机推荐
- java面试题整理(3)
1.Spring有哪些优点? 轻量级:Spring在大小和透明性方面绝对属于轻量级的,基础版本的Spring框架大约只有2MB. 控制反转(IOC):Spring使用控制反转技术实现了松耦合.依赖被注 ...
- LightOJ - 1074 Extended Traffic(标记负环)
题意:有n个城市,每一个城市有一个拥挤度ai,从一个城市u到另一个城市v的时间为:(au-av)^3,存在负环.问从第一个城市到达第k个城市所话的时间,如果不能到达,或者时间小于3输出?否则输出所花的 ...
- 解决jupyter中无自己创建的虚拟环境
最近看的教程都是用的jupyter,按理说都一样吧,但是pycharm中python有的模块就弃用了,而jupyter却都可以用,而且jupyter听说也不错,就配置了一下下 1.打开cmd,激活你的 ...
- Red Hat 6.3 下安装 nginx-1.7.4
一.安装准备 在Redhat系统下,没有CentOS那样使用yum安装依赖包等,所以接下来主要记录一下如何一步一步安装Nginx相关的依赖库. 下面就正式安装,由于安装Nginx需要依赖gcc-c++ ...
- 一不小心用oracle关键子创建了表,如何修改
一不小心将备注字段建成了ORACLE的关键子COMMENT. 用下面的语句修改成NOTES ------------------------------------------------------ ...
- Sublime Text3—系统设置
摘要 软件的设置分为系统设置和快捷键设置两项,这次分享系统设置,Sublime Text3-自带快捷键介绍前面已分享过. 正文 菜单依次选择Preferences | Settings,我们修改设置不 ...
- ( 大数 startsWith substring) Exponentiation hdu1063
Exponentiation Time Limit: 2000/500 MS (Java/Others) Memory Limit: 65536/32768 K (Java/Others) To ...
- tcp的4次挥手、三次握手
1. TCP短连接模拟一种TCP短连接的情况:1. client 向 server 发起连接请求2. server 接到请求,双⽅建⽴连接3. client 向 server 发送消息4. serve ...
- Cookie浅谈
相信大家对Cookie多多少少都有点了解吧~~下面我来谈谈吧: 每个Cookie不超过4K数据,每个网站不超过20个Cookie,所有网站的Cookie总和不超过300个 虽然cookie已经是上世纪 ...
- promise用法详解
es6的promise可谓是异步书写的一大福音,过去异步js书写是函数嵌套函数的方式,promise出现后书写异步js代码就变得美观得多了 以前的写法:回调函数不停嵌套 ajax('/banners' ...