H2O.ai初步使用
1.官网下载最新稳定版,https://www.h2o.ai/download/ ,如果点击下载无反应,请使用ie浏览器
2.解压h2o-3.18.0.10.zip到目录h2o-3.18.0.10
3.执行命令
cd h2o-3.18.0.10
java -jar h2o.jar -name clusterName
选项参考http://docs.h2o.ai/h2o/latest-stable/h2o-docs/starting-h2o.html#h2o-options
[root@eureka- h2o-3.18.0.10]# java -jar h2o.jar -name clusterName
- ::43.010 192.168.0.80: main INFO: Found XGBoost backend with library: xgboost4j_gpu
- ::43.020 192.168.0.80: main INFO: XGBoost supported backends: [WITH_GPU, WITH_OMP]
- ::43.020 192.168.0.80: main INFO: ----- H2O started -----
- ::43.020 192.168.0.80: main INFO: Build git branch: rel-wolpert
- ::43.020 192.168.0.80: main INFO: Build git hash: b26ef10d0f1b4dd26b8227c1672ee47e0e893fec
- ::43.020 192.168.0.80: main INFO: Build git describe: jenkins-3.18.0.9--gb26ef10
- ::43.021 192.168.0.80: main INFO: Build age: days, hours and minutes
- ::43.021 192.168.0.80: main INFO: Built by: 'jenkins'
- ::43.021 192.168.0.80: main INFO: Built on: '2018-05-22 08:13:35'
- ::43.021 192.168.0.80: main INFO: Watchdog Build git branch: (unknown)
- ::43.021 192.168.0.80: main INFO: Watchdog Build git hash: (unknown)
- ::43.021 192.168.0.80: main INFO: Watchdog Build git describe: (unknown)
- ::43.021 192.168.0.80: main INFO: Watchdog Build project version: (unknown)
- ::43.021 192.168.0.80: main INFO: Watchdog Built by: (unknown)
- ::43.021 192.168.0.80: main INFO: Watchdog Built on: (unknown)
- ::43.021 192.168.0.80: main INFO: XGBoost Build git branch: (unknown)
- ::43.022 192.168.0.80: main INFO: XGBoost Build git hash: (unknown)
- ::43.022 192.168.0.80: main INFO: XGBoost Build git describe: (unknown)
- ::43.022 192.168.0.80: main INFO: XGBoost Build project version: (unknown)
- ::43.022 192.168.0.80: main INFO: XGBoost Built by: (unknown)
- ::43.022 192.168.0.80: main INFO: XGBoost Built on: (unknown)
- ::43.022 192.168.0.80: main INFO: KrbStandalone Build git branch: (unknown)
- ::43.022 192.168.0.80: main INFO: KrbStandalone Build git hash: (unknown)
- ::43.022 192.168.0.80: main INFO: KrbStandalone Build git describe: (unknown)
- ::43.022 192.168.0.80: main INFO: KrbStandalone Build project version: (unknown)
- ::43.022 192.168.0.80: main INFO: KrbStandalone Built by: (unknown)
- ::43.023 192.168.0.80: main INFO: KrbStandalone Built on: (unknown)
- ::43.023 192.168.0.80: main INFO: Processed H2O arguments: [-name, clusterName]
- ::43.023 192.168.0.80: main INFO: Java availableProcessors:
- ::43.023 192.168.0.80: main INFO: Java heap totalMemory: 964.5 MB
- ::43.023 192.168.0.80: main INFO: Java heap maxMemory: 13.95 GB
- ::43.023 192.168.0.80: main INFO: Java version: Java 1.8.0_121 (from Oracle Corporation)
- ::43.023 192.168.0.80: main INFO: JVM launch parameters: []
- ::43.023 192.168.0.80: main INFO: OS version: Linux 3.10.-.el7.x86_64 (amd64)
- ::43.023 192.168.0.80: main INFO: Machine physical memory: 62.76 GB
- ::43.023 192.168.0.80: main INFO: X-h2o-cluster-id:
- ::43.023 192.168.0.80: main INFO: User name: 'root'
- ::43.023 192.168.0.80: main INFO: IPv6 stack selected: false
- ::43.024 192.168.0.80: main INFO: Possible IP Address: ens160 (ens160), fe80::::df23:d65d:4aa8:62f5%ens160
- ::43.024 192.168.0.80: main INFO: Possible IP Address: ens160 (ens160), 192.168.0.80
- ::43.024 192.168.0.80: main INFO: Possible IP Address: lo (lo), :::::::%lo
- ::43.024 192.168.0.80: main INFO: Possible IP Address: lo (lo), 127.0.0.1
- ::43.024 192.168.0.80: main INFO: H2O node running in unencrypted mode.
- ::43.026 192.168.0.80: main INFO: Internal communication uses port:
- ::43.026 192.168.0.80: main INFO: Listening for HTTP and REST traffic on http://192.168.0.80:54321/
- ::43.027 192.168.0.80: main INFO: H2O cloud name: 'clusterName' on /192.168.0.80:, static configuration based on -flatfile null
- ::43.027 192.168.0.80: main INFO: If you have trouble connecting, try SSH tunneling from your local machine (e.g., via port ):
- ::43.027 192.168.0.80: main INFO: . Open a terminal and run 'ssh -L 55555:localhost:54321 root@192.168.0.80'
- ::43.027 192.168.0.80: main INFO: . Point your browser to http://localhost:55555
- ::43.735 192.168.0.80: main INFO: Log dir: '/tmp/h2o-root/h2ologs'
- ::43.736 192.168.0.80: main INFO: Cur dir: '/opt/software/h2o-3.18.0.10'
- ::43.740 192.168.0.80: main INFO: HDFS subsystem successfully initialized
- ::43.743 192.168.0.80: main INFO: S3 subsystem successfully initialized
- ::43.743 192.168.0.80: main INFO: Flow dir: '/root/h2oflows'
- ::43.757 192.168.0.80: main INFO: Cloud of size formed [/192.168.0.80:]
- ::43.770 192.168.0.80: main INFO: Registered parsers: [GUESS, ARFF, XLS, SVMLight, AVRO, PARQUET, CSV]
- ::43.770 192.168.0.80: main INFO: Watchdog extension initialized
- ::43.770 192.168.0.80: main INFO: XGBoost extension initialized
- ::43.770 192.168.0.80: main INFO: KrbStandalone extension initialized
- ::43.770 192.168.0.80: main INFO: Registered core extensions in: 256ms
- ::43.770 192.168.0.80: main INFO: Registered H2O core extensions: [Watchdog, XGBoost, KrbStandalone]
- ::44.035 192.168.0.80: main INFO: Registered: REST APIs in: 264ms
- ::44.035 192.168.0.80: main INFO: Registered REST API extensions: [XGBoost, Algos, AutoML, Core V3, Core V4]
- ::44.149 192.168.0.80: main INFO: Registered: schemas in 113ms
- ::44.150 192.168.0.80: main INFO: H2O started in 1691ms
- ::44.150 192.168.0.80: main INFO:
- ::44.150 192.168.0.80: main INFO: Open H2O Flow in your web browser: http://192.168.0.80:54321
- ::44.150 192.168.0.80: main INFO:
4.找另一台机器或者重新打开一个shell命令窗口,再次输入命令
java -jar h2o.jar -name clusterName
会自动根据-name选项查找存在的集群
- ::22.648 192.168.0.166: main INFO: Found XGBoost backend with library: xgboost4j_gpu
- ::22.661 192.168.0.166: main INFO: XGBoost supported backends: [WITH_GPU, WITH_OMP]
- ::22.661 192.168.0.166: main INFO: ----- H2O started -----
- ::22.661 192.168.0.166: main INFO: Build git branch: rel-wolpert
- ::22.661 192.168.0.166: main INFO: Build git hash: b26ef10d0f1b4dd26b8227c1672ee47e0e893fec
- ::22.661 192.168.0.166: main INFO: Build git describe: jenkins-3.18.0.9--gb26ef10
- ::22.661 192.168.0.166: main INFO: Build age: days, hours and minutes
- ::22.661 192.168.0.166: main INFO: Built by: 'jenkins'
- ::22.662 192.168.0.166: main INFO: Built on: '2018-05-22 08:13:35'
- ::22.662 192.168.0.166: main INFO: Watchdog Build git branch: (unknown)
- ::22.662 192.168.0.166: main INFO: Watchdog Build git hash: (unknown)
- ::22.662 192.168.0.166: main INFO: Watchdog Build git describe: (unknown)
- ::22.662 192.168.0.166: main INFO: Watchdog Build project version: (unknown)
- ::22.662 192.168.0.166: main INFO: Watchdog Built by: (unknown)
- ::22.662 192.168.0.166: main INFO: Watchdog Built on: (unknown)
- ::22.662 192.168.0.166: main INFO: XGBoost Build git branch: (unknown)
- ::22.662 192.168.0.166: main INFO: XGBoost Build git hash: (unknown)
- ::22.663 192.168.0.166: main INFO: XGBoost Build git describe: (unknown)
- ::22.663 192.168.0.166: main INFO: XGBoost Build project version: (unknown)
- ::22.663 192.168.0.166: main INFO: XGBoost Built by: (unknown)
- ::22.663 192.168.0.166: main INFO: XGBoost Built on: (unknown)
- ::22.663 192.168.0.166: main INFO: KrbStandalone Build git branch: (unknown)
- ::22.663 192.168.0.166: main INFO: KrbStandalone Build git hash: (unknown)
- ::22.663 192.168.0.166: main INFO: KrbStandalone Build git describe: (unknown)
- ::22.663 192.168.0.166: main INFO: KrbStandalone Build project version: (unknown)
- ::22.663 192.168.0.166: main INFO: KrbStandalone Built by: (unknown)
- ::22.664 192.168.0.166: main INFO: KrbStandalone Built on: (unknown)
- ::22.664 192.168.0.166: main INFO: Processed H2O arguments: [-name, clusterName]
- ::22.664 192.168.0.166: main INFO: Java availableProcessors:
- ::22.664 192.168.0.166: main INFO: Java heap totalMemory: 88.5 MB
- ::22.664 192.168.0.166: main INFO: Java heap maxMemory: 1.27 GB
- ::22.664 192.168.0.166: main INFO: Java version: Java 1.8.0_77 (from Oracle Corporation)
- ::22.664 192.168.0.166: main INFO: JVM launch parameters: []
- ::22.664 192.168.0.166: main INFO: OS version: Linux 2.6.-.el6.x86_64 (amd64)
- ::22.664 192.168.0.166: main INFO: Machine physical memory: 5.72 GB
- ::22.665 192.168.0.166: main INFO: X-h2o-cluster-id:
- ::22.665 192.168.0.166: main INFO: User name: 'root'
- ::22.665 192.168.0.166: main INFO: IPv6 stack selected: false
- ::22.665 192.168.0.166: main INFO: Possible IP Address: eth1 (eth1), fe80::::20c:29ff:fe29:d906%eth1
- ::22.665 192.168.0.166: main INFO: Possible IP Address: eth1 (eth1), 192.168.0.166
- ::22.665 192.168.0.166: main INFO: Possible IP Address: lo (lo), :::::::%lo
- ::22.665 192.168.0.166: main INFO: Possible IP Address: lo (lo), 127.0.0.1
- ::22.665 192.168.0.166: main INFO: H2O node running in unencrypted mode.
- ::22.668 192.168.0.166: main INFO: Internal communication uses port:
- ::22.668 192.168.0.166: main INFO: Listening for HTTP and REST traffic on http://192.168.0.166:54323/
- ::22.669 192.168.0.166: main INFO: H2O cloud name: 'clusterName' on /192.168.0.166:, static configuration based on -flatfile null
- ::22.669 192.168.0.166: main INFO: If you have trouble connecting, try SSH tunneling from your local machine (e.g., via port ):
- ::22.669 192.168.0.166: main INFO: . Open a terminal and run 'ssh -L 55555:localhost:54323 root@192.168.0.166'
- ::22.669 192.168.0.166: main INFO: . Point your browser to http://localhost:55555
- ::23.457 192.168.0.166: main INFO: Log dir: '/tmp/h2o-root/h2ologs'
- ::23.458 192.168.0.166: main INFO: Cur dir: '/opt/software'
- ::23.462 192.168.0.166: main INFO: HDFS subsystem successfully initialized
- ::23.466 192.168.0.166: main INFO: S3 subsystem successfully initialized
- ::23.466 192.168.0.166: main INFO: Flow dir: '/root/h2oflows'
- ::23.481 192.168.0.166: main INFO: Cloud of size formed [/192.168.0.166:]
- ::23.518 192.168.0.166: main INFO: Registered parsers: [GUESS, ARFF, XLS, SVMLight, AVRO, PARQUET, CSV]
- ::23.519 192.168.0.166: main INFO: Watchdog extension initialized
- ::23.519 192.168.0.166: main INFO: XGBoost extension initialized
- ::23.519 192.168.0.166: main INFO: KrbStandalone extension initialized
- ::23.519 192.168.0.166: main INFO: Registered core extensions in: 269ms
- ::23.519 192.168.0.166: main INFO: Registered H2O core extensions: [Watchdog, XGBoost, KrbStandalone]
- ::23.972 192.168.0.166: main INFO: Registered: REST APIs in: 452ms
- ::23.980 192.168.0.166: main INFO: Registered REST API extensions: [XGBoost, Algos, AutoML, Core V3, Core V4]
- ::24.391 192.168.0.166: main INFO: Registered: schemas in 410ms
- ::24.391 192.168.0.166: main INFO: H2O started in 2369ms
- ::24.391 192.168.0.166: main INFO:
- ::24.400 192.168.0.166: main INFO: Open H2O Flow in your web browser: http://192.168.0.166:54323
- ::24.400 192.168.0.166: main INFO:
- ::26.961 192.168.0.166: FJ-- INFO: Cloud of size formed [/192.168.0.80:, /192.168.0.166:]
5. 打开浏览器,输入网址
http://192.168.0.166:54323
会看到h2o的flow ui界面
6. 页面使用
6.1数据导入
选择左侧帮助部分的导入数据,importFiles
页面下方会显示出导入数据的界面,在search文本框上输入服务器上文件的路径,点击右侧的搜索按钮,页面会列出所有查到到的文件。然后点击Add all,没问题后点击import按钮
6.2 导入本地客户端数据
如果服务器上不存在要分析的文件,你可以选择上传自己的文件
6.3 解析导入的数据
如果你页面刷新了或者页面数据太乱了,你可以在getFrames里找到你刚才导入的数据集
找到我们刚才导入的数据集,点击parse按钮,
你可以自己输入列名,选择数据类型及其他修改,最后点击parse完成数据集的格式处理
点击上图中的view按钮,会显示下图,然后点击下图中的view data,会进行数据预览
数据预览查看:
parse完数据之后,你会发现数据集的扩展名已经由我们的.csv转为.hex,刷新一下页面,点击getFrames,
6.4 拆分数据集,
点击进入数据集,点击split按钮,
选择输入拆分比例,会拆分成多个数据集
6.5创建模型
点击顶菜单的'model -- k-meas'
选择算法,这里选择k-means,输入训练集training_frame和验证集validation_frame,或调整其他参数。
点击底部的create model按钮,会生成一个job,
点击view按钮,可查看模型的详细情况,如下图。
点击预测predict按钮,会显示下图,选择要预测的数据集,点击预测按钮即可查看结果。
H2O.ai初步使用的更多相关文章
- [GPU] Install H2O.ai
一.前言 主页:https://www.h2o.ai/products/h2o4gpu/ GPU版本安装:h2oai/h2o4gpu 采用GPU,能否成为超越下面链接中实验的存在? [ML] LIBS ...
- H2O Driverless AI
H2O Driverless AI(H2O无驱动人工智能平台)是一个自动化的机器学习平台,它给你一个有着丰富经验的“数据科学家之盒”来完成你的算法. 使AI技术得到大规模应用 各地的企业都意识到人工智 ...
- AI - H2O - 第一个示例
1 - Iris数据集 Iris数据集是常用的机器学习分类实验数据集,特点是数据量很小,可以快速学习. 数据集包含150个数据集,分为3类,每类50个数据,每个数据包含4个属性. Sepal.Leng ...
- 2018 AI产业界大盘点
2018 AI产业界大盘点 大事件盘点 “ 1.24——Facebook人工智能部门负责人Yann LeCun宣布卸任 Facebook人工智能研究部门(FAIR)的负责人Yann LeCun宣布卸 ...
- 2018年终总结之AI领域开源框架汇总
2018年终总结之AI领域开源框架汇总 [稍显活跃的第一季度] 2018.3.04——OpenAI公布 “后见之明经验复现(Hindsight Experience Reply, HER)”的开源算法 ...
- H2O 网址
使用pysparking的一个例子 http://docs.h2o.ai/h2o-tutorials/latest-stable/tutorials/sparkling-water/index.htm ...
- H2O 笔记之安装
参考资料: 了解H2O:http://h2o-release.s3.amazonaws.com/h2o/rel-turchin/9/docs-website/h2o-docs/index.html 安 ...
- AI 也开源:50 大开源 AI 项目 (转)
这些开源AI项目专注于机器学习.深度学习.神经网络及其他应用场合. 自IT界早期以来,研制出能像人类那样“思考”的机器一直是研究人员的一大目标.在过去几年,计算机科学家们在人工智能(AI)领域已取得了 ...
- 时间序列分析工具箱—— h2o + timetk
目录 时间序列分析工具箱-- h2o + timetk h2o 的用途 加载包 安装 h2o 加载包 数据 教程:h2o + timetk,时间序列机器学习 时间序列机器学习 最终的胜利者是... 翻 ...
随机推荐
- 学习 python 编写规范 pep8 的问题笔记
决定开始Python之路了,利用业余时间,争取更深入学习Python.编程语言不是艺术,而是工作或者说是工具,所以整理并遵循一套编码规范是十分必要的.所以今天下午我根据PEP 8整理了一份,以后都照此 ...
- pam和sasl
这几天使用在Postfix搭建一个Webmail的平台,用户认证这一块最终使用了PAM.想整理一下思路,让自己对PAM有个更加清晰的认识. 1. PAM的简介 PAM全称是:Pluggabl ...
- java中调用操作系统的命令
java.lang.Runtime类提供了exec() 方法来执行操作系统的命令. 使用静态的Runtime.getRuntime()方法可以获得当前的java应用程序对应的Runtime类的实例 R ...
- C# SignalR 即时通讯 聊天室
一.SignalR简介 SignalR:当所连接的客户端变得可用时服务器代码可以立即向其推送内容,而不是让服务器等待客户端请求新的数据.实现实时服务器与客户端通信.是一个开源.NET 库生成需要实时用 ...
- [Log]ASP.NET之HttpModule 事件执行顺序
ASP.Net下的HttpModule是基于事件的处理模型,这使得我们在选择事件监听和处理的时候有更多选择.下面是对HttpModule有关事件被触发的监测: 有关代码如下 using System; ...
- dhroid - ioc基础(@Inject*)
1 ioc即控制反转.控制反转(Inversion of Control,英文缩写为IoC)是一个重要的面向对象编程的法则来削减计算机程序的耦合问题,也是轻量级的Spring框架的核心.控制反转还有一 ...
- java的HashMap 原理
https://www.cnblogs.com/chengxiao/p/6059914.html 哈希表(hash table)也叫散列表,是一种非常重要的数据结构,应用场景及其丰富,许多缓存技术(比 ...
- 'cmd' 不是内部或外部命令,也不是可运行的程序 或批处理文件.
添加path内容: %SystemRoot%\system32; %SystemRoot%; %SystemRoot%\System32\Wbem;
- Deplearning.AI-吴恩达【中文课后作业】
[吴恩达课后作业目录] 课程 周数 名称 类型 语言 地址 课程1 - 神经网络和深度学习 第1周 深度学习简介 测验 中英 传送门 无编程作业 编程作业 —— —— 第2周 神经网络基础 测验 中英 ...
- Docker 学习应用篇之二: Docker的介绍和安装
之前说过Docker的好处,Docker可以集装箱化的部署应用程序.那么Docker是通过什么实现的呢.要理解Docker内部构建,需要先理解Docker的四种部件 1)images:镜像,docke ...