Linux下面kettle的部署
一直以来服务器是linux系统,但是感觉linux图形化不强,于是从接触kettle以来都是在windows系统操作ETL的设计和处理。现在需要在linux中查看一下kettle资源库是否连接正常,以及在linux上调度kettle的job,就需要在Linux上配置kettle环境了。
登陆-linux-(切换到kettle部署的用户下面)
第一:产看系统的java环境,cat .bash_profile 文件
从上面可以看到,在cognos用户下已经安装了java jdk,版本是1.6.0_20,我们看一下kettle的最低版本要求,编辑查看spoon.bat可以看到
java的版本需求为1.6.0_17,cognos用户下的jdk版本在此之上,说明java环境已经符合。
第二:上传文件,开始部署
1. 将data-integration.zip上传到linux服务器(利用SSH将解压过的整个文件夹上传也可以)
2. 使用unzip命令解压data-integration.zip unzip data-integration.zip -d "/mnt/kettle"(如果上传的是文件夹,忽略此步骤)
3.进入解压目录,找到./kitchen.sh
键入./kitchen.sh,看输入信息
BASH:/ kitchen.sh的:权限被拒绝
从上面可以看出kitchen.sh缺少执行权限,我们再次进入看看文件盒文件夹的权限
从上面可以看出,此目录下面的.sh文件都没有执行权限(X),接下来我们给这个文件夹下面的所有.sh文件赋执行的权限
由上面的我们可以看出,赋权成功!
再次./kitchen.sh,回车 看输出信息--
可以看到上面出现 -rep,-user,-pass 这些kettle中的帮助信息,说明kettle部署成功!
第三:调出spoon界面
在windows系统上面是执行spoon.bat 同理在linux系统上面执行spoon.sh调出spoon的界面进行开发。
执行./spoon.sh,查看信息
这里说一下,调出spoon界面需要linux客户端支持图形化服务。我们这里采用的是SecureCRT_CN,只支持命令后台。这个时候就需要用tvnviewer,需要在linux服务端装tvnviewer服务端。
在命令客户端执行:vncserver 打开vnc服务
从上面的信息可以看出,服务已经启动,我们可以登陆tvnviewer
登陆成功 --
在终端执行调出spoon界面的命令!执行 xhost +(xhost + 是使所有用户都能访问Xserver.)
OK ,所有host用户都可以访问图形服务了。
进入目录,执行spoon.sh
弹出下面的信息
解决上面的问题,jdk已经没问题了到网上搜了一下
http://forums.pentaho.com/archive/index.php/t-93893.html thanks 这位兄弟给出此方法
从英文的大概可以看出来是需要编辑.kettle目录下的一个文件,于是发现linux上面cognos根目录下没有.kettle文件
于是从window上面把C:\Users\Administrator\.kettle中的文件.spoonrc.kettle编辑修改
保存,然后把.kettle整个文件夹赋值到cognos根目录下,查看是否存在(使用 ls -a显示所有对象,因为.XX的对象默认是隐藏的)
再次执行./spoon.sh
[cognos@bitic data-integration]$ ./spoon.sh
/home/cognos/pdi-ce-4.2.0-stable/data-integration
INFO 11-11 14:56:34,164 - Spoon - Logging goes to file:///tmp/spoon_66d28e63-4a9e-11e3-a301-7b09d1d32e5b.log
INFO 11-11 14:56:35,641 - Logging to org.slf4j.impl.JCLLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO 11-11 14:56:35,646 - class org.pentaho.agilebi.platform.JettyServer - WebServer.Log.CreateListener localhost:10000
INFO 11-11 14:56:35,647 - jetty-6.1.21
INFO 11-11 14:56:35,703 - NO JSP Support for /pentaho, did not find org.apache.jasper.servlet.JspServlet
INFO 11-11 14:56:39,221 - Initializing Spring root WebApplicationContext
INFO 11-11 14:56:39,221 - Root WebApplicationContext: initialization started
INFO 11-11 14:56:39,242 - Refreshing org.pentaho.platform.web.http.context.PentahoSolutionSpringApplicationContext@e73783: display name [Root WebApplicationContext]; startup date [Mon Nov 11 14:56:39 CST 2013]; root of context hierarchy
INFO 11-11 14:56:39,271 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/pentaho-spring-beans.xml]
INFO 11-11 14:56:39,285 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/pentahoSystemConfig.xml]
INFO 11-11 14:56:39,298 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/adminPlugins.xml]
INFO 11-11 14:56:39,305 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/systemListeners.xml]
INFO 11-11 14:56:39,310 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/sessionStartupActions.xml]
INFO 11-11 14:56:39,316 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/applicationContext-spring-security.xml]
INFO 11-11 14:56:39,331 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/applicationContext-common-authorization.xml]
INFO 11-11 14:56:39,336 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/applicationContext-spring-security-memory.xml]
INFO 11-11 14:56:39,343 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/applicationContext-pentaho-security-memory.xml]
INFO 11-11 14:56:39,351 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/pentahoObjects.spring.xml]
INFO 11-11 14:56:39,527 - Bean factory for application context [org.pentaho.platform.web.http.context.PentahoSolutionSpringApplicationContext@e73783]: org.springframework.beans.factory.support.DefaultListableBeanFactory@da52a1
INFO 11-11 14:56:39,607 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@da52a1: defining beans [systemSettingsService,org.pentaho.platform.engine.core.system.SpringPentahoSystemProxy#0,administrationPluginsList,systemListenersList,sessionStartupActionsList,filterChainProxy,authenticationManager,loggerListener,basicProcessingFilter,basicProcessingFilterEntryPoint,requestParameterProcessingFilter,requestParameterProcessingFilterEntryPoint,pentahoSecurityStartupFilter,anonymousProcessingFilter,anonymousAuthenticationProvider,httpSessionContextIntegrationFilter,logoutFilter,securityContextHolderAwareRequestFilter,httpSessionReuseDetectionFilter,exceptionTranslationFilter,authenticationProcessingFilter,authenticationProcessingFilterEntryPoint,httpRequestAccessDecisionManager,filterInvocationInterceptor,roleVoter,daoAuthenticationProvider,userDetailsService,userMap,userMapFactoryBean,passwordEncoder,userRoleListEnhancedUserMapFactoryBean,inMemoryUserRoleListService,pentahoUserRoleListService,ISolutionEngine,ISolutionRepository,ISolutionRepositoryService,IContentRepository,IAuditEntry,IUITemplater,file,vfs-ftp,contentrepo,IAclPublisher,IAclVoter,IVersionHelper,ICacheManager,IConditionalExecution,IMessageFormatter,IDatasourceService,IPasswordService,IPluginProvider,IPluginManager,IPluginResourceLoader,IMenuProvider,IServiceManager,ITempFileDeleter,gwtServiceManager,IChartBeansGenerator,systemStartupSession,connection-SQL,connection-MDX,connection-XML,connection-HQL,IThemeManager]; root of factory hierarchy
INFO 11-11 14:56:39,687 - Adding user [org.springframework.security.userdetails.User@c24ef000: Username: suzy; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, cto, is]
INFO 11-11 14:56:39,688 - Adding user [org.springframework.security.userdetails.User@e9f02600: Username: pat; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, dev]
INFO 11-11 14:56:39,688 - Adding user [org.springframework.security.userdetails.User@7ba0e400: Username: joe; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Admin, Authenticated, User, ceo]
INFO 11-11 14:56:39,688 - Adding user [org.springframework.security.userdetails.User@6a247400: Username: tiffany; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, dev, devmgr]
INFO 11-11 14:56:39,745 - Validated configuration attributes
INFO 11-11 14:56:39,749 - Adding user [org.springframework.security.userdetails.User@c24ef000: Username: suzy; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, cto, is]
INFO 11-11 14:56:39,749 - Adding user [org.springframework.security.userdetails.User@e9f02600: Username: pat; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, dev]
INFO 11-11 14:56:39,749 - Adding user [org.springframework.security.userdetails.User@7ba0e400: Username: joe; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Admin, Authenticated, User, ceo]
INFO 11-11 14:56:39,749 - Adding user [org.springframework.security.userdetails.User@6a247400: Username: tiffany; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, dev, devmgr]
INFO 11-11 14:56:39,761 - Root WebApplicationContext: initialization completed in 539 ms
INFO 11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IRuntimeRepository
INFO 11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for ISubscriptionScheduler
INFO 11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for ISubscriptionRepository
INFO 11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IUserFilesComponent
INFO 11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IBackgroundExecution
INFO 11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IScheduler
INFO 11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for INavigationComponent
INFO 11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IUserSettingService
INFO 11-11 14:56:39,810 - Mondrian: properties loaded from 'file:/home/cognos/pdi-ce-4.2.0-stable/data-integration/libext/mondrian/config/mondrian.properties'
INFO 11-11 14:56:39,810 - Mondrian: loaded 0 system properties
INFO 11-11 14:56:39,884 - Refreshing com.pentaho.analyzer.content.px@106e02e: display name [com.pentaho.analyzer.content.px@106e02e]; startup date [Mon Nov 11 14:56:39 CST 2013]; root of context hierarchy
INFO 11-11 14:56:39,885 - Loading XML bean definitions from class path resource [beans.xml]
INFO 11-11 14:56:39,921 - Bean factory for application context [com.pentaho.analyzer.content.px@106e02e]: org.springframework.beans.factory.support.DefaultListableBeanFactory@f67d81
INFO 11-11 14:56:39,940 - Loading properties file from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/analyzer/analyzer.properties]
INFO 11-11 14:56:39,944 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@f67d81: defining beans [propertyConfigurer,properties,analysisAreaManager,olapMetaDataManager,olapConnectionManager,reportManager,reportRequestService,usageTracker,localizationService,CVAppContext]; root of factory hierarchy
INFO 11-11 14:56:39,948 - Loading properties file from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions/system/analyzer/analyzer.properties]
Pentaho BI Platform server is ready. (Pentaho Platform Engine Core 3.9.0-stable.47240) Fully Qualified Server Url = http://localhost:8080/pentaho/, Solution Path = /home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions
INFO 11-11 14:56:40,048 - Started SocketConnector@localhost:10000
INFO 11-11 14:56:40,054 - Refreshing org.springframework.context.support.FileSystemXmlApplicationContext@bf1a4a: display name [org.springframework.context.support.FileSystemXmlApplicationContext@bf1a4a]; startup date [Mon Nov 11 14:56:40 CST 2013]; root of context hierarchy
INFO 11-11 14:56:40,054 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/visualizations/prpt/plugin.xml]
INFO 11-11 14:56:40,070 - Bean factory for application context [org.springframework.context.support.FileSystemXmlApplicationContext@bf1a4a]: org.springframework.beans.factory.support.DefaultListableBeanFactory@9e4dc0
INFO 11-11 14:56:40,071 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@9e4dc0: defining beans [visualizationBean]; root of factory hierarchy
INFO 11-11 14:56:40,079 - Refreshing org.springframework.context.support.FileSystemXmlApplicationContext@7348e: display name [org.springframework.context.support.FileSystemXmlApplicationContext@7348e]; startup date [Mon Nov 11 14:56:40 CST 2013]; root of context hierarchy
INFO 11-11 14:56:40,080 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/visualizations/report-wizard/plugin.xml]
INFO 11-11 14:56:40,094 - Bean factory for application context [org.springframework.context.support.FileSystemXmlApplicationContext@7348e]: org.springframework.beans.factory.support.DefaultListableBeanFactory@ffb35e
INFO 11-11 14:56:40,095 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@ffb35e: defining beans [visualizationBean]; root of factory hierarchy
INFO 11-11 14:56:40,097 - Refreshing org.springframework.context.support.FileSystemXmlApplicationContext@153c9c7: display name [org.springframework.context.support.FileSystemXmlApplicationContext@153c9c7]; startup date [Mon Nov 11 14:56:40 CST 2013]; root of context hierarchy
INFO 11-11 14:56:40,098 - Loading XML bean definitions from file [/home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/visualizations/analyzer/plugin.xml]
INFO 11-11 14:56:40,123 - Bean factory for application context [org.springframework.context.support.FileSystemXmlApplicationContext@153c9c7]: org.springframework.beans.factory.support.DefaultListableBeanFactory@3eeab3
INFO 11-11 14:56:40,125 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@3eeab3: defining beans [visualizationBean]; root of factory hierarchy
INFO 11-11 14:56:40,224 - Spoon - Asking for repository
INFO 11-11 14:56:40,347 - RepositoriesMeta - Reading repositories XML file: /home/cognos/.kettle/repositories.xml
INFO 11-11 14:56:41,118 - Version checker - OK
--------------------------------------------出现上面的加载信息,图形界面成功调出------------------------------------------------------------------------------
小结:至于解决方法ShowWelcomePageOnStartup=N 欢迎页面不显示就可以加载处设计页面,就不知道是上面原因了,此时我们在spoon界面上点击显示欢迎界面的话又会出现同样的错误,哪位大神看到的话,欢迎留言科普!
Linux下面kettle的部署的更多相关文章
- Linux中kettle自动化部署脚本
自己写的一个自动化在Linux中部署kettle的脚本,包括一些遇到的问题在脚本中都有涉及. kettle是官网最新版本pdi-ce-6.1.0.1-196.zip 目前最新版本下载地址:https: ...
- Windows环境安装Linux系统及JDK部署
前言 由于我的笔记本有点问题,所以这周系统包括所有硬盘全部重装了,原来的Linux虚拟机都没了,因此才有了这篇文章和各位朋友们分享. 由于Linux环境的优越性(开源.低成本.安全性好.网络功能强大) ...
- mosquitto在Linux环境下的部署/安装/使用/测试
mosquitto在Linux环境下的部署 看了有三四天的的源码,(当然没怎么好好看了),突然发现对mosquitto的源码有了一点点感觉,于是在第五天决定在Linux环境下部署mosquitto. ...
- Linux启动kettle及linux和windows中kettle往hdfs中写数据(3)
在xmanager中的xshell运行进入图形化界面 sh spoon.sh 新建一个job
- linux系统tomcat项目部署和tomcat访问日志
一.只用ip地址访问 先把端口号改成80,然后用 <Host name="localhost" appBase="webapps" 137 ...
- 在linux下用tomcat部署java web项目的过程与注意事项
在linux下用tomcat部署java web项目的过程与注意事项 一.安装JDK 到http://www.oracle.com/technetwork/java/javase/downloads/ ...
- linux下实现自动部署tomcat的脚本
linux下实现自动部署tomcat的脚本 由于经常部署war到tomccat上,经常有一些重复的工作要做:停服务.备份war包.上传新的war包.启动服务.索性就写了一个自动部署的脚本. 脚本如下a ...
- Kafka~Linux环境下的部署
概念 Kafka是一种高吞吐量的分布式发布订阅消息系统,它可以处理消费者规模的网站中的所有动作流数据. 这种动作(网页浏览,搜索和其他用户的行动)是在现代网络上的许多社会功能的一个关键因素. 这些数据 ...
- Linux shell编写脚本部署pxe网络装机
Linux shell编写脚本部署pxe网络装机 人工安装配置,Linux PXE无人值守网络装机 https://www.cnblogs.com/yuzly/p/10582254.html 脚本实 ...
随机推荐
- 【BZOJ 2721】 2721: [Violet 5]樱花 (筛)
2721: [Violet 5]樱花 Time Limit: 5 Sec Memory Limit: 128 MBSubmit: 599 Solved: 354 Description Input ...
- SQLSERVER2014集群实战——IP引发的坑
在之前的帖子里有提到过,为了避免IP变更带来的一系列问题,采取了不改变IP的策略.原以为,只要SQLSERVER的群集IP保持与之前单机部署的IP一致,就基本上不会有问题.然而实际永远比预想的更复杂. ...
- BZOJ 2118 墨墨的等式(最短路)
[题目链接] http://www.lydsy.com/JudgeOnline/problem.php?id=2118 [题目大意] 求a1x1+a2y2+…+anxn=B在B的取值范围,有多少B可以 ...
- 【扩展欧几里得】codevs1200-同余方程
[题目大意] 求关于 x 同余方程 ax ≡ 1 (mod b)的最小正整数解. [思路] 求解ax+by=1,只要x<0就不断加上 b. #include<iostream> #i ...
- 【10.5校内测试】【DP】【概率】
转移都很明显的一道DP题.按照不优化的思路,定义状态$dp[i][j][0/1]$表示吃到第$i$天,当前胃容量为$j$,前一天吃(1)或不吃(0)时能够得到的最大价值. 因为有一个两天不吃可以复原容 ...
- Codeforces Round #352 (Div. 1) B. Robin Hood 二分
B. Robin Hood 题目连接: http://www.codeforces.com/contest/671/problem/B Description We all know the impr ...
- MySQL DB 主从复制之SSL
需求架构 准备工作 主从服务器时间同步 # 主从服务器同时配置crontab任务,与NTP服务器同步时间即可 */5 * * * * ntpdate 172.16.0.1 &>/dev/ ...
- ubuntu 自动获取ip
$sudo dhclient -r $sudo dhclient $sudo dhclient eth0
- acm省赛选拔组队赛经验谈
省赛组队赛已经进行5场了,过半了. 从曾经的不会组队到如今逐渐磨合,尽管每次都有遗憾,可是我认为我们一直在进步.有些失误是要记录下来下次不能再犯的! 经验: 1:上场開始一定要有人(英语能力和算法综合 ...
- LNMP 1.2升级Nginx、MySQL/MariaDB、PHP教程
一般情况下不建议对生产环境进行升级,升级开始后会停止LNMP相关服务.本文仅适用于LNMP1.2及以后版本! 在LNMP目前LNMP v1.2中已经包含了Nginx.MySQL/MariaDB.PHP ...