Azkaban是什么?（一）

Azkaban的功能特点（二）

Azkaban的架构（三）

Hadoop工作流引擎之Azkaban与Oozie对比（四）

　　不多说，直接上干货！

http://www.cnblogs.com/zlslch/category/938837.html

　　准备这四个

Azkaban 2.5安装

  • 系统时区设置

  • 安装和配置mysql

  • Azkaban Web Server 安装

  • Azkaban Executor Server安装

  • 启动验证

  • Azkaban web server插件安装

  • Azkaban Executor Server 插件安装

一、系统时区配置

1.查看时区

[hadoop@master azkaban-web-2.5.]$ more /etc/sysconfig/clock

ZONE="Asia/Shanghai"

UTC=true

ARC=false

[hadoop@master ~]$ more /etc/sysconfig/clock

# The time zone of the system is defined by the contents of /etc/localtime.

# This file is only for evaluation by system-config-date, do not rely on its

# contents elsewhere.

ZONE="Asia/Shanghai"

[hadoop@master ~]$ su root

Password:

[root@master hadoop]# vim /etc/sysconfig/clock

[root@master hadoop]# more /etc/sysconfig/clock

# The time zone of the system is defined by the contents of /etc/localtime.

# This file is only for evaluation by system-config-date, do not rely on its

# contents elsewhere.

ZONE="Asia/Shanghai"

UTC=true

ARC=false

[root@master hadoop]#

2.修改时区

时区文件都在/usr/share/zoneinfo，复制相应时区覆盖/etc/localtime即可

[hadoop@master ~]$ ll /usr/share/zoneinfo

cp /usr/share/zoneinfo/Asia/Shanghai  /etc/localtime

　　修改web server 和excutor server 都需要配置时区，必须和系统时区一致（注意，这一步可以到最后才来修改）

default.timezone.id=Asia/Shanghai

安装mysql

　　这个很简单。不多赘述，大家可以去看我的博客

Hive环境的安装部署（完美安装）（集群内或集群外都适用）（含卸载自带mysql安装指定版本）

[hadoop@master app]$ pwd

/home/hadoop/app

[hadoop@master app]$ ll

total

drwxrwxr-x    hadoop hadoop  Apr  : elasticsearch-2.4.

drwxrwxr-x    hadoop hadoop  Apr  : elasticsearch-2.4.

lrwxrwxrwx    hadoop hadoop    Apr  : es -> elasticsearch-2.4./

lrwxrwxrwx    hadoop hadoop    Apr  : flume -> flume-1.6.

drwxrwxr-x    hadoop hadoop  Apr  : flume-1.6.

drwxrwxr-x    hadoop hadoop  Apr  : flume-1.7.

lrwxrwxrwx.   hadoop hadoop    Apr  : hadoop -> hadoop-2.6.

drwxr-xr-x.  hadoop hadoop  Apr  : hadoop-2.6.

lrwxrwxrwx.   hadoop hadoop    Apr  : hbase -> hbase-0.98.

drwxrwxr-x.   hadoop hadoop  Apr  : hbase-0.98.

lrwxrwxrwx.   hadoop hadoop    Apr  : hive -> hive-1.0.

drwxrwxr-x.   hadoop hadoop  Apr  : hive-1.0.

lrwxrwxrwx.   hadoop hadoop    Apr  : jdk -> jdk1..0_79

drwxr-xr-x.   hadoop hadoop  Apr    jdk1..0_79

drwxr-xr-x.   hadoop hadoop  Aug     jdk1..0_60

lrwxrwxrwx    hadoop hadoop    Apr  : kibana -> kibana-4.6.-linux-x86_64/

drwxrwxr-x   hadoop hadoop  Nov   : kibana-4.6.-linux-x86_64

lrwxrwxrwx.   hadoop hadoop    Apr  : sqoop -> sqoop-1.4.

drwxr-xr-x.   hadoop hadoop  Apr    sqoop-1.4.

lrwxrwxrwx.   hadoop hadoop    Apr  : zookeeper -> zookeeper-3.4.

drwxr-xr-x.  hadoop hadoop  Apr  : zookeeper-3.4.

[hadoop@master app]$ mkdir azkaban

[hadoop@master app]$ ll

total

drwxrwxr-x    hadoop hadoop  May   : azkaban

drwxrwxr-x    hadoop hadoop  Apr  : elasticsearch-2.4.

drwxrwxr-x    hadoop hadoop  Apr  : elasticsearch-2.4.

lrwxrwxrwx    hadoop hadoop    Apr  : es -> elasticsearch-2.4./

lrwxrwxrwx    hadoop hadoop    Apr  : flume -> flume-1.6.

drwxrwxr-x    hadoop hadoop  Apr  : flume-1.6.

drwxrwxr-x    hadoop hadoop  Apr  : flume-1.7.

lrwxrwxrwx.   hadoop hadoop    Apr  : hadoop -> hadoop-2.6.

drwxr-xr-x.  hadoop hadoop  Apr  : hadoop-2.6.

lrwxrwxrwx.   hadoop hadoop    Apr  : hbase -> hbase-0.98.

drwxrwxr-x.   hadoop hadoop  Apr  : hbase-0.98.

lrwxrwxrwx.   hadoop hadoop    Apr  : hive -> hive-1.0.

drwxrwxr-x.   hadoop hadoop  Apr  : hive-1.0.

lrwxrwxrwx.   hadoop hadoop    Apr  : jdk -> jdk1..0_79

drwxr-xr-x.   hadoop hadoop  Apr    jdk1..0_79

drwxr-xr-x.   hadoop hadoop  Aug     jdk1..0_60

lrwxrwxrwx    hadoop hadoop    Apr  : kibana -> kibana-4.6.-linux-x86_64/

drwxrwxr-x   hadoop hadoop  Nov   : kibana-4.6.-linux-x86_64

lrwxrwxrwx.   hadoop hadoop    Apr  : sqoop -> sqoop-1.4.

drwxr-xr-x.   hadoop hadoop  Apr    sqoop-1.4.

lrwxrwxrwx.   hadoop hadoop    Apr  : zookeeper -> zookeeper-3.4.

drwxr-xr-x.  hadoop hadoop  Apr  : zookeeper-3.4.

[hadoop@master app]$

二、配置mysql

　　下载mysql数据脚本

wget https://s3.amazonaws.com/azkaban2/azkaban2/2.5.0/azkaban-sql-script-2.5.0.tar.gz
tar -zxvf azkaban-sql-script-2.5.0.tar.gz –C ~/app/azkaban/

　　我下载的是离线，待会上传。

[hadoop@master azkaban]$ pwd

/home/hadoop/app/azkaban

[hadoop@master azkaban]$ ll

total

[hadoop@master azkaban]$ rz

[hadoop@master azkaban]$ ll

total

-rw-r--r--  hadoop hadoop  May   : azkaban-sql-script-2.5..tar.gz

[hadoop@master azkaban]$ 

[hadoop@master azkaban]$ pwd

/home/hadoop/app/azkaban

[hadoop@master azkaban]$ ll

total

-rw-r--r--  hadoop hadoop  May   : azkaban-sql-script-2.5..tar.gz

[hadoop@master azkaban]$ tar -zxvf azkaban-sql-script-2.5..tar.gz 

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop  May   : azkaban-2.5.

-rw-r--r--  hadoop hadoop  May   : azkaban-sql-script-2.5..tar.gz

[hadoop@master azkaban]$ rm azkaban-sql-script-2.5..tar.gz

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop  May   : azkaban-2.5.

[hadoop@master azkaban]$

创建用户、分配权限并执行脚本

mysql –uroot –pxxxx

创建数据库: CREATE DATABASE azkaban;

创建用户名：CREATE USER 'azkaban'@'%' IDENTIFIED BY 'azkaban'

分配权限：GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON `azkaban`.* TO 'azkaban'@'%' WITH GRANT OPTION;

flush privileges；

quit;

通过azkaban账号登录mysql：mysql –uazkaban –pazkaban

Use azkaban;

source ~/azkaban/azkaban-2.5./create-all-sql-2.5..sql

　　先开启mysql服务进程

[root@master azkaban]# service mysqld start

Starting mysqld:                                           [  OK  ]

[root@master azkaban]# su hadoop

[hadoop@master azkaban]$

[hadoop@master azkaban]$ mysql -uroot -prootroot

Welcome to the MySQL monitor.  Commands end with ; or \g.

Your MySQL connection id is

Server version: 5.1. Source distribution

Copyright (c) , , Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its

affiliates. Other names may be trademarks of their respective

owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> CREATE DATABASE azkaban;

Query OK,  row affected (0.00 sec)

mysql> CREATE USER 'azkaban'@'%' IDENTIFIED BY 'azkaban';

Query OK,  rows affected (0.00 sec)

mysql> GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON 'azkaban'.* TO 'azkaban'@'%' WITH GRANT OPTION;

ERROR  (): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ''azkaban'.* TO 'azkaban'@'%' WITH GRANT OPTION' at line

mysql> GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON `azkaban`.* TO 'azkaban'@'%' WITH GRANT OPTION;

Query OK,  rows affected (0.00 sec)

mysql> flush privileges;

Query OK,  rows affected (0.00 sec)

mysql> quit;

Bye

[hadoop@master azkaban]$ 
通过azkaban账号登录mysql
mysql –uazkaban –pazkaban

use azkaban;

source ~/app/azkaban/azkaban-2.5./create-all-sql-2.5..sql

　　　　则，再次执行

[hadoop@master azkaban]$ mysql -uazkaban -pazkaban

ERROR  (): Access denied for user 'azkaban'@'localhost' (using password: YES)

[hadoop@master azkaban]$ mysql -uroot -prootroot

Welcome to the MySQL monitor.  Commands end with ; or \g.

Your MySQL connection id is

Server version: 5.1. Source distribution

Copyright (c) , , Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its

affiliates. Other names may be trademarks of their respective

owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> GRANT ALL PRIVILEGES ON *.* to 'azkaban'@'%' IDENTIFIED BY 'azkaban' WITH GRANT OPTION;

Query OK,  rows affected (0.00 sec)

mysql> GRANT ALL PRIVILEGES ON *.* to 'azkaban'@'master' IDENTIFIED BY 'azkaban' WITH GRANT OPTION;

Query OK,  rows affected (0.00 sec)

mysql> GRANT ALL PRIVILEGES ON *.* to 'azkaban'@'localhost' IDENTIFIED BY 'azkaban' WITH GRANT OPTION;

Query OK,  rows affected (0.00 sec)

mysql> flush privileges;

Query OK,  rows affected (0.00 sec)

mysql> select user,host,password from mysql.user;

+---------+-----------+-------------------------------------------+

| user    | host      | password                                  |

+---------+-----------+-------------------------------------------+

| root    | localhost | *6C362347EBEAA7DF44F6D34884615A35095E80EB |

| root    | master    |                                           |

| root    | 127.0.0.1 |                                           |

|         | localhost |                                           |

|         | master    |                                           |

| hive    | %         | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |

| hive    | master    | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |

| hive    | localhost | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |

| azkaban | %         | *8E02B7AE57F9A19E165EB45CD3F705BF66985B85 |

| azkaban | master    | *8E02B7AE57F9A19E165EB45CD3F705BF66985B85 |

| azkaban | localhost | *8E02B7AE57F9A19E165EB45CD3F705BF66985B85 |

+---------+-----------+-------------------------------------------+

 rows in set (0.01 sec)

mysql> exit;

Bye

[hadoop@master azkaban]$

　　然后，此刻就可以通过azkaban账号登录mysql了。

mysql –uazkaban –pazkaban

use azkaban;

source ~/app/azkaban/azkaban-2.5./create-all-sql-2.5..sql

　　因为，

[hadoop@master azkaban]$ pwd

/home/hadoop/app/azkaban

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop  May   : azkaban-2.5.

[hadoop@master azkaban]$ cd azkaban-2.5./

[hadoop@master azkaban-2.5.]$ pwd

/home/hadoop/app/azkaban/azkaban-2.5.

[hadoop@master azkaban-2.5.]$ ll

total

-rwxr-xr-x  hadoop hadoop   Apr    create.active_executing_flows.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.active_sla.sql

-rwxr-xr-x  hadoop hadoop  Apr    create-all-sql-2.5..sql

-rwxr-xr-x  hadoop hadoop   Apr    create.execution_flows.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.execution_jobs.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.execution_logs.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.project_events.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.project_files.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.project_flows.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.project_permissions.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.project_properties.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.projects.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.project_versions.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.properties.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.schedules.sql

-rwxr-xr-x  hadoop hadoop   Apr    create.triggers.sql

-rwxr-xr-x  hadoop hadoop    Apr    database.properties

-rwxr-xr-x  hadoop hadoop   Apr    update-all-sql-2.1.sql

-rwxr-xr-x  hadoop hadoop   Apr    update-all-sql-2.2.sql

-rwxr-xr-x  hadoop hadoop   Apr    update.execution_logs.2.1.sql

-rwxr-xr-x  hadoop hadoop    Apr    update.project_properties.2.1.sql

[hadoop@master azkaban-2.5.]$

　　

　　所以，才执行如下

[hadoop@master azkaban]$ mysql -uazkaban -pazkaban

Welcome to the MySQL monitor.  Commands end with ; or \g.

Your MySQL connection id is

Server version: 5.1. Source distribution

Copyright (c) , , Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its

affiliates. Other names may be trademarks of their respective

owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> use azkaban;

Database changed

mysql> source /home/hadoop/app/azkaban/azkaban-2.5.0/create-all-sql-2.5.0.sql

Query OK,  rows affected (0.03 sec)

Query OK,  rows affected (0.03 sec)

Query OK,  rows affected (0.01 sec)

Query OK,  rows affected (0.04 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.02 sec)

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.03 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.02 sec)

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Query OK,  rows affected (0.00 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.02 sec)

Query OK,  rows affected (0.00 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.02 sec)

Query OK,  rows affected (0.00 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Query OK,  rows affected (0.00 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.02 sec)

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.01 sec)

Query OK,  rows affected (0.01 sec)

Query OK,  rows affected (0.01 sec)

Records:   Duplicates:   Warnings: 

Query OK,  rows affected (0.02 sec)

　mysql> exit;
　Bye
 [hadoop@master azkaban]$



三、Azkaban Web Server 安装


1.下载安装包




wget https://s3.amazonaws.com/azkaban2/azkaban2/2.5.0/azkaban-web-server-2.5.0.tar.gz

tar –zxvf azkaban-web-server-2.5..tar.gz  –C  ~/app/azkaban/




　　


　　我这里，选择离线上传的方式，之前已经下载好了。






[hadoop@master azkaban]$ pwd

/home/hadoop/app/azkaban

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop  May   : azkaban-2.5.

[hadoop@master azkaban]$ rz

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop      May   : azkaban-2.5.

-rw-r--r--  hadoop hadoop  May   : azkaban-web-server-2.5..tar.gz

[hadoop@master azkaban]$ 




解压缩






[hadoop@master azkaban]$ pwd

/home/hadoop/app/azkaban

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop      May   : azkaban-2.5.

-rw-r--r--  hadoop hadoop  May   : azkaban-web-server-2.5..tar.gz

[hadoop@master azkaban]$ tar -zxvf azkaban-web-server-2.5..tar.gz 










[hadoop@master azkaban]$ pwd

/home/hadoop/app/azkaban

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop      May   : azkaban-2.5.

drwxrwxr-x  hadoop hadoop      May   : azkaban-web-2.5.

-rw-r--r--  hadoop hadoop  May   : azkaban-web-server-2.5..tar.gz

[hadoop@master azkaban]$ rm azkaban-web-server-2.5..tar.gz

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop  May   : azkaban-2.5.

drwxrwxr-x  hadoop hadoop  May   : azkaban-web-2.5.

[hadoop@master azkaban]$ 






2.上传依赖包


　　上传mysql驱动包至 ~/app/azkaban/azkaban-web-2.5.0/extlib/






[hadoop@master extlib]$ pwd

/home/hadoop/app/azkaban/azkaban-web-2.5./extlib

[hadoop@master extlib]$ ll

total

[hadoop@master extlib]$ rz

[hadoop@master extlib]$ ll

total

-rw-r--r--  hadoop hadoop  Nov   : mysql-connector-java-5.1..jar

[hadoop@master extlib]$ 




3.生成jetty ssl所需密钥文件




keytool -keystore keystore -alias jetty -genkey -keyalg RSA

        Enter keystore password:  mysteel

        What is your first and last name?

          [Unknown]:  mysteel

        What is the name of your organizational unit?

          [Unknown]:  mysteel

        What is the name of your organization?

          [Unknown]: mysteel

        What is the name of your City or Locality?

          [Unknown]:SH

        What is the name of your State or Province?

          [Unknown]:SH

        What is the two-letter country code for this unit?

          [Unknown]:CN

       Is CN=mysteel, OU= mysteel, O= mysteel, L=SH, ST=SH, C=CN correct?

      [no]:  yes

        Enter key password for < mysteel >

                (RETURN if same as keystore password):  mysteel








[hadoop@master extlib]$ pwd

/home/hadoop/app/azkaban/azkaban-web-2.5./extlib

[hadoop@master extlib]$ keytool -keystore keystore -alias jetty -genkey -keyalg RSA

Enter keystore password:（密码是mysteel）  

Re-enter new password: （密码是mysteel）

What is your first and last name?

  [Unknown]:  mysteel

What is the name of your organizational unit?

  [Unknown]:  mysteel

What is the name of your organization?

  [Unknown]:  mysteel

What is the name of your City or Locality?

  [Unknown]:  SH

What is the name of your State or Province?

  [Unknown]:  SH

What is the two-letter country code for this unit?

  [Unknown]:  CN

Is CN=mysteel, OU=mysteel, O=mysteel, L=SH, ST=SH, C=CN correct?

  [no]:  yes

Enter key password for <jetty>

    (RETURN if same as keystore password):

Re-enter new password: （密码是mysteel）

[hadoop@master extlib]$ 




　　注意：这里keystore的密码为mysteel,key的密码为mysteel可自行修改 最后将生成的keystore文件放到 Azkaban安装目录中~/app/azkaban/azkaban-web-2.5.0/ （也可通过修改配置文件改变其默认存放地址）。






[hadoop@master extlib]$ pwd

/home/hadoop/app/azkaban/azkaban-web-2.5./extlib

[hadoop@master extlib]$ ll

total

-rw-rw-r--  hadoop hadoop    May   : keystore

-rw-r--r--  hadoop hadoop  Nov   : mysql-connector-java-5.1..jar

[hadoop@master extlib]$ mv keystore /home/hadoop/app/azkaban/azkaban-web-2.5./

[hadoop@master extlib]$ cd /home/hadoop/app/azkaban/azkaban-web-2.5./

[hadoop@master azkaban-web-2.5.]$ pwd

/home/hadoop/app/azkaban/azkaban-web-2.5.

[hadoop@master azkaban-web-2.5.]$ ll

total

-rw-r--r--  hadoop hadoop   Apr    azkaban.version

drwxr-xr-x  hadoop hadoop  Apr    bin

drwxr-xr-x  hadoop hadoop  May   : conf

drwxr-xr-x  hadoop hadoop  May   : extlib

-rw-rw-r--  hadoop hadoop  May   : keystore

drwxr-xr-x  hadoop hadoop  May   : lib

drwxr-xr-x  hadoop hadoop  Apr    plugins

drwxr-xr-x  hadoop hadoop  May   : web

[hadoop@master azkaban-web-2.5.]$ 




4.修改配置文件 (conf/azkaban.propreties)


修改首页样式及时区信息




azkaban.name=Job Tasks

azkaban.label=mysteel workflow

azkaban.color=#FF3601

azkaban.default.servlet.path=/index

web.resource.dir=web/

default.timezone.id=Asia/Shanghai












#Azkaban Personalization Settings

azkaban.name=Test

azkaban.label=My Local Azkaban

azkaban.color=#FF3601

azkaban.default.servlet.path=/index

web.resource.dir=web/

default.timezone.id=America/Los_Angeles

改为


#Azkaban Personalization Settings
azkaban.name=Job Tasks
azkaban.label=mysteel workflow
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai




修改mysql连接,可自行修改




database.type=mysql

mysql.port=

mysql.host=192.168.80.145

mysql.database=azkaban

mysql.user=azkaban

mysql.password=azkaban

mysql.numconnections=










database.type=mysql

mysql.port=

mysql.host=localhost

mysql.database=azkaban

mysql.user=azkaban

mysql.password=azkaban

mysql.numconnections=

改为

database.type=mysql

mysql.port=

mysql.host=192.168.80.145

mysql.database=azkaban

mysql.user=azkaban

mysql.password=azkaban

mysql.numconnections=




　　修改 Jetty 服务器属性，包括 keystore 的相关配置




jetty.maxThreads=

jetty.ssl.port=

jetty.port=

jetty.keystore=keystore

jetty.password=mysteel

jetty.keypassword= mysteel

jetty.truststore=keystore

jetty.trustpassword= mysteel










# Azkaban Jetty server properties.

jetty.maxThreads=

jetty.ssl.port=

jetty.port=

jetty.keystore=keystore

jetty.password=password

jetty.keypassword=password

jetty.truststore=keystore

jetty.trustpassword=password

改成

# Azkaban Jetty server properties.

jetty.maxThreads=

jetty.ssl.port=

jetty.port=

jetty.keystore=keystore

jetty.password=mysteel

jetty.keypassword=mysteel

jetty.truststore=keystore

jetty.trustpassword=mysteel




修改邮件设置（可选）




mail.sender=xxxxxxx@mysteel.com

    mail.host=smtp..com

    mail.user= xxxxxxx@mysteel.com

    mail.password=xxx (注:发送邮箱的密码)






5.用户及权限配置


　　进入 azkaban web 服务器 conf 目录，修改 azkaban-users.xml ，增加管理员用户：




< azkaban-users>

   < user username="azkaban" password="azkaban" roles="admin"  groups="azkaban" />

   < user username="metrics" password="metrics" roles="metrics"/>

   < user username="admin" password="admin" roles="admin,metrics" />

   < role name="admin" permissions="ADMIN" />

   < role name="metrics" permissions="METRICS"/>

< /azkaban-users>












<azkaban-users>

        <user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />

        <user username="metrics" password="metrics" roles="metrics"/>

        <role name="admin" permissions="ADMIN" />

        <role name="metrics" permissions="METRICS"/>

</azkaban-users>

改为

<azkaban-users>

        <user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />

        <user username="metrics" password="metrics" roles="metrics"/>

        <user username="admin" password="admin" roles="admin,metrics"/>

        <role name="admin" permissions="ADMIN" />

        <role name="metrics" permissions="METRICS"/>

</azkaban-users>




四、Azkaban Executor Server安装


1、下载安装包




wget https://s3.amazonaws.com/azkaban2/azkaban2/2.5.0/azkaban-executor-server-2.5.0.tar.gz

tar –zxvf  azkaban-executor-server-2.5..tar.gz  –C  ~/app/azkaban/




　　我这里，选择的是离线，再上传的方式






[hadoop@master azkaban]$ pwd

/home/hadoop/app/azkaban

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop  May   : azkaban-2.5.

drwxrwxr-x  hadoop hadoop  May   : azkaban-web-2.5.

[hadoop@master azkaban]$ rz

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop      May   : azkaban-2.5.

-rw-r--r--  hadoop hadoop  May   : azkaban-executor-server-2.5..tar.gz

drwxrwxr-x  hadoop hadoop      May   : azkaban-web-2.5.

[hadoop@master azkaban]$ clear

[hadoop@master azkaban]$




　　解压缩






[hadoop@master azkaban]$ pwd

/home/hadoop/app/azkaban

[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop      May   : azkaban-2.5.

-rw-r--r--  hadoop hadoop  May   : azkaban-executor-server-2.5..tar.gz

drwxrwxr-x  hadoop hadoop      May   : azkaban-web-2.5.

[hadoop@master azkaban]$ tar -zxvf azkaban-executor-server-2.5..tar.gz








[hadoop@master azkaban]$ ll

total

drwxrwxr-x  hadoop hadoop      May   : azkaban-2.5.

drwxrwxr-x  hadoop hadoop      May   : azkaban-executor-2.5.

-rw-r--r--  hadoop hadoop  May   : azkaban-executor-server-2.5..tar.gz

drwxrwxr-x  hadoop hadoop      May   : azkaban-web-2.5.

[hadoop@master azkaban]$ rm azkaban-executor-server-2.5..tar.gz

[hadoop@master azkaban]$




2.修改配置文件 (conf/azkaban.propreties)


修改时区信息




default.timezone.id=Asia/Shanghai








[hadoop@master conf]$ pwd

/home/hadoop/app/azkaban/azkaban-executor-2.5./conf

[hadoop@master conf]$ ll

total

-rw-r--r--  hadoop hadoop   Apr    azkaban.private.properties

-rw-r--r--  hadoop hadoop  Apr    azkaban.properties

-rw-r--r--  hadoop hadoop    Apr    global.properties

[hadoop@master conf]$ vim azkaban.properties










#Azkaban

default.timezone.id=America/Los_Angeles

改为

#Azkaban

default.timezone.id=Asia/Shanghai




修改mysql连接,可自行修改




database.type=mysql

mysql.port=

mysql.host=192.168.80.145

mysql.database=azkaban

mysql.user=azkaban

mysql.password=azkaban

mysql.numconnections=










database.type=mysql

mysql.port=

mysql.host=localhost

mysql.database=azkaban2

mysql.user=azkaban

mysql.password=azkaban

mysql.numconnections=

改为

database.type=mysql

mysql.port=

mysql.host=192.168.80.145

mysql.database=azkaban

mysql.user=azkaban

mysql.password=azkaban

mysql.numconnections=




配置端口，默认就好




executor.maxThreads=

executor.port=

executor.flow.threads=






　　在web server 的azkaban.properties配置executor的连接，特别注意，如果两个server不是在一台主机上，web server 需要配置executor.host




# Azkaban Executor settings

executor.port=

executor.host=ip/hostname




　　我这里，仅仅是都安装在单节点master即同一台机器上，所以上述这一小步骤省略。


五、启动验证


启动web server




~/app/azkaban/azkaban-web-2.5./bin/azkaban-web-start.sh（azkaban-web-shutdown.sh停止）

 访问 https://master:8443   出现界面安装成功
或


 访问 https://192.168.80.145:8443   出现界面安装成功










[hadoop@master azkaban-web-2.5.]$ pwd

/home/hadoop/app/azkaban/azkaban-web-2.5.

[hadoop@master azkaban-web-2.5.]$ ll

total

-rw-r--r--  hadoop hadoop   Apr    azkaban.version

drwxr-xr-x  hadoop hadoop  Apr    bin

drwxr-xr-x  hadoop hadoop  May   : conf

drwxr-xr-x  hadoop hadoop  May   : extlib

-rw-rw-r--  hadoop hadoop  May   : keystore

drwxr-xr-x  hadoop hadoop  May   : lib

drwxr-xr-x  hadoop hadoop  Apr    plugins

drwxr-xr-x  hadoop hadoop  May   : web

[hadoop@master azkaban-web-2.5.]$ bin/azkaban-web-start.sh

Using Hadoop from /home/hadoop/app/hadoop-2.6.

Using Hive from /home/hadoop/app/hive

bin/..

/home/hadoop/app/jdk/lib:.:/home/hadoop/app/jdk/lib:/home/hadoop/app/jdk/jre/lib:bin/../lib/azkaban-2.5..jar:bin/../lib/commons-collections-3.2..jar:bin/../lib/commons-configuration-1.8.jar:bin/../lib/commons-dbcp-1.4.jar:bin/../lib/commons-dbutils-1.5.jar:bin/../lib/commons-email-1.2.jar:bin/../lib/commons-fileupload-1.2..jar:bin/../lib/commons-io-2.4.jar:bin/../lib/commons-jexl-2.1..jar:bin/../lib/commons-lang-2.6.jar:bin/../lib/commons-logging-1.1..jar:bin/../lib/commons-pool-1.6.jar:bin/../lib/guava-13.0..jar:bin/../lib/h2-1.3..jar:bin/../lib/httpclient-4.2..jar:bin/../lib/httpcore-4.2..jar:bin/../lib/jackson-core-asl-1.9..jar:bin/../lib/jackson-mapper-asl-1.9..jar:bin/../lib/jetty-6.1..jar:bin/../lib/jetty-util-6.1..jar:bin/../lib/joda-time-2.0.jar:bin/../lib/jopt-simple-4.3.jar:bin/../lib/junit-4.8.jar:bin/../lib/log4j-1.2..jar:bin/../lib/mail-1.4..jar:bin/../lib/mysql-connector-java-5.1..jar:bin/../lib/servlet-api-2.5.jar:bin/../lib/slf4j-api-1.6..jar:bin/../lib/slf4j-log4j12-1.6..jar:bin/../lib/velocity-1.7.jar:bin/../lib/velocity-tools-2.0.jar:bin/../extlib/mysql-connector-java-5.1..jar:bin/../plugins/*/*.jar:/home/hadoop/app/hadoop-2.6.0/conf:/home/hadoop/app/hadoop-2.6.0/*:/home/hadoop/app/hive/conf:/home/hadoop/app/hive/lib/*

[hadoop@master azkaban-web-2.5.0]$ 2017/05/01 15:35:30.167 +0800 ERROR [AzkabanWebServer] [Azkaban] Starting Jetty Azkaban Executor...

2017/05/01 15:35:30.278 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from bin/../conf

2017/05/01 15:35:30.280 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file

2017/05/01 15:35:30.338 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up Jetty Https Server with port:8443 and numThreads:25

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/home/hadoop/app/azkaban/azkaban-web-2.5.0/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/home/hadoop/app/hive-1.0.0/lib/hive-jdbc-1.0.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.


2017/05/01 15:35:30.532 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2017/05/01 15:35:30.897 +0800 INFO [AzkabanWebServer] [Azkaban] Loading user manager class azkaban.user.XmlUserManager
2017/05/01 15:35:31.352 +0800 INFO [XmlUserManager] [Azkaban] Loading user azkaban
2017/05/01 15:35:31.359 +0800 INFO [XmlUserManager] [Azkaban] Loading user metrics
2017/05/01 15:35:31.360 +0800 INFO [XmlUserManager] [Azkaban] Loading user admin
2017/05/01 15:35:33.429 +0800 INFO [AzkabanWebServer] [Azkaban] Loading JDBC for project management
2017/05/01 15:35:33.450 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old logs from execution_logs
2017/05/01 15:35:33.480 +0800 INFO [ProjectManager] [Azkaban] Project version retention is set to 3
2017/05/01 15:35:34.233 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old log files before 2017-02-06T15:35:33.601+08:00
2017/05/01 15:35:34.283 +0800 INFO [ExecutorManager] [Azkaban] Cleaned up 0 log entries.
2017/05/01 15:35:34.483 +0800 INFO [TriggerManager] [Azkaban] TriggerManager loaded.
2017/05/01 15:35:34.484 +0800 INFO [AzkabanWebServer] [Azkaban] Loading built-in checker and action types
2017/05/01 15:35:34.533 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker BasicTimeChecker
2017/05/01 15:35:34.533 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker SlaChecker
2017/05/01 15:35:34.534 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker ExecutionChecker
2017/05/01 15:35:34.534 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action ExecuteFlowAction
2017/05/01 15:35:34.535 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action KillExecutionAction
2017/05/01 15:35:34.550 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action AlertAction
2017/05/01 15:35:34.566 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action CreateTriggerAction
2017/05/01 15:35:34.582 +0800 INFO [AzkabanWebServer] [Azkaban] Loading trigger based scheduler
2017/05/01 15:35:34.620 +0800 INFO [AzkabanWebServer] [Azkaban] Loading plug-in checker and action types
2017/05/01 15:35:34.621 +0800 ERROR [AzkabanWebServer] [Azkaban] plugin path plugins/triggers doesn't exist!
2017/05/01 15:35:34.623 +0800 INFO [AzkabanWebServer] [Azkaban] Setting timezone to Asia/Shanghai
2017/05/01 15:35:34.627 +0800 INFO [AzkabanWebServer] [Azkaban] Registering MBeans...
2017/05/01 15:35:34.747 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.
2017/05/01 15:35:34.755 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxTriggerManager registered.
2017/05/01 15:35:34.765 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxExecutorManager registered.
2017/05/01 15:35:34.770 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up web resource dir web/
2017/05/01 15:35:34.952 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loading all triggers from db.
2017/05/01 15:35:35.047 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loaded 0 triggers.


2017/05/01 15:35:35.048 +0800 INFO [log] [Azkaban] jetty-6.1.26
2017/05/01 15:35:36.445 +0800 INFO [log] [Azkaban] Started SslSocketConnector@0.0.0.0:8443
2017/05/01 15:35:36.446 +0800 INFO [AzkabanWebServer] [Azkaban] Server running on ssl port 8443.






　　这里的用户名好密码都是我们在配置文件里，设置的azkaban








启动 executor server




~/app/azkaban/azkaban-executor-2.5./bin/azkaban-executor-start.sh(azkaban-executor-shutdown.sh 停止










[hadoop@master azkaban-executor-2.5.]$ pwd

/home/hadoop/app/azkaban/azkaban-executor-2.5.

[hadoop@master azkaban-executor-2.5.]$ ll

total

-rw-r--r--  hadoop hadoop   Apr    azkaban.version

drwxr-xr-x  hadoop hadoop  Apr    bin

drwxr-xr-x  hadoop hadoop  May   : conf

drwxr-xr-x  hadoop hadoop  Apr    extlib

drwxr-xr-x  hadoop hadoop  May   : lib

drwxr-xr-x  hadoop hadoop  Apr    plugins

[hadoop@master azkaban-executor-2.5.]$ bin/azkaban-executor-start.sh

Using Hadoop from /home/hadoop/app/hadoop-2.6.

Using Hive from /home/hadoop/app/hive

bin/..

/home/hadoop/app/jdk/lib:.:/home/hadoop/app/jdk/lib:/home/hadoop/app/jdk/jre/lib:bin/../lib/azkaban-2.5..jar:bin/../lib/commons-collections-3.2..jar:bin/../lib/commons-configuration-1.8.jar:bin/../lib/commons-dbcp-1.4.jar:bin/../lib/commons-dbutils-1.5.jar:bin/../lib/commons-email-1.2.jar:bin/../lib/commons-fileupload-1.2..jar:bin/../lib/commons-io-2.4.jar:bin/../lib/commons-jexl-2.1..jar:bin/../lib/commons-lang-2.6.jar:bin/../lib/commons-logging-1.1..jar:bin/../lib/commons-pool-1.6.jar:bin/../lib/guava-13.0..jar:bin/../lib/h2-1.3..jar:bin/../lib/httpclient-4.2..jar:bin/../lib/httpcore-4.2..jar:bin/../lib/jackson-core-asl-1.9..jar:bin/../lib/jackson-mapper-asl-1.9..jar:bin/../lib/jetty-6.1..jar:bin/../lib/jetty-util-6.1..jar:bin/../lib/joda-time-2.0.jar:bin/../lib/jopt-simple-4.3.jar:bin/../lib/junit-4.8.jar:bin/../lib/log4j-1.2..jar:bin/../lib/mail-1.4..jar:bin/../lib/mysql-connector-java-5.1..jar:bin/../lib/servlet-api-2.5.jar:bin/../lib/slf4j-api-1.6..jar:bin/../lib/slf4j-log4j12-1.6..jar:bin/../lib/velocity-1.7.jar:bin/../lib/velocity-tools-2.0.jar:bin/../extlib/*.jar:bin/../plugins/*/*.jar:/home/hadoop/app/hadoop-2.6./conf:/home/hadoop/app/hadoop-2.6./*:/home/hadoop/app/hive/conf:/home/hadoop/app/hive/lib/*

Starting AzkabanExecutorServer on port 12321 ...

[hadoop@master azkaban-executor-2.5.0]$ 2017/05/01 15:43:52.101 +0800 ERROR [AzkabanExecutorServer] [Azkaban] Starting Jetty Azkaban Executor...

2017/05/01 15:43:52.180 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from bin/../conf

2017/05/01 15:43:52.182 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban private properties file

2017/05/01 15:43:52.187 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file

2017/05/01 15:43:52.285 +0800 INFO [AzkabanExecutorServer] [Azkaban] Setting timezone to Asia/Shanghai

SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/home/hadoop/app/azkaban/azkaban-executor-2.5.0/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: Found binding in [jar:file:/home/hadoop/app/hive-1.0.0/lib/hive-jdbc-1.0.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

2017/05/01 15:43:52.430 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog

2017/05/01 15:43:53.334 +0800 INFO [FlowRunnerManager] [Azkaban] Execution dir retention set to 86400000 ms

2017/05/01 15:43:53.388 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished

2017/05/01 15:43:53.389 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects

2017/05/01 15:43:53.390 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old execution dirs

2017/05/01 15:43:53.431 +0800 INFO [AzkabanExecutorServer] [Azkaban] Registering MBeans...

2017/05/01 15:43:53.610 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.

2017/05/01 15:43:53.639 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxFlowRunnerManager registered.

2017/05/01 15:43:53.640 +0800 INFO [log] [Azkaban] jetty-6.1.26

2017/05/01 15:43:53.861 +0800 INFO [log] [Azkaban] Started SocketConnector@0.0.0.0:12321

2017/05/01 15:43:53.862 +0800 INFO [AzkabanExecutorServer] [Azkaban] Azkaban Executor Server started on port 12321




　　如何停止






[hadoop@master azkaban-web-2.5.]$ pwd

/home/hadoop/app/azkaban/azkaban-web-2.5.

[hadoop@master azkaban-web-2.5.]$ jps

 AzkabanWebServer

 AzkabanExecutorServer

 Jps










[hadoop@master azkaban-executor-2.5.]$ pwd

/home/hadoop/app/azkaban/azkaban-executor-2.5.

[hadoop@master azkaban-executor-2.5.]$ ll

total

-rw-rw-r--  hadoop hadoop     May   : azkaban-access.log

-rw-r--r--  hadoop hadoop   Apr    azkaban.version

-rw-rw-r--  hadoop hadoop   May   : azkaban-webserver.log

drwxr-xr-x  hadoop hadoop  Apr    bin

drwxr-xr-x  hadoop hadoop  May   : conf

-rw-rw-r--  hadoop hadoop     May   : currentpid

drwxrwxr-x  hadoop hadoop  May   : executions

drwxr-xr-x  hadoop hadoop  Apr    extlib

drwxr-xr-x  hadoop hadoop  May   : lib

drwxr-xr-x  hadoop hadoop  Apr    plugins

drwxrwxr-x  hadoop hadoop  May   : projects

drwxrwxr-x  hadoop hadoop  May   : temp

[hadoop@master azkaban-executor-2.5.]$ bin/azkaban-executor-shutdown.sh

[hadoop@master azkaban-executor-2.5.]$ jps

 AzkabanWebServer

 Jps

[hadoop@master azkaban-executor-2.5.]$ 






[hadoop@master azkaban-web-2.5.]$ pwd

/home/hadoop/app/azkaban/azkaban-web-2.5.

[hadoop@master azkaban-web-2.5.]$ jps

 AzkabanWebServer

 Jps

[hadoop@master azkaban-web-2.5.]$ bin/azkaban-web-shutdown.sh




　　　　或kill掉




[hadoop@master azkaban-web-2.5.]$ jps

 Jps

 AzkabanWebServer

[hadoop@master azkaban-web-2.5.]$ kill -

[hadoop@master azkaban-web-2.5.]$ jps

 Jps

[hadoop@master azkaban-web-2.5.]$ 




　　这里不多赘述了。


　　


六、Azkaban web server插件安装（暂时没用上，不先写了）


　　为了后边插件的安装，需要在${AZKABAN_WEB_SERVER}/plugins/目录下创建viewer目录，用来安装各种viewer插件。当安装好一个插件后需要重启服务，让插件生效。


安装HDFS Viewer插件


1.解压插件


　　解压插件 在viewer目录中解压azkaban-hdfs-viewer-2.5.0.tar.gz，得到azkaban-hdfs-viewer-2.5.0目录，将其更名为hdfs。最终，这个插件的目录路径是：${AZKABAN_WEB_SERVER}/plugins/viewer/hdfs。


安装Job Summary插件


安装Reportal插件


七、Azkaban Executor Server 插件安装（暂时没用上，不先写了）


　　进入${AZKABAN_EXECUTOR_SERVER}/plugins目录，在该目录下解压azkaban-jobtype-2.5.0.tar.gz得到目录：azkaban-jobtype-2.5.0。将该目录更名为jobtypes。这个目录用来存放之后安装的所有插件，与Web Server中的viewer目录类似。每次插件的安装配置需要重启Executor Server。


安装Reportalhive插件


参考


http://www.cnblogs.com/qiaoyihang/p/6237810.html


欢迎大家，加入我的微信公众号：大数据躺过的坑        人工智能躺过的坑


 


 


 




同时，大家可以关注我的个人博客：


   http://www.cnblogs.com/zlslch/   和     http://www.cnblogs.com/lchzls/      http://www.cnblogs.com/sunnyDream/   


   详情请见：http://www.cnblogs.com/zlslch/p/7473861.html


　　人生苦短，我愿分享。本公众号将秉持活到老学到老学习无休止的交流分享开源精神，汇聚于互联网和个人学习工作的精华干货知识，一切来于互联网，反馈回互联网。
　　目前研究领域：大数据、机器学习、深度学习、人工智能、数据挖掘、数据分析。 语言涉及：Java、Scala、Python、Shell、Linux等 。同时还涉及平常所使用的手机、电脑和互联网上的使用技巧、问题和实用软件。 只要你一直关注和呆在群里，每天必须有收获


对应本平台的讨论和答疑QQ群：大数据和人工智能躺过的坑（总群）（161156071） 








												


											
Azkaban2.5安装部署（系统时区设置  +  安装和配置mysql + Azkaban Web Server 安装 + Azkaban Executor Server安装  +   Azkaban web server插件安装  +  Azkaban Executor Server 插件安装）（博主推荐）（五）的更多相关文章
	

    
								
  1. Ubuntu16.04下Neo4j图数据库官网安装部署步骤（图文详解）（博主推荐）
		
    不多说,直接上干货! 说在前面的话  首先,查看下你的操作系统的版本. root@zhouls-virtual-machine:~# cat /etc/issue Ubuntu LTS \n \l r ...
    
		
    2. 
						
  2. Ubuntu14.04下Neo4j图数据库官网安装部署步骤（图文详解）（博主推荐）
		
    不多说,直接上干货! 说在前面的话  首先,查看下你的操作系统的版本. root@zhouls-virtual-machine:~# cat /etc/issue Ubuntu 14.04.4 LTS ...
    
		
    3. 
						
  3. Ubuntu14.04下Mongodb数据库可视化工具安装部署步骤（图文详解）（博主推荐）
		
    不多说,直接上干货! 前期博客 Ubuntu14.04下Mongodb(离线安装方式|非apt-get)安装部署步骤(图文详解)(博主推荐) Ubuntu14.04下Mongodb官网安装部署步骤(图 ...
    
		
    4. 
						
  4. Ubuntu14.04下Mongodb官网安装部署步骤（图文详解）（博主推荐）
		
    不多说,直接上干货! 在这篇博客里,我采用了非官网的安装步骤,来进行安装.走了弯路,同时,也是不建议.因为在大数据领域和实际生产里,还是要走正规的为好. Ubuntu14.04下Mongodb(离线安 ...
    
		
    5. 
						
  5. Ubuntu16.04下Mongodb官网安装部署步骤（图文详解）（博主推荐）
		
    不多说,直接上干货! 在这篇博客里,我采用了非官网的安装步骤,来进行安装.走了弯路,同时,也是不建议.因为在大数据领域和实际生产里,还是要走正规的为好. Ubuntu16.04下Mongodb(离线安 ...
    
		
    6. 
						
  6. Spark on YARN模式的安装（spark-1.6.1-bin-hadoop2.6.tgz    +  hadoop-2.6.0.tar.gz）（master、slave1和slave2）（博主推荐）
		
    说白了 Spark on YARN模式的安装,它是非常的简单,只需要下载编译好Spark安装包,在一台带有Hadoop YARN客户端的的机器上运行即可.  Spark on YARN简介与运行wor ...
    
		
    7. 
						
  7. Navicat Premium之MySQL客户端的下载、安装和使用（博主推荐）
		
    不多说,直接上干货! 前期工作 若需使用Navicat Premium,则需要先安装MySQL,在此就不叙述了.具体可见我的博客: MySQL Server类型之MySQL客户端工具的下载.安装和使用 ...
    
		
    8. 
						
  8. 大数据搭建各个子项目时配置文件技巧（适合CentOS和Ubuntu系统）（博主推荐）
		
    不多说,直接上干货! 很多同行,也许都知道,对于我们大数据搭建而言,目前主流,分为Apache 和 Cloudera 和 Ambari. 后两者我不多说,是公司必备和大多数高校科研环境所必须的! 分别 ...
    
		
    9. 
						
  9. Ubuntu14.04下Mongodb官网卸载部署步骤（图文详解）（博主推荐）
		
    不多说,直接上干货! 前期博客 Ubuntu14.04下Mongodb官网安装部署步骤(图文详解)(博主推荐) https://docs.mongodb.com/manual/tutorial/ins ...
    
		
    10. 
		

	


随机推荐
	

    
									
  1. 1>/dev/null 2>&1 & 意思解析
			
    原文:https://jingyan.baidu.com/article/6dad5075334e26a123e36e31.html 用 /dev/null 2>&1 这样的写法.这条命 ...
    
			
    2. 
						
  2. MySQL-with rollup函数运用 _20160930
			
    在博客里http://www.cnblogs.com/Mr-Cxy/p/5898839.html提到了行转列, 如果想在下面这个表下面添加一行 总计 数据行SQL代码怎么实现 并且根据9月金额进行城市 ...
    
			
    3. 
						
  3. xml解析中的sax解析
			
    title: xml解析中的sax解析 tags: grammar_cjkRuby: true --- SAXPasser 类: parser(File file, DefaultHandler ha ...
    
			
    4. 
						
  4. CUDA 9.1/9.2 与 Visual Studio 2017 (VS2017 15.6.4) 的不兼容问题
			
    2018年7月9日更新: CUDA已推出9.2版本,最高支持MSVC++ 14.13 _MSC_VER == 1913 (Visual Studio 2017 version 15.6). 然而最新版 ...
    
			
    5. 
						
  5. HTTP缓存控制
			
    HTTP缓存控制总结   引言 通过网络获取内容既缓慢,成本又高.大的相应需要在客户端和服务器之间多次往返通信,这拖延了浏览器可以使用和处理内容的时间,同时也增加了通信的成本.因此,缓存和重用以前获取 ...
    
			
    6. 
						
  6. [hiho第92周]Miller-Rabin素性测试的c++实现
			
    证明: 如果n是素数,整数$a$ 与$n$ 互素,即$n$ 不整除$a$ ,则${a^{n - 1}} \equiv 1(\bmod n)$ ,如果能找到一个与$n$ 互素的整数$a$ ,是的上式不成 ...
    
			
    7. 
						
  7. nodejs写文件
			
    var fs = require('fs'); 2 var txt = "以上程序使用fs.readFileSync从源路径读取文件内容,并使用fs.writeFileSync将文件内容写入 ...
    
			
    8. 
						
  8. QListWidget笔记
			
    1.头文件:#include <QListWidget> 2.继承自:QListView 3.基本代码: #include "mainwindow.h" #includ ...
    
			
    9. 
						
  9. js学习笔记2：循环和try/catch/throw
			
    今天学习了js的比较.if/else.switch/case和各种循环,这些东西每种语言都大同小异,没什么好看的,重点说一下js的循环. JavaScript 支持不同类型的循环: for - 循环代 ...
    
			
    10. 
						
  10. 使用gRPC搭建Server端与Client端
			
    gRPC简介 gRPC是一种RPC框架技术,采用Protocal Buffers(协议缓存) 作为其接口定义的语言(就是Proto来写接口)和基础的消息交换格式. 在gRPC中,客户端应用程序可以直接 ...
    
			
    11.