cdh搭建仓库

搭建内部仓库使用yum安装cm

Creating a Permanent Internal Repository

1,安装httpd

 yum install httpd

 删除/etc/httpd/conf/httpd.conf  里的include 

2,下载源文件cm

Download the tarball for your OS distribution from the repo-as-tarball archive:

Cloudera Manager 5: https://archive.cloudera.com/cm5/repo-astarball/

CDH 5: https://archive.cloudera.com/cdh5/repo-as-tarball/

解压

Unpack the tarball, move the files to the web server directory, and modify filepermissions. For example, you might use the following commands

$ tar xvfz cm5.14.0-centos7.tar.gz
$ sudo mv cm /var/www/html
$ sudo chmod -R ugo+rX /var/www/html/cm

3,配置客户端使用repo

Modifying Clients to Use the Internal Repository

Create /etc/yum.repos.d/cloudera-repo.repo files on clusterhosts with the following content, where <web_server> is thehostname of the web server:

$ [cloudera-repo]
$ name=cloudera-repo
$ baseurl=http://<web_server>/cm/5
$ enabled=1
$ gpgcheck=0

4，配置parcel 仓库

Hosting an Internal Parcel Repository

配置httpd

1,Download the parcel and manifest.json files for your OS distribution from:

CDH 5: Impala, Kudu, Spark 1, and Search are included in the CDH parcel.

CDH - https://archive.cloudera.com/cdh5/parcels/

Accumulo - - https://archive.cloudera.com/accumulo-c5/parcels/

GPL Extras - https://archive.cloudera.com/gplextras5/parcels/

可以不做》

CDS 2 Powered by Apache Spark for CDH 5:

The exact parcel name is dependent on the OS. You can find all the parcels athttps://archive.cloudera.com/spark2/parcels/ .

Cloudera Navigator Key Trustee Server:

Go to the Key Trustee Server download page (http://www.cloudera.com/content/www/enus/downloads/navigator/key-trustee-server.html) . Select Parcels from the Package or Parcel drop-down menu, and click

2，Move the .parcel and manifest.json files to the web server directory, and modify the file permissions. The hosted .sha1 files

are not used by Cloudera Manager when it obtains the parcels from a web server. Instead, it extracts the SHA1 hashes provided in

manifest.json . For example

sudo mkdir -p /var/www/html/cloudera-parcels/cdh5/<cdh5_version>/
sudo mv *.parcel* /var/www/html/cloudera-parcels/cdh5/<cdh5_version>/
sudo mv manifest.json /var/www/html/cloudera-parcels/cdh5/<cdh5_version>/
sudo chmod -R ugo+rX /var/www/html/cloudera-parcels/cdh5/<cdh5_version>/

Replace <cdh5_version> with your CDH version (for example, 5.14.0 ). After moving the files and changing permissions, visit

http://<web_server>/cloudera-parcels/cdh5/<cdh5_version> to verify that you can access the parcel. If you do not see

anything, your web server may have been configured to not show indexes.

Configuring the Cloudera Manager Server to Use the Parcel URL for Hosted Repositories

In the Remote Parcel Repository URLs list, click the addition symbol to open an additional row.

3. Enter the path to the parcel. For example: http://<web_server>/cdh5/<cdh5_version>

4. Click Save Changes to commit the changes

配置使用本地的parcel 仓库

To use a local parcel repository, complete the following steps:

1. Open the Cloudera Manager web UI and navigate to the Parcels page.
2. Select Configuration and verify that you have a Local Parcel Repository path set. By default, the directory is /opt/cloudera/parcelrepo .
3. Remove any Remote Parcel Repository URLs you are not using, including ones that point to Cloudera archives.
4. Add the parcel you want to use to the local parcel repository directory that you specified.
5. In the command line, navigate to the local parcel repository directory.
6. Create a SHA1 hash for the parcel you added and save it to a file named <parcel_name>.parcel.sha .
   
   For example, the following command generates a SHA1 hash for the parcel CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel :

sha1sum CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel | awk '{ print $1 }' > CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.sha

1. Change the ownership of the parcel and hash files to cloudera-scm :

   sudo chown cloudera-scm:cloudera-scm *.parcel.*
   

2. In the Cloudera Manager web UI, navigate to the Parcels page

3. Click Check for New Parcels.

4. When the new parcel appears, download, distribute, and activate the parcel