原博文出自于：　　http://blog.fens.me/category/%E6%95%B0%E6%8D%AE%E5%BA%93/page/3/　　　　　　感谢！

Cassandra单集群实验2个节点

前言

Apache Cassandra是一套开源分布式Key-Value存储系统。它最初由Facebook开发，用于储存特别大的数据。主要特性：分布式，基于column的结构化，高伸展性。作为NoSQL的一支代表，虽然现在已经被hbase超越，但Cassandra的很多的设计思想是非常值得我们学习和借鉴的。感谢tigerfish老师的详细讲解，让我收获颇多！

Cassandra中非常有用的几个概念：一致性哈希，Gossip协议，Snitch，复制策略，DHT，BloomFilter。

关于作者：
张丹(Conan), 程序员Java,R,PHP,Javascript
weibo：@Conan_Z
blog: http://blog.fens.me
email: bsspirit@gmail.com

转载请注明出处：
http://blog.fens.me/cassandra-clustor/

目录

  1. Cassandra集群实验2个节点
  2. 实验过程的错误及修复

1. Cassandra集群实验2个节点

1. 下载Cassandra并配置JAVA环境(跳过)
2. 安装第一个Cassandra节点，解压到/home/conan/toolkit/cassandra125目录

  1. ~ pwd
  2. /home/conan/toolkit/cassandra125

ip地址：192.168.1.200


  2. ~ ifconfig
  3. eth0      Link encap:Ethernet  HWaddr 08:00:27:90:e8:19
  4.       inet addr:192.168.1.200  Bcast:192.168.1.255  Mask:255.255.255.0
  5.       inet6 addr: fe80::a00:27ff:fe90:e819/64 Scope:Link
  6.       UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
  7.       RX packets:16943 errors:0 dropped:0 overruns:0 frame:0
  8.       TX packets:19527 errors:0 dropped:0 overruns:0 carrier:0
  9.       collisions:0 txqueuelen:1000
  10.       RX bytes:1433046 (1.4 MB)  TX bytes:2902059 (2.9 MB)

3. 设置环境变更


  2. ~ sudo vi /etc/environment
  3. CASSANDRA_HOME=/home/conan/toolkit/cassandra125
  5. ~ . /etc/environment
  7. ~ export |grep /home/conan/toolkit/cassandra125
  8. declare -x CASSANDRA_HOME="/home/conan/toolkit/cassandra125"
  9. declare -x OLDPWD="/home/conan/toolkit/cassandra125"
  10. declare -x PWD="/home/conan/toolkit/cassandra125/bin"

4. 创建存储和日志目录


  2. ~ sudo rm -rf /var/lib/cassandra
  4. ~ sudo mkdir -p /var/lib/cassandra/data
  5. ~ sudo mkdir -p /var/lib/cassandra/saved_caches
  6. ~ sudo mkdir -p /var/lib/cassandra/commitlog
  7. ~ sudo mkdir -p /var/log/cassandra/
  9. ~ sudo chown -R conan:conan /var/lib/cassandra
  10. ~ sudo chown -R conan:conan /var/log/cassandra
  12. ~ ls -l /var/lib/cassandra
  13. drwxr-xr-x  2 conan conan 4096 Jul  4 00:15 commitlog/
  14. drwxr-xr-x  2 conan conan 4096 Jul  4 00:15 data/
  15. drwxr-xr-x  2 conan conan 4096 Jul  4 00:15 saved_caches/

5. 修改配置文件cassandra.yaml，按文件顺序列表修改的地方


  2. ~ vi /home/conan/toolkit/cassandra125/conf/cassandra.yaml
  4. cluster_name: 'case1'
  5. num_tokens: 256
  7. data_file_directories:
  8. - /var/lib/cassandra/data
  10. commitlog_directory: /var/lib/cassandra/commitlog
  12. saved_caches_directory: /var/lib/cassandra/saved_caches
  14. seed_provider:
  15. - class_name: org.apache.cassandra.locator.SimpleSeedProvider
  16.   parameters:
  17.       - seeds: "192.168.1.200"
  19. #listen_address: localhost
  20. listen_address: 192.168.1.200
  22. #rpc_address: localhost
  23. rpc_address: 192.168.1.200
  25. endpoint_snitch: SimpleSnitch

6. 启动节点


  2. ~ cd /home/conan/toolkit/cassandra125/
  4. ~ bin/cassandra -f
  6. #部分日志
  7. INFO 00:23:22,785 Enqueuing flush of Memtable-schema_columnfamilies@1792194126(1097/1097 serialized/live bytes, 20 ops)
  8. INFO 00:23:22,786 Writing Memtable-schema_columnfamilies@1792194126(1097/1097 serialized/live bytes, 20 ops)
  9. INFO 00:23:22,796 Completed flushing /var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-ic-2-Data.db (698 bytes) for commitlog position ReplayPosition(segmentId=1372868601408, position=64705)
  10. INFO 00:23:22,797 Enqueuing flush of Memtable-schema_columns@552364977(251/251 serialized/live bytes, 5 ops)
  11. INFO 00:23:22,798 Writing Memtable-schema_columns@552364977(251/251 serialized/live bytes, 5 ops)
  12. INFO 00:23:22,808 Completed flushing /var/lib/cassandra/data/system/schema_columns/system-schema_columns-ic-2-Data.db (209 bytes) for commitlog position ReplayPosition(segmentId=1372868601408, position=64705)
  13. INFO 00:23:22,894 Starting listening for CQL clients on /192.168.1.200:9042...
  14. INFO 00:23:22,906 Binding thrift service to /192.168.1.200:9160
  15. INFO 00:23:22,931 Using TFramedTransport with a max frame size of 15728640 bytes.
  16. INFO 00:23:22,952 Using synchronous/threadpool thrift server on 192.168.1.200 : 9160
  17. INFO 00:23:22,953 Listening for thrift clients...
  18. INFO 00:23:33,101 Created default superuser 'cassandra'

7. 查看集群的状态


  2. bin/nodetool status
  3. Datacenter: datacenter1
  4. =======================
  5. Status=Up/Down
  6. |/ State=Normal/Leaving/Joining/Moving
  7. --  Address        Load       Tokens  Owns (effective)  Host ID                               Rack
  8. UN  192.168.1.200  51.01 KB   256     100.0%            e7106e0a-1a9e-43a2-9bcc-fc1201076fee  rack1

8. 增加第2个节点到集群：2个节点
计算机ip: 192.168.1.201


  2. ~ ifconfig
  3. eth0      Link encap:Ethernet  HWaddr 08:00:27:0d:0b:0b
  4.           inet addr:192.168.1.201  Bcast:192.168.1.255  Mask:255.255.255.0
  5.           inet6 addr: fe80::a00:27ff:fe0d:b0b/64 Scope:Link
  6.           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
  7.           RX packets:45455 errors:0 dropped:0 overruns:0 frame:0
  8.           TX packets:14717 errors:0 dropped:0 overruns:0 carrier:0
  9.           collisions:0 txqueuelen:1000
  10.           RX bytes:33590582 (33.5 MB)  TX bytes:2549931 (2.5 MB)

9. 从第一节点192.168.1.200把cassandra125和jdk目录复制过来


  2. ~ pwd
  3. /home/conan/toolkit
  5. ~ scp -r conan@192.168.1.200:/home/conan/toolkit/cassandra125 .
  6. ~ scp -r conan@192.168.1.200:/home/conan/toolkit/jdk16 .
  8. ~ ls -l
  9. drwxrwxr-x  9 conan conan 4096 Apr 25 03:04 cassandra125
  10. drwxr-xr-x 10 conan conan 4096 Apr 25 03:33 jdk16

10. 设置环境变量


  2. ~ sudo vi /etc/environment
  4. PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/home/conan/toolkit/jdk16/bin:/home/conan/toolkit/cassandra/bin"
  5. JAVA_HOME=/home/conan/toolkit/jdk16
  6. CASSANDRA_HOME=/home/conan/toolkit/cassandra125
  8. ~ . /etc/environment
  10. ~ java -version
  11. java version "1.6.0_29"
  12. Java(TM) SE Runtime Environment (build 1.6.0_29-b11)
  13. Java HotSpot(TM) 64-Bit Server VM (build 20.4-b02, mixed mode)

11. 创建存储和日志目录


  2. ~ sudo rm -rf /var/lib/cassandra
  4. ~ sudo mkdir -p /var/lib/cassandra/data
  5. ~ sudo mkdir -p /var/lib/cassandra/saved_caches
  6. ~ sudo mkdir -p /var/lib/cassandra/commitlog
  7. ~ sudo mkdir -p /var/log/cassandra/
  9. ~ sudo chown -R conan:conan /var/lib/cassandra
  10. ~ sudo chown -R conan:conan /var/log/cassandra
  12. ~ ls -l /var/lib/cassandra
  13. drwxr-xr-x  2 conan conan 4096 Jul  4 00:15 commitlog/
  14. drwxr-xr-x  2 conan conan 4096 Jul  4 00:15 data/
  15. drwxr-xr-x  2 conan conan 4096 Jul  4 00:15 saved_caches/

12. 修改配置文件cassandra.yaml，按文件顺序列表修改的地方


  2. ~ vi /home/conan/toolkit/cassandra125/conf/cassandra.yaml
  4. cluster_name: 'case1'
  6. seed_provider:
  7. - class_name: org.apache.cassandra.locator.SimpleSeedProvider
  8.   parameters:
  9.       - seeds: "192.168.1.200"
  11. listen_address: 192.168.1.201
  13. rpc_address: 192.168.1.201

13. 启动节点192.168.1.201


  2. ~ bin/cassandra -f
  4. //部分日志
  5. INFO 03:36:47,476 Completed flushing /var/lib/cassandra/data/system/local/system-local-ic-4-Data.db (75 bytes) for commitlog position ReplayPosition(segmentId=1366832174115, position=77582)
  6. INFO 03:36:47,504 Compacting [SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-ic-1-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-ic-3-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-ic-4-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-ic-2-Data.db')]
  7. INFO 03:36:47,527 Enqueuing flush of Memtable-local@692438881(10094/10094 serialized/live bytes, 257 ops)
  8. INFO 03:36:47,533 Writing Memtable-local@692438881(10094/10094 serialized/live bytes, 257 ops)
  9. INFO 03:36:47,547 Completed flushing /var/lib/cassandra/data/system/local/system-local-ic-5-Data.db (5365 bytes) for commitlog position ReplayPosition(segmentId=1366832174115, position=89585)
  10. INFO 03:36:47,660 Node /192.168.1.201 state jump to normal
  11. INFO 03:36:47,663 Startup completed! Now serving reads.
  12. INFO 03:36:47,686 Compacted 4 sstables to [/var/lib/cassandra/data/system/local/system-local-ic-6,].  5,956 bytes to 5,687 (~95% of original) in 158ms = 0.034326MB/s.  4 total rows, 1 unique.  Row merge counts were {1:0, 2:0, 3:0, 4:1, }
  13. INFO 03:36:47,771 Starting listening for CQL clients on /192.168.1.201:9042...
  14. INFO 03:36:47,785 Binding thrift service to /192.168.1.201:9160
  15. INFO 03:36:47,810 Using TFramedTransport with a max frame size of 15728640 bytes.
  16. INFO 03:36:47,834 Using synchronous/threadpool thrift server on 192.168.1.201 : 9160
  17. INFO 03:36:47,834 Listening for thrift clients...

14. 查看节点1，192.168.1.200的日志


  2. INFO 01:01:27,382 InetAddress /192.168.1.201 is now UP
  3. INFO 01:01:58,660 Beginning transfer to /192.168.1.201
  4. INFO 01:01:58,661 Flushing memtables for [CFS(Keyspace='system_auth', ColumnFamily='users')]...
  5. INFO 01:01:58,663 Enqueuing flush of Memtable-users@1338035062(28/28 serialized/live bytes, 2 ops)
  6. INFO 01:01:58,668 Writing Memtable-users@1338035062(28/28 serialized/live bytes, 2 ops)
  7. INFO 01:01:59,010 Completed flushing /var/lib/cassandra/data/system_auth/users/system_auth-users-ic-1-Data.db (64 bytes) for commitlog position ReplayPosition(segmentId=1372868601408, position=65900)
  8. INFO 01:01:59,047 Stream context metadata [/var/lib/cassandra/data/system_auth/users/system_auth-users-ic-1-Data.db sections=1 progress=0/64 - 0%], 1 sstables.
  9. INFO 01:01:59,048 Streaming to /192.168.1.201
  10. INFO 01:01:59,122 Successfully sent /var/lib/cassandra/data/system_auth/users/system_auth-users-ic-1-Data.db to /192.168.1.201
  11. INFO 01:01:59,123 Finished streaming session to /192.168.1.201
  12. INFO 01:01:59,424 Enqueuing flush of Memtable-peers@1855686378(10279/10279 serialized/live bytes, 271 ops)
  13. INFO 01:01:59,425 Writing Memtable-peers@1855686378(10279/10279 serialized/live bytes, 271 ops)
  14. INFO 01:01:59,497 Completed flushing /var/lib/cassandra/data/system/peers/system-peers-ic-1-Data.db (5538 bytes) for commitlog position ReplayPosition(segmentId=1372868601408, position=77902)

15. 集群中已经成功加载了192.168.1.201个节点了。


  2. bin/nodetool status
  4. Datacenter: datacenter1
  5. =======================
  6. Status=Up/Down
  7. |/ State=Normal/Leaving/Joining/Moving
  8. --  Address        Load       Tokens  Owns (effective)  Host ID                               Rack
  9. UN  192.168.1.200  65.46 KB   256     48.7%             e7106e0a-1a9e-43a2-9bcc-fc1201076fee  rack1
  10. UN  192.168.1.201  58.04 KB   256     51.3%             8eef1965-9822-44bf-a9f6-fff5b87bc474  rack1

实验完成！！

2. 实验过程的错误及修复

1. 不要在已经建立keystore的节点，再修改cluster name
出现下面的错误


  2. ERROR 23:29:58,004 Fatal exception during initialization
  3. org.apache.cassandra.exceptions.ConfigurationException: Saved cluster name Test Cluster != configured name case1

解决办法：http://wiki.apache.org/cassandra/FAQ


  2. Cassandra says "ClusterName mismatch: oldClusterName != newClusterName" and refuses to start
  4. To prevent operator errors, Cassandra stores the name of the cluster in its system table. If you need to rename a cluster for some reason, you can:
  6. Perform these steps on each node:
  8. Start the cassandra-cli connected locally to this node.
  9. Run the following:
  10. use system;
  11. set LocationInfo[utf8('L')][utf8('ClusterName')]=utf8('');
  12. exit;
  13. Run nodetool flush on this node.
  14. Update the cassandra.yaml file for the cluster_name as the same as 2b).
  15. Restart the node.
  16. Once all nodes have been had this operation performed and restarted, nodetool ring should show all nodes as UP.

2. 修改配置文件时:后一定要有空格
会出现下面的错误提示：


  2. while scanning a simple key; could not found expected ':'

举例：修改下面配置


  2. #错误语法
  3. listen_address:localhost
  5. #正确语法
  6. listen_address: localhost

问题解释：
上面问题是由于，:和”之间没有空格，引起的解析错误。

转载请注明出处：
http://blog.fens.me/cassandra-clustor/

转】Cassandra单集群实验2个节点的更多相关文章

  1. cassandra集群缩容与剔除问题节点

    今天在操作cassandra集群数据迁移时发生了一些意料之外的事情,服务器迁移前与迁移后同样为5台,但是不知道是什么原因导致的,迁移过后的节点居然多出了一台cassandra节点,个人瞬间感觉莫名其妙 ...

  2. cassandra集群环境搭建——注意seeds节点，DHT p2p集群管理难道初始化都应如此吗？

    解压cassandra的安装包后可以查看主要的配置文件,都在conf/目录下,conf/cassandra.yaml比较重要,其中需要着重注意的有以下一些配置项: cluster_name: 'TC0 ...

  3. [转帖]单集群10万节点 走进腾讯云分布式调度系统VStation

    单集群10万节点 走进腾讯云分布式调度系统VStation https://www.sohu.com/a/227223696_355140 2018-04-04 08:18 云计算并非无中生有的概念, ...

  4. Redis单机多节点集群实验

    第一步:安装Redis 前面已经安装过了 不解释, Reids安装包里有个集群工具,要复制到/usr/local/bin里去 cp redis-3.2.9/src/redis-trib.rb /usr ...

  5. Redis多机多节点集群实验

    第一步:环境准备 我们搞两台虚拟机 局域网IP 分别是 192.168.1.109和192.168.1.110 我们约定把192.168.1.109作为集群控制端,需要安装redis-trib.rb ...

  6. elasticsearch介绍集群,模拟横向扩展节点、节点宕机、改变分片

        出处:[http://www.cnblogs.com/dennisit/p/4133131.html] ,防楼主删博,故保留一份! elasticsearch用于构建高可用和可扩展的系统.扩展 ...

  7. Kubernetes集群部署之五node节点部署

    Node节点是Kubernetes集群中的工作负载节点.每个node都会被master分配一些工作负载,每个node节点都运行以下关键服务进程.Kubelet :负责pod对应的容器的创建.启停等任务 ...

  8. 【译】Apache Kafka支持单集群20万分区

    之前网上关于确定Kafka分区数的博客多多少少都源自于饶军大神的文章,如今他带来了这方面的第二篇文章,特此翻译一下,记录一下其中的要点. 原贴地址: https://www.confluent.io/ ...

  9. Kafka支持单集群20万分区

    Kafka支持单集群20万分区 之前网上关于确定Kafka分区数的博客多多少少都源自于饶军大神的文章,如今他带来了这方面的第二篇文章,特此翻译一下,记录一下其中的要点. 原贴地址: https://w ...

随机推荐

  1. JS应用之禁止抓屏、复制、打印

    JS应用之禁止抓屏.复制.打印项目需要禁止抓屏.复制.打印的要求,复制.打印做起来可能顺手一点网上各种各样的脚本俯首皆是.但抓屏怎么禁止?PrintScreen是一个特殊的键,它是没有keyCode的 ...

  2. C语言-- static 全局使用示例

    C语言-- static 全局使用示例  前言:看到很多使用Objective-C开发IOS的大牛,有时候会使用static全局变量,相比之下,我却很少用这个,从而很少对其有着比较有实质意义的理解,甚 ...

  3. Python爬虫开发【第1篇】【机器视觉及Tesseract】

    ORC库概述 在读取和处理图像.图像相关的机器学习以及创建图像等任务中,Python 一直都是非常出色的语言.虽然有很多库可以进行图像处理,但在这里我们只重点介绍:Tesseract 1.Tesser ...

  4. WinPE：创建 USB 可引导驱动器

    https://msdn.microsoft.com/zh-cn/library/windows/hardware/dn938386(v=vs.85).aspx

  5. jQuery - AJAX 级联变动

    此篇文章主要是用来记忆使用JQUERY+AJAX技术实现 二级级联变动 : 当第一个下拉框变动时,第二个下拉列表框中也将会随之变动. JSP: ---------------------------- ...

  6. I.MX6 逻辑分析仪 UART

    /*********************************************************************** * I.MX6 逻辑分析仪 UART * 说明: * ...

  7. memcached value最大限制只能是1M吗

    关于memcached的value最大是1M的限制很多人都知道,但是如果你以为我还要说这个事情,那你就错了. 之前的老版本确实是只能是1M,但是根据git记录,其实2009年以后的版本这个value最 ...

  8. sqlserver2008Mail

    use msdb  GO    DROP PROC MailTim  GO    CREATE PROC MailTim  @Subject NVARCHAR(100),@Body NVARCHAR( ...

  9. UI：单例的写法

    单例设计模式 参考 UIApplication sharedApplocation 详细解释 :参考 通讯录的helper 类的读取本地plist 文件的时候,使用的单例单例的要点有三个:一个类只能有 ...

  10. js方式的页面跳转

    window.location.href="login.html";   (直接function里面执行 跳转)