Zookeeper单机伪集群部署

avatar 2020年2月29日18:01:00 评论 1,928 次浏览

zookeeper单价伪集群的部署和单机安装区别不大，伪集群就是在一台机器上安装三个zookeeper的应用，然后修改一下三个应用的端口，关联起来，这个在单机安装的时候说过，配置文件中没有集群部署的配置信息，需要自己单独添加。参考单机安装:https://www.wulaoer.org/?p=864

现在已经下载好文件了，我们需要在同一台机器上在安装两个zookeeper，然后联系起来即可。

  1.  [root@wulaoer.org local]# ll
  2. total 0
  3. drwxr-xr-x. 2 root root   6 Apr 11  2018 bin
  4. drwxr-xr-x. 2 root root   6 Apr 11  2018 etc
  5. drwxr-xr-x. 2 root root   6 Apr 11  2018 games
  6. drwxr-xr-x. 2 root root   6 Apr 11  2018 include
  7. drwxr-xr-x. 7   10  143 245 Oct  5 18:13 jdk
  8. drwxr-xr-x. 2 root root   6 Apr 11  2018 lib
  9. drwxr-xr-x. 2 root root   6 Apr 11  2018 lib64
  10. drwxr-xr-x. 2 root root   6 Apr 11  2018 libexec
  11. drwxr-xr-x. 2 root root   6 Apr 11  2018 sbin
  12. drwxr-xr-x. 5 root root  49 Feb  3 15:24 share
  13. drwxr-xr-x. 2 root root   6 Apr 11  2018 src
  14. drwxr-xr-x. 9 root root 168 Feb 24 14:37 zookeeper1
  15. drwxr-xr-x. 9 root root 168 Feb 24 14:37 zookeeper2
  16. drwxr-xr-x. 9 root root 168 Feb 24 14:37 zookeeper3

zookeeper1配置

下面我们针对每一个zookeeper进行针对配置，下面先配置zookeeper1，因为同一个应用，所以需要修改端口和数据路径以及日志路径，至于集群的配置信息不需要修改。

  1. [root@wulaoer.org local]# vim zookeeper1/conf/zoo.cfg 
  2. # The number of milliseconds of each tick
  3. tickTime=2000
  4. # The number of ticks that the initial
  5. # synchronization phase can take
  6. initLimit=10
  7. # The number of ticks that can pass between
  8. # sending a request and getting an acknowledgement
  9. syncLimit=5
  10. # the directory where the snapshot is stored.
  11. # do not use /tmp for storage, /tmp here is just
  12. # example sakes.
  13. dataDir=/usr/local/zookeeper1/data
  14. dataLogDir=/usr/local/zookeeper1/logs
  15. # the port at which the clients will connect
  16. clientPort=2181
  17. # the maximum number of client connections.
  18. # increase this if you need to handle more clients
  19. #maxClientCnxns=60
  20. #
  21. # Be sure to read the maintenance section of the
  22. # administrator guide before turning on autopurge.
  23. #
  24. # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
  25. #
  26. # The number of snapshots to retain in dataDir
  27. #autopurge.snapRetainCount=3
  28. # Purge task interval in hours
  29. # Set to "0" to disable auto purge feature
  30. #autopurge.purgeInterval=1
  31. server.1=127.0.0.1:12888:13888
  32. server.2=127.0.0.1:14888:15888
  33. server.3=127.0.0.1:16888:17888

配置好zookeeper文件后需要在data目录下创建一个myid文件，在myid文件中输入zookeeper的编号，以备集群区分。

  1. [root@wulaoer.org zookeeper1]# mkdir data
  2. [root@wulaoer.org zookeeper1]# touch data/myid
  3. [root@wulaoer.org zookeeper1]# echo "1" > data/myid

Zookeeper2配置

  1. [root@wulaoer.org local]# vim zookeeper2/conf/zoo.cfg 
  2. # The number of milliseconds of each tick
  3. tickTime=2000
  4. # The number of ticks that the initial
  5. # synchronization phase can take
  6. initLimit=10
  7. # The number of ticks that can pass between
  8. # sending a request and getting an acknowledgement
  9. syncLimit=5
  10. # the directory where the snapshot is stored.
  11. # do not use /tmp for storage, /tmp here is just
  12. # example sakes.
  13. dataDir=/usr/local/zookeeper2/data
  14. dataLogDir=/usr/local/zookeeper2/logs
  15. # the port at which the clients will connect
  16. clientPort=2182
  17. # the maximum number of client connections.
  18. # increase this if you need to handle more clients
  19. #maxClientCnxns=60
  20. #
  21. # Be sure to read the maintenance section of the
  22. # administrator guide before turning on autopurge.
  23. #
  24. # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
  25. #
  26. # The number of snapshots to retain in dataDir
  27. #autopurge.snapRetainCount=3
  28. # Purge task interval in hours
  29. # Set to "0" to disable auto purge feature
  30. #autopurge.purgeInterval=1
  31. server.1=127.0.0.1:12888:13888
  32. server.2=127.0.0.1:14888:15888
  33. server.3=127.0.0.1:16888:17888
  34.  
  35. [root@wulaoer.org zookeeper2]# mkdir data
  36. [root@wulaoer.org zookeeper2]# touch data/myid
  37. [root@wulaoer.org zookeeper2]# echo "2" > data/myid

Zookeeper3配置

  1. [root@wulaoer.org local]# vim zookeeper3/conf/zoo.cfg 
  2. # The number of milliseconds of each tick
  3. tickTime=2000
  4. # The number of ticks that the initial
  5. # synchronization phase can take
  6. initLimit=10
  7. # The number of ticks that can pass between
  8. # sending a request and getting an acknowledgement
  9. syncLimit=5
  10. # the directory where the snapshot is stored.
  11. # do not use /tmp for storage, /tmp here is just
  12. # example sakes.
  13. dataDir=/usr/local/zookeeper3/data
  14. dataLogDir=/usr/local/zookeeper3/logs
  15. # the port at which the clients will connect
  16. clientPort=2183
  17. # the maximum number of client connections.
  18. # increase this if you need to handle more clients
  19. #maxClientCnxns=60
  20. #
  21. # Be sure to read the maintenance section of the
  22. # administrator guide before turning on autopurge.
  23. #
  24. # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
  25. #
  26. # The number of snapshots to retain in dataDir
  27. #autopurge.snapRetainCount=3
  28. # Purge task interval in hours
  29. # Set to "0" to disable auto purge feature
  30. #autopurge.purgeInterval=1
  31. server.1=127.0.0.1:12888:13888
  32. server.2=127.0.0.1:14888:15888
  33. server.3=127.0.0.1:16888:17888
  34.  
  35. [root@wulaoer.org zookeeper3]# mkdir data
  36. [root@wulaoer.org zookeeper3]# touch data/myid
  37. [root@wulaoer.org zookeeper3]# echo "3" > data/myid

现在三个Zookeeper服务已经配置完成，下面我们启动一下三个服务。

  1. [root@wulaoer.org zookeeper1]# ./bin/zkServer.sh start
  2. ZooKeeper JMX enabled by default
  3. Using config: /usr/local/zookeeper1/bin/../conf/zoo.cfg
  4. Starting zookeeper ... STARTED
  5.  
  6. [root@wulaoer.org zookeeper2]# ./bin/zkServer.sh start
  7. ZooKeeper JMX enabled by default
  8. Using config: /usr/local/zookeeper2/bin/../conf/zoo.cfg
  9. Starting zookeeper ... STARTED
  10.  
  11. [root@wulaoer.org zookeeper3]# ./bin/zkServer.sh start
  12. ZooKeeper JMX enabled by default
  13. Using config: /usr/local/zookeeper3/bin/../conf/zoo.cfg
  14. Starting zookeeper ... STARTED

查看一下三个服务的状态，这里看到Zookeeper2是集群中的leader了。

  1. [root@wulaoer.org local]# ./zookeeper1/bin/zkServer.sh status
  2. ZooKeeper JMX enabled by default
  3. Using config: /usr/local/zookeeper1/bin/../conf/zoo.cfg
  4. Client port found: 2181. Client address: wulaoer.org.
  5. Mode: follower
  6. [root@wulaoer.org local]# ./zookeeper2/bin/zkServer.sh status
  7. ZooKeeper JMX enabled by default
  8. Using config: /usr/local/zookeeper2/bin/../conf/zoo.cfg
  9. Client port found: 2182. Client address: wulaoer.org.
  10. Mode: leader
  11. [root@wulaoer.org local]# ./zookeeper3/bin/zkServer.sh status
  12. ZooKeeper JMX enabled by default
  13. Using config: /usr/local/zookeeper3/bin/../conf/zoo.cfg
  14. Client port found: 2183. Client address: wulaoer.org.
  15. Mode: follower

zookeeper单机伪集群已经搭建完成，Zookeeper伪集群不建议在生产或者测试环境中使用，一旦机器出现故障整个集群都不可使用，建议分之三台集群中搭建集群。

总结

报错原因是我指定的日志格式的文件名，我指定的是log，但是单机安装的时候会生成一个logs

  1. java.io.IOException: No snapshot found, but there are log entries. Something is broken!
  2. 		at org.apache.zookeeper.server.persistence.FileTxnSnapLog.restore(FileTxnSnapLog.java:240)
  3. 		at org.apache.zookeeper.server.ZKDatabase.loadDataBase(ZKDatabase.java:240)
  4. 		at org.apache.zookeeper.server.quorum.QuorumPeer.loadDataBase(QuorumPeer.java:901)
  5. 		at org.apache.zookeeper.server.quorum.QuorumPeer.start(QuorumPeer.java:887)
  6. 		at org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:205)
  7. 		at org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123)
  8. 		at org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
  9. 2020-02-24 16:37:59,779 [myid:1] - ERROR [main:QuorumPeerMain@101] - Unexpected exception, exiting abnormally
  10. java.lang.RuntimeException: Unable to run quorum server

错误原因是因为没有在data目录下创建myid文件，所以也没有在myid文件中指定Zookeeper集群的编号。

  1. 2020-02-24 16:19:46,659 [myid:] - ERROR [main:QuorumPeerMain@89] - Invalid config, exiting abnormally
  2. org.apache.zookeeper.server.quorum.QuorumPeerConfig$ConfigException: Error processing /usr/local/zookeeper1/bin/../conf/zoo.cfg
  3. 		at org.apache.zookeeper.server.quorum.QuorumPeerConfig.parse(QuorumPeerConfig.java:156)
  4. 		at org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:113)
  5. 		at org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82)
  6. Caused by: java.lang.IllegalArgumentException: myid file is missing
  7. 		at org.apache.zookeeper.server.quorum.QuorumPeerConfig.checkValidity(QuorumPeerConfig.java:736)
  8. 		at org.apache.zookeeper.server.quorum.QuorumPeerConfig.setupQuorumPeerConfig(QuorumPeerConfig.java:607)
  9. 		at org.apache.zookeeper.server.quorum.QuorumPeerConfig.parseProperties(QuorumPeerConfig.java:422)
  10. 		at org.apache.zookeeper.server.quorum.QuorumPeerConfig.parse(QuorumPeerConfig.java:152)

Zookeeper伪集群已经单间完成。

avatar

发表评论

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

滑动解锁才能提交