Kafka Offset相关命令总结
Kafka Offset相关命令总结
作者:尹正杰
版权声明:原创作品,谢绝转载!否则将追究法律责任。
一.查询topic的offset的范围
1>.查询某个topic的offset的最小值
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114: -topic yinzhengjie --time -
yinzhengjie:: #很显然,第一列为topic名称,第二列为partition名称,第三列则是offset。为估计仔细的你应该已经发现了最小的offset为0,分区数为30个
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
[root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114: -topic yinzhengjie --time - | wc -l [root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic yinzhengjie --time -2
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114: -topic data.batch.ad --time -
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
[root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114: -topic data.batch.ad --time - |wc -l [root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic data.batch.ad --time -2
2>.查询某个topic的offset的最大值
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114: -topic yinzhengjie --time -
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
yinzhengjie::
[root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114: -topic yinzhengjie --time - | wc -l [root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic yinzhengjie --time -1
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114: -topic data.batch.ad --time -
data.batch.ad:: #很明显,以冒号为分割,第一列为topic名称,第二列为partition 编号,第三列为当前最大的便宜量位置!
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
data.batch.ad::
[root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114: -topic data.batch.ad --time - | wc -l [root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 10.1.2.114:9092 -topic data.batch.ad --time -1
二.查看consumer group列表,使用--list参数
查看consumer group列表有新、旧两种命令,分别查看新版(信息保存在broker中)consumer列表和老版(信息保存在zookeeper中)consumer列表,因而需要区分指定bootstrap--server和zookeeper参数:(本片博客测试的kafka版本为0.10.2.1)
[root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --zookeeper 10.1.2.114: --list
Note: This will only show information about consumers that use ZooKeeper (not those using the Java consumer API). #很显然,为这里使用的是kafka 0.10..1版本,我们是查询不到对应的信息的! [root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --zookeeper 10.1.2.114:2181 --list #老版本的consumer信息都保存在zookeeper中,很显然,0.10.2.1这个版本已经将consumer信息自己保存啦!
[root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --bootstrap-server 10.1.2.114: --list #查看新版consumer列表,很显然,我们可以查询到对应的数据
Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers). id-data.batch.ad
console-consumer-
id-data.batch.env
id-data.batch.er
id-data.batch.pl
console-consumer-
id-data.batch.op
[root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --bootstrap-server 10.1.2.114:9092 --list #查看新版consumer列表,很显然,我们可以查询到对应的数据
三.查看指定group.id 的消费者消费情况 (kafka-consumer-groups.sh)
[root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --new-consumer --bootstrap-server 10.1.2.114: --group id-data.batch.ad --describe
Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers). TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
data.batch.ad consumer--53498a12-e62b-46c8-9c5c-ad97f807698d /10.1.2.112 consumer-
[root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --new-consumer --bootstrap-server 10.1.2.114: --group id-data.batch.ad --describe | grep ad | wc -l
Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers). [root@node101.yinzhengjie.org.cn ~]# 简单对每列进行说明: TOPIC:
消费者的topic名称
PARTITION:
分区数的名称 CURRENT-OFFSET:
consumer group最后一次提交的offset LOG-END-OFFSET:
最后提交的生产消息offset
LAG
消费offset与生产offset之间的差值
CONSUMER-ID
消费者的ID编号,我们知道消费者组里面可以有最少要有一个消费者,当然也可以有多个消费者。
HOST
消费者的主机IP地址。
CLIENT-ID
链接的ID编号。
[root@node101.yinzhengjie.org.cn ~]# kafka-consumer-groups.sh --new-consumer --bootstrap-server 10.1.2.114:9092 --group id-data.batch.ad --describe
四. 查询 __consumer_offsets topic 所有内容
1>.运行下面命令前先要在consumer.properties中设置exclude.internal.topics=false
[root@node101.yinzhengjie.org.cn ~]# cat /soft/kafka/config/consumer.properties
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# see kafka.consumer.ConsumerConfig for more details # Zookeeper connection string
# comma separated host:port pairs, each corresponding to a zk
# server. e.g. "127.0.0.1:3000,127.0.0.1:3001,127.0.0.1:3002"
zookeeper.connect=127.0.0.1: # timeout in ms for connecting to zookeeper
zookeeper.connection.timeout.ms= #consumer group id
group.id=test-consumer-group #consumer timeout
#consumer.timeout.ms= exclude.internal.topics=false
[root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# cat /soft/kafka/config/consumer.properties
2>.0.11.0.0之前版本
[root@node101.yinzhengjie.org.cn ~]# kafka-console-consumer.sh --topic __consumer_offsets --bootstrap-server 10.1.2.114: --formatter "kafka.coordinator.GroupMetadataManager\$OffsetsMessageFormatter" --consumer.config /soft/kafka/config/consumer.properties --from-beginning
.......
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,96ef03f3-528a--9b56-7b98ea258ba4],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
[-data.batch.ad,data.batch.ad,]::[OffsetMetadata[,b350dc94-868b-42a5-91f3-7fb59ca7ea93],CommitTime ,ExpirationTime ]
.......
[root@node101.yinzhengjie.org.cn ~]# kafka-console-consumer.sh --topic __consumer_offsets --bootstrap-server 10.1.2.114:9092 --formatter "kafka.coordinator.GroupMetadataManager\$OffsetsMessageFormatter" --consumer.config /soft/kafka/config/consumer.properties --from-beginning
3>. 0.11.0.0之后版本(含)
[root@node101.yinzhengjie.org.cn ~]# kafka-console-consumer.sh --topic __consumer_offsets --bootstrap-server 10.1.2.114:9092 --formatter "kafka.coordinator.group.GroupMetadataManager\$OffsetsMessageFormatter" --consumer.config /soft/kafka/config/consumer.properties --from-beginning
五.
六.
Kafka Offset相关命令总结的更多相关文章
- kafka的offset相关知识
Offset存储模型 由于一个partition只能固定的交给一个消费者组中的一个消费者消费,因此Kafka保存offset时并不直接为每个消费者保存,而是以 groupid-topic-partit ...
- kafka 相关命令 偏移重置
kafka官方文档 https://kafka.apache.org/documentation.html#quickstart kafka 安装文档 https://www.jianshu.com/ ...
- kafka的相关操作脚本
总结最近用到的kafka相关命令和脚本. 1.创建Topic./kafka-topics.sh --zookeeper cc13-141:2182 --topic mytopic --replicat ...
- Redis key 相关命令
其实本质上,Redis 就是一个Key---Value 数据库.这里我先介绍下Redis中关于的key的相关命令, 注意:key是字符串存储,但是不能使用 空格 或者 “\n”,value 则可以使用 ...
- redis-key相关命令
本篇主要介绍和redis的key进行操作的相关命令. 命令 描述 复杂度 返回值 DEL key [key ...] 删除给定的一个或多个 key .不存在的 key 会被忽略.删除单个列表.集合.有 ...
- [Redis]Redis的五种数据类型与键值/服务器相关命令
-------------------------------------------------------------------------------------- String(字符串):最 ...
- kafka集群监控工具之三--kafka Offset Monitor
1.介绍 一般情况下,功能简单的kafka项目 使用运维命令+kafka Offset Monitor 就足够用了. 2.使用2.1 部署 github下载jar包 KafkaOffsetMonit ...
- 关于 Kafka offset
查询topic的offset的范围 用下面命令可以查询到topic:Mytopic broker:SparkMaster:9092的offset的最小值: bin/kafka-run-class.sh ...
- redis03----集合 set 相关命令
集合 set 相关命令 集合的性质: 唯一性,无序性,确定性 注: 在string和link的命令中,可以通过range 来访问string中的某几个字符或某几个元素 但,因为集合的无序性,无法通过下 ...
随机推荐
- django-admin和manage.py
目录 一.Django内置命令选项 check dbshell diffsettings flush makemigrations migrate runserver shell startapp s ...
- Sublime Text ——3200破解补丁
声明 该资源来源于网络,只为学习交流使用,侵权联系删除.长期使用和觉得sublime text 不错的话,还望购买授权码,多多支持正版!!! 重要的事情说三遍 请支持正版!!! 请支持正版!!! 请支 ...
- 大学jsp实验3include指令的使用
1.include指令的使用 (1)编写一个名为includeCopyRight.jsp的页面,页面的浏览效果如下: 要求“2016”这个值可以实现动态更新.请写出页面代码: <%@ page ...
- Codeforces551 C. GukiZ hates Boxes
二分答案 + 贪心 传送门:$>here<$ $Solution$ 二分时间+贪心验证.思维难度主要在验证上,然而坑人的点却在n的取值上.那么先来谈如何验证.在已知时间的条件下,能否用一种 ...
- Matplotlib学习---用matplotlib画误差线(errorbar)
误差线用于显示数据的不确定程度,误差一般使用标准差(Standard Deviation)或标准误差(Standard Error). 标准差(SD):是方差的算术平方根.如果是总体标准差,那么用σ表 ...
- Matplotlib学习---用matplotlib画箱线图(boxplot)
箱线图通过数据的四分位数来展示数据的分布情况.例如:数据的中心位置,数据间的离散程度,是否有异常值等. 把数据从小到大进行排列并等分成四份,第一分位数(Q1),第二分位数(Q2)和第三分位数(Q3)分 ...
- bzoj1559 [JSOI2009]密码
题目链接:[JSOI2009]密码 我们先看第一问:输出方案数 我们把所有给出来的串丢到AC自动机里面去,然后在建出来的\(trie\)图上跑dp 由于\(n\leq 10\)我们很自然的就想到了状压 ...
- 启发式合并&线段树合并/分裂&treap合并&splay合并
启发式合并 有\(n\)个集合,每次让你合并两个集合,或询问一个集合中是否存在某个元素. 我们可以用平衡树/set维护集合. 对于合并两个\(A,B\),如果\(|A|<|B|\),那么 ...
- MT【295】线段比的仿射变换
已知$F_1,F_2$分别为椭圆$\dfrac{x^2}{4}+\dfrac{y^2}{3}=1$的左右焦点.$A,B,C$是椭圆上$x$轴上方的三点,且$AF_1//BO//CF_2$,则$\dfr ...
- 信用算力基于 RocketMQ 实现金融级数据服务的实践
微服务架构已成为了互联网的热门话题之一,而这也是互联网技术发展的必然阶段.然而,微服务概念的提出者 Martin Fowler 却强调:分布式调用的第一原则就是不要分布式. 纵观微服务实施过程中的弊端 ...