概念,见博客

Storm概念学习系列之storm的可靠性

   什么业务场景需要storm可靠性的ACK确认机制?

  答:想要保住数据不丢,或者保住数据总是被处理。即若没被处理的,得让我们知道。

  

public void nextTuple() {
num++;
System.out.println("spout:"+num);
int messageid = num;
//开启消息确认机制,就是在发送数据的时候发送一个messageid,一般情况下,messageid可以理解为mysql数据里面的主键id字段
//要保证messageid和tuple之间有一个唯一的对应关系,这个关系需要程序员自己维护
this.collector.emit(new Values(num),messageid);
Utils.sleep();
}

  

  编写代码

  StormTopologyAcker.java

package zhouls.bigdata.stormDemo;

import java.util.Map;

import org.apache.storm.Config;
import org.apache.storm.LocalCluster;
import org.apache.storm.StormSubmitter;
import org.apache.storm.generated.AlreadyAliveException;
import org.apache.storm.generated.AuthorizationException;
import org.apache.storm.generated.InvalidTopologyException;
import org.apache.storm.spout.SpoutOutputCollector;
import org.apache.storm.task.OutputCollector;
import org.apache.storm.task.TopologyContext;
import org.apache.storm.topology.OutputFieldsDeclarer;
import org.apache.storm.topology.TopologyBuilder;
import org.apache.storm.topology.base.BaseRichBolt;
import org.apache.storm.topology.base.BaseRichSpout;
import org.apache.storm.tuple.Fields;
import org.apache.storm.tuple.Tuple;
import org.apache.storm.tuple.Values;
import org.apache.storm.utils.Utils; public class StormTopologyAcker { public static class MySpout extends BaseRichSpout{
private Map conf;
private TopologyContext context;
private SpoutOutputCollector collector; public void open(Map conf, TopologyContext context,
SpoutOutputCollector collector) {
this.conf = conf;
this.collector = collector;
this.context = context;
} int num = ; public void nextTuple() {
num++;
System.out.println("spout:"+num);
int messageid = num;
//开启消息确认机制,就是在发送数据的时候发送一个messageid,一般情况下,messageid可以理解为mysql数据里面的主键id字段
//要保证messageid和tuple之间有一个唯一的对应关系,这个关系需要程序员自己维护
this.collector.emit(new Values(num),messageid);
Utils.sleep();
} public void declareOutputFields(OutputFieldsDeclarer declarer) {
declarer.declare(new Fields("num"));
} @Override
public void ack(Object msgId) {
System.out.println("处理成功!"+msgId);
} @Override
public void fail(Object msgId) {
System.out.println("处理失败!"+msgId);
//TODO 可以吧这个数据单独记录下来
} } public static class MyBolt extends BaseRichBolt{ private Map stormConf;
private TopologyContext context;
private OutputCollector collector; public void prepare(Map stormConf, TopologyContext context,
OutputCollector collector) {
this.stormConf = stormConf;
this.context = context;
this.collector = collector;
} int sum = ; public void execute(Tuple input) {
try{
Integer num = input.getIntegerByField("num");
sum += num;
System.out.println("sum="+sum);
this.collector.ack(input);
}catch(Exception e){
this.collector.fail(input);
}
} public void declareOutputFields(OutputFieldsDeclarer declarer) { } } public static void main(String[] args) {
TopologyBuilder topologyBuilder = new TopologyBuilder();
String spout_id = MySpout.class.getSimpleName();
String bolt_id = MyBolt.class.getSimpleName(); topologyBuilder.setSpout(spout_id, new MySpout());
topologyBuilder.setBolt(bolt_id, new MyBolt()).shuffleGrouping(spout_id); Config config = new Config();
config.setMaxSpoutPending();//如果设置了这个参数,必须要保证开启了acker机制才有效
String topology_name = StormTopologyAcker.class.getSimpleName();
if(args.length==){
//在本地运行
LocalCluster localCluster = new LocalCluster();
localCluster.submitTopology(topology_name, config, topologyBuilder.createTopology());
}else{
//在集群运行
try {
StormSubmitter.submitTopology(topology_name, config, topologyBuilder.createTopology());
} catch (AlreadyAliveException e) {
e.printStackTrace();
} catch (InvalidTopologyException e) {
e.printStackTrace();
} catch (AuthorizationException e) {
e.printStackTrace();
}
} } }

  停掉,我们复制粘贴来分析分析

 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:zookeeper.version=3.4.-, built on // : GMT
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:host.name=WIN-BQOBV63OBNM
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.version=1.8.0_66
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.vendor=Oracle Corporation
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.home=C:\Program Files\Java\jre1..0_66
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.class.path=D:\Code\eclipseMarsCode\stormDemo\target\classes;D:\SoftWare\maven\repository\org\apache\storm\storm-core\1.0.\storm-core-1.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\kryo\3.0.\kryo-3.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\reflectasm\1.10.\reflectasm-1.10..jar;D:\SoftWare\maven\repository\org\ow2\asm\asm\5.0.\asm-5.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\minlog\1.3.\minlog-1.3..jar;D:\SoftWare\maven\repository\org\objenesis\objenesis\2.1\objenesis-2.1.jar;D:\SoftWare\maven\repository\org\clojure\clojure\1.7.\clojure-1.7..jar;D:\SoftWare\maven\repository\com\lmax\disruptor\3.3.\disruptor-3.3..jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-api\2.1\log4j-api-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-core\2.1\log4j-core-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-slf4j-impl\2.1\log4j-slf4j-impl-2.1.jar;D:\SoftWare\maven\repository\org\slf4j\log4j-over-slf4j\1.6.\log4j-over-slf4j-1.6..jar;D:\SoftWare\maven\repository\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\SoftWare\maven\repository\org\slf4j\slf4j-api\1.7.\slf4j-api-1.7..jar
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.library.path=C:\Program Files\Java\jre1..0_66\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:/Program Files/Java/jre1..0_66/bin/server;C:/Program Files/Java/jre1..0_66/bin;C:/Program Files/Java/jre1..0_66/lib/amd64;%WEKA39_HOME%\lib\mysql-connector-java-5.1.-bin.jar;%WEKA37_HOME%\lib\mysql-connector-java-5.1.-bin.jar;C:\Program Files\Java\jdk1..0_66\jre\lib\ext\mysql-connector-java-5.1.-bin.jar;C:\ProgramData\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.\;D:\SoftWare\MATLAB R2013a\runtime\win64;D:\SoftWare\MATLAB R2013a\bin;C:\Program Files (x86)\IDM Computer Solutions\UltraCompare;C:\Program Files\Java\jdk1..0_66\bin;C:\Program Files\Java\jdk1..0_66\jre\bin;D:\SoftWare\apache-ant-1.9.\bin;HADOOP_HOME\bin;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\Scala\bin;D:\SoftWare\Scala\jre\bin;%MYSQL_HOME\bin;D:\SoftWare\MySQL\mysql-5.7.-winx64;;D:\SoftWare\apache-tomcat-7.0.\bin;%C:\Windows\System32;%C:\Windows\SysWOW64;;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\Anaconda2;D:\SoftWare\Anaconda2\Scripts;D:\SoftWare\Anaconda2\Library\bin;D:\SoftWare\MySQL Server\MySQL Server 5.0\bin;D:\SoftWare\Python\Python36\Scripts\;D:\SoftWare\Python\Python36\;D:\SoftWare\SSH Secure Shell;D:\SoftWare\eclipse;;.
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.io.tmpdir=C:\Users\ADMINI~\AppData\Local\Temp\
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.compiler=<NA>
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.name=Windows
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.arch=amd64
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.version=6.1
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.name=Administrator
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.home=C:\Users\Administrator
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.dir=D:\Code\eclipseMarsCode\stormDemo
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Created server with tickTime minSessionTimeout maxSessionTimeout datadir C:\Users\ADMINI~\AppData\Local\Temp\0d2c165c-61e3-45ea-957f-8ecaeea3b694\version- snapdir C:\Users\ADMINI~\AppData\Local\Temp\0d2c165c-61e3-45ea-957f-8ecaeea3b694\version-
[main] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - binding to port 0.0.0.0/0.0.0.0:
[main] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - binding to port 0.0.0.0/0.0.0.0:
[main] INFO o.a.s.zookeeper - Starting inprocess zookeeper at port and dir C:\Users\ADMINI~\AppData\Local\Temp\0d2c165c-61e3-45ea-957f-8ecaeea3b694
[main] INFO o.a.s.d.nimbus - Starting Nimbus with conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\d7cdc68c-f54c-4677-ac0e-d73c3b2effb3", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" [ ], "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:zookeeper.version=3.4.-, built on // : GMT
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:host.name=WIN-BQOBV63OBNM
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.version=1.8.0_66
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.vendor=Oracle Corporation
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.home=C:\Program Files\Java\jre1..0_66
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.class.path=D:\Code\eclipseMarsCode\stormDemo\target\classes;D:\SoftWare\maven\repository\org\apache\storm\storm-core\1.0.\storm-core-1.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\kryo\3.0.\kryo-3.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\reflectasm\1.10.\reflectasm-1.10..jar;D:\SoftWare\maven\repository\org\ow2\asm\asm\5.0.\asm-5.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\minlog\1.3.\minlog-1.3..jar;D:\SoftWare\maven\repository\org\objenesis\objenesis\2.1\objenesis-2.1.jar;D:\SoftWare\maven\repository\org\clojure\clojure\1.7.\clojure-1.7..jar;D:\SoftWare\maven\repository\com\lmax\disruptor\3.3.\disruptor-3.3..jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-api\2.1\log4j-api-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-core\2.1\log4j-core-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-slf4j-impl\2.1\log4j-slf4j-impl-2.1.jar;D:\SoftWare\maven\repository\org\slf4j\log4j-over-slf4j\1.6.\log4j-over-slf4j-1.6..jar;D:\SoftWare\maven\repository\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\SoftWare\maven\repository\org\slf4j\slf4j-api\1.7.\slf4j-api-1.7..jar
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.library.path=C:\Program Files\Java\jre1..0_66\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:/Program Files/Java/jre1..0_66/bin/server;C:/Program Files/Java/jre1..0_66/bin;C:/Program Files/Java/jre1..0_66/lib/amd64;%WEKA39_HOME%\lib\mysql-connector-java-5.1.-bin.jar;%WEKA37_HOME%\lib\mysql-connector-java-5.1.-bin.jar;C:\Program Files\Java\jdk1..0_66\jre\lib\ext\mysql-connector-java-5.1.-bin.jar;C:\ProgramData\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.\;D:\SoftWare\MATLAB R2013a\runtime\win64;D:\SoftWare\MATLAB R2013a\bin;C:\Program Files (x86)\IDM Computer Solutions\UltraCompare;C:\Program Files\Java\jdk1..0_66\bin;C:\Program Files\Java\jdk1..0_66\jre\bin;D:\SoftWare\apache-ant-1.9.\bin;HADOOP_HOME\bin;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\Scala\bin;D:\SoftWare\Scala\jre\bin;%MYSQL_HOME\bin;D:\SoftWare\MySQL\mysql-5.7.-winx64;;D:\SoftWare\apache-tomcat-7.0.\bin;%C:\Windows\System32;%C:\Windows\SysWOW64;;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\Anaconda2;D:\SoftWare\Anaconda2\Scripts;D:\SoftWare\Anaconda2\Library\bin;D:\SoftWare\MySQL Server\MySQL Server 5.0\bin;D:\SoftWare\Python\Python36\Scripts\;D:\SoftWare\Python\Python36\;D:\SoftWare\SSH Secure Shell;D:\SoftWare\eclipse;;.
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.io.tmpdir=C:\Users\ADMINI~\AppData\Local\Temp\
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.compiler=<NA>
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:os.name=Windows
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:os.arch=amd64
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:os.version=6.1
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:user.name=Administrator
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:user.home=C:\Users\Administrator
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:user.dir=D:\Code\eclipseMarsCode\stormDemo
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@6824b913
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.p.FileTxnLog - Creating new log file: log.
[main] INFO o.a.s.b.FileBlobStoreImpl - Creating new blob store based in C:\Users\ADMINI~\AppData\Local\Temp\d7cdc68c-f54c--ac0e-d73c3b2effb3\blobs
[main] INFO o.a.s.d.nimbus - Using default scheduler
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820000 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820000, negotiated timeout =
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@21a9a705
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820001 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820001, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@753fd7a1
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820002 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820002, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d87b848820002
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d87b848820002 closed
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d87b848820002
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@70025b99
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@3ba3d4b6
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820003 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820003, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820004 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820004, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.zookeeper - Queued up for leader lock.
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Got user-level KeeperException when processing sessionid:0x15d87b848820001 type:create cxid:0x1 zxid:0x12 txntype:- reqpath:n/a Error Path:/storm/leader-lock Error:KeeperErrorCode = NoNode for /storm/leader-lock
[Curator-Framework-] WARN o.a.s.s.o.a.c.u.ZKPaths - The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead.
[main] INFO o.a.s.d.m.MetricsUtils - Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter
[main] INFO o.a.s.d.m.r.JmxPreparableReporter - Preparing...
[main-EventThread] INFO o.a.s.zookeeper - WIN-BQOBV63OBNM gained leadership, checking if it has all the topology code locally.
[main] INFO o.a.s.d.common - Started statistics report plugin...
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@1b9d9a2b
[main-EventThread] INFO o.a.s.zookeeper - active-topology-ids [] local-topology-ids [] diff-topology []
[main-EventThread] INFO o.a.s.zookeeper - Accepting leadership, all active topology found localy.
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820005 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820005, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d87b848820005
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d87b848820005
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d87b848820005 closed
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@7c281eb8
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@4a8ffd75
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820006, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820006 with negotiated timeout for client /127.0.0.1:
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820007, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820007 with negotiated timeout for client /127.0.0.1:
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d87b848820007
[Curator-ConnectionStateManager-] WARN o.a.s.s.o.a.c.f.s.ConnectionStateManager - There are no ConnectionStateListeners registered.
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d87b848820007 closed
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@3e05586b
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] WARN o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x15d87b848820007, likely client has closed socket
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:) [storm-core-1.0..jar:1.0.]
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:) [storm-core-1.0..jar:1.0.]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_66]
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d87b848820007
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820008, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820008 with negotiated timeout for client /127.0.0.1:
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.d.supervisor - Starting Supervisor with conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\fc1c162d-e299-4a9e-8599-3ca874fdcb76", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" ( ), "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[main] INFO o.a.s.l.Localizer - Reconstruct localized resource: C:\Users\ADMINI~\AppData\Local\Temp\fc1c162d-e299-4a9e--3ca874fdcb76\supervisor\usercache
[main] WARN o.a.s.l.Localizer - No left over resources found for any user during reconstructing of local resources at: C:\Users\ADMINI~\AppData\Local\Temp\fc1c162d-e299-4a9e--3ca874fdcb76\supervisor\usercache
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@294aba23
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820009 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820009, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d87b848820009
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d87b848820009 closed
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d87b848820009
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@5f5827d0
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b84882000a with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b84882000a, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.d.supervisor - Starting supervisor with id a8e2250d-ca68-48bb-bb91-53a2e7ba9080 at host WIN-BQOBV63OBNM
[main] INFO o.a.s.d.supervisor - Starting Supervisor with conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\afb39ee7-3111-41c1-9c53-fc75cec05822", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" ( ), "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[main] INFO o.a.s.l.Localizer - Reconstruct localized resource: C:\Users\ADMINI~\AppData\Local\Temp\afb39ee7--41c1-9c53-fc75cec05822\supervisor\usercache
[main] WARN o.a.s.l.Localizer - No left over resources found for any user during reconstructing of local resources at: C:\Users\ADMINI~\AppData\Local\Temp\afb39ee7--41c1-9c53-fc75cec05822\supervisor\usercache
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@c689973
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b84882000b with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b84882000b, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d87b84882000b
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d87b84882000b closed
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d87b84882000b
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@2b148329
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b84882000c, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b84882000c with negotiated timeout for client /127.0.0.1:
[main] INFO o.a.s.d.supervisor - Starting supervisor with id 22a78b3c-3d5f-4bac-9d9f- at host WIN-BQOBV63OBNM
[main] INFO o.a.s.l.ThriftAccessLogger - Request ID: access from: principal: operation: submitTopology
[main] INFO o.a.s.d.nimbus - Received topology submission for StormTopologyAcker with conf {"topology.max.task.parallelism" nil, "topology.submitter.principal" "", "topology.acker.executors" nil, "topology.eventlogger.executors" , "topology.max.spout.pending" , "storm.zookeeper.superACL" nil, "topology.users" (), "topology.submitter.user" "Administrator", "topology.kryo.register" nil, "topology.kryo.decorators" (), "storm.id" "StormTopologyAcker-1-1501220593", "topology.name" "StormTopologyAcker"}
[main] INFO o.a.s.d.nimbus - uploadedJar
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@460b50df
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b84882000d with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b84882000d, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Got user-level KeeperException when processing sessionid:0x15d87b84882000d type:create cxid:0x2 zxid:0x27 txntype:- reqpath:n/a Error Path:/storm/blobstoremaxkeysequencenumber Error:KeeperErrorCode = NoNode for /storm/blobstoremaxkeysequencenumber
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d87b84882000d
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d87b84882000d closed
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d87b84882000d
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.cluster - setup-path/blobstore/StormTopologyAcker---stormconf.ser/WIN-BQOBV63OBNM:-
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@2cd388f5
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b84882000e, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b84882000e with negotiated timeout for client /127.0.0.1:
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d87b84882000e
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d87b84882000e closed
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] WARN o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x15d87b84882000e, likely client has closed socket
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:) [storm-core-1.0..jar:1.0.]
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:) [storm-core-1.0..jar:1.0.]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_66]
[main] INFO o.a.s.cluster - setup-path/blobstore/StormTopologyAcker---stormcode.ser/WIN-BQOBV63OBNM:-
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d87b84882000e
[main] INFO o.a.s.d.nimbus - desired replication count achieved, current-replication-count for conf key = , current-replication-count for code key = , current-replication-count for jar key =
[main] INFO o.a.s.d.nimbus - Activating StormTopologyAcker: StormTopologyAcker--
[timer] INFO o.a.s.s.EvenScheduler - Available slots: (["a8e2250d-ca68-48bb-bb91-53a2e7ba9080" ] ["a8e2250d-ca68-48bb-bb91-53a2e7ba9080" ] ["a8e2250d-ca68-48bb-bb91-53a2e7ba9080" ] ["22a78b3c-3d5f-4bac-9d9f-392742596655" ] ["22a78b3c-3d5f-4bac-9d9f-392742596655" ] ["22a78b3c-3d5f-4bac-9d9f-392742596655" ])
[timer] INFO o.a.s.d.nimbus - Setting new assignment for topology id StormTopologyAcker--: #org.apache.storm.daemon.common.Assignment{:master-code-dir "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\d7cdc68c-f54c-4677-ac0e-d73c3b2effb3", :node->host {"a8e2250d-ca68-48bb-bb91-53a2e7ba9080" "WIN-BQOBV63OBNM"}, :executor->node+port {[ ] ["a8e2250d-ca68-48bb-bb91-53a2e7ba9080" ], [ ] ["a8e2250d-ca68-48bb-bb91-53a2e7ba9080" ], [ ] ["a8e2250d-ca68-48bb-bb91-53a2e7ba9080" ]}, :executor->start-time-secs {[ ] , [ ] , [ ] }, :worker->resources {["a8e2250d-ca68-48bb-bb91-53a2e7ba9080" ] [0.0 0.0 0.0]}}
[Thread-] INFO o.a.s.d.supervisor - Downloading code for storm id StormTopologyAcker--
[Thread-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@284a8f8c
[Thread-] INFO o.a.s.b.FileBlobStoreImpl - Creating new blob store based in C:\Users\ADMINI~\AppData\Local\Temp\d7cdc68c-f54c--ac0e-d73c3b2effb3\blobs
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b84882000f with negotiated timeout for client /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b84882000f, negotiated timeout =
[Thread--EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d87b84882000f
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] WARN o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x15d87b84882000f, likely client has closed socket
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:) [storm-core-1.0..jar:1.0.]
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:) [storm-core-1.0..jar:1.0.]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_66]
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d87b84882000f
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d87b84882000f closed
[Thread--EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[Thread-] INFO o.a.s.d.supervisor - Finished downloading code for storm id StormTopologyAcker--
[Thread-] INFO o.a.s.d.supervisor - Launching worker with assignment {:storm-id "StormTopologyAcker-1-1501220593", :executors [[ ] [ ] [ ]], :resources #object[org.apache.storm.generated.WorkerResources 0x53f66d42 "WorkerResources(mem_on_heap:0.0, mem_off_heap:0.0, cpu:0.0)"]} for this supervisor a8e2250d-ca68-48bb-bb91-53a2e7ba9080 on port with id 715c933e-5f3a-4a1c-b2f3-b4ace693b7fc
[Thread-] INFO o.a.s.d.worker - Launching worker for StormTopologyAcker-- on a8e2250d-ca68-48bb-bb91-53a2e7ba9080: with id 715c933e-5f3a-4a1c-b2f3-b4ace693b7fc and conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\fc1c162d-e299-4a9e-8599-3ca874fdcb76", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" ( ), "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[Thread-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@fe8f4c9
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820010 with negotiated timeout for client /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820010, negotiated timeout =
[Thread--EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Thread--EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d87b848820010
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d87b848820010 closed
[Thread--EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[Thread-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] WARN o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x15d87b848820010, likely client has closed socket
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:) [storm-core-1.0..jar:1.0.]
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:) [storm-core-1.0..jar:1.0.]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_66]
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@12401e6d
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d87b848820010
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d87b848820011 with negotiated timeout for client /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d87b848820011, negotiated timeout =
[Thread--EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Thread-] INFO o.a.s.s.a.AuthUtils - Got AutoCreds []
[Thread-] INFO o.a.s.d.worker - Reading Assignments.
[Thread-] INFO o.a.s.d.worker - Registering IConnectionCallbacks for a8e2250d-ca68-48bb-bb91-53a2e7ba9080:
[Thread-] INFO o.a.s.d.executor - Loading executor MySpout:[ ]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks MySpout:[ ]
[Thread-] INFO o.a.s.d.executor - Finished loading executor MySpout:[ ]
[Thread-] INFO o.a.s.d.executor - Loading executor __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Timeouts disabled for executor __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Finished loading executor __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Loading executor MyBolt:[ ]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks MyBolt:[ ]
[Thread-] INFO o.a.s.d.executor - Finished loading executor MyBolt:[ ]
[Thread-] INFO o.a.s.d.executor - Loading executor __system:[- -]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks __system:[- -]
[Thread-] INFO o.a.s.d.executor - Finished loading executor __system:[- -]
[Thread-] INFO o.a.s.d.worker - Started with log levels: {"" #object[org.apache.logging.log4j.Level 0x2c9c9097 "INFO"], "org.apache.zookeeper" #object[org.apache.logging.log4j.Level 0xd4f4340 "WARN"]}
[Thread-] INFO o.a.s.d.worker - Worker has topology config {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "topology.submitter.principal" "", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\d7cdc68c-f54c-4677-ac0e-d73c3b2effb3", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" , "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "storm.zookeeper.superACL" nil, "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" [ ], "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "topology.users" [], "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.submitter.user" "Administrator", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "topology.kryo.register" nil, "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "topology.kryo.decorators" [], "storm.id" "StormTopologyAcker-1-1501220593", "topology.name" "StormTopologyAcker", "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[Thread-] INFO o.a.s.d.worker - Worker 715c933e-5f3a-4a1c-b2f3-b4ace693b7fc for storm StormTopologyAcker-- on a8e2250d-ca68-48bb-bb91-53a2e7ba9080: has finished loading
[Thread-] INFO o.a.s.config - SET worker-user 715c933e-5f3a-4a1c-b2f3-b4ace693b7fc
[refresh-active-timer] INFO o.a.s.d.worker - All connections are ready for worker a8e2250d-ca68-48bb-bb91-53a2e7ba9080: with id 715c933e-5f3a-4a1c-b2f3-b4ace693b7fc
[Thread--MySpout-executor[ ]] INFO o.a.s.d.executor - Opening spout MySpout:()
[Thread--MySpout-executor[ ]] INFO o.a.s.d.executor - Opened spout MySpout:()
[Thread--MySpout-executor[ ]] INFO o.a.s.d.executor - Activating spout MySpout:()
spout:
[Thread--MyBolt-executor[ ]] INFO o.a.s.d.executor - Preparing bolt MyBolt:()
[Thread--MyBolt-executor[ ]] INFO o.a.s.d.executor - Prepared bolt MyBolt:()
[Thread--__system-executor[- -]] INFO o.a.s.d.executor - Preparing bolt __system:(-)
[Thread--__system-executor[- -]] INFO o.a.s.d.executor - Prepared bolt __system:(-)
[Thread--__acker-executor[ ]] INFO o.a.s.d.executor - Preparing bolt __acker:()
[Thread--__acker-executor[ ]] INFO o.a.s.d.executor - Prepared bolt __acker:()
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=
处理成功!
spout:
sum=

 ok!

Storm编程入门API系列之Storm的可靠性的ACK消息确认机制的更多相关文章

  1. Storm编程入门API系列之Storm的Topology多个Workers数目控制实现

    前期博客 Storm编程入门API系列之Storm的Topology默认Workers.默认executors和默认tasks数目 继续编写 StormTopologyMoreWorker.java ...

  2. Storm编程入门API系列之Storm的Topology多个Executors数目控制实现

    前期博客 Storm编程入门API系列之Storm的Topology默认Workers.默认executors和默认tasks数目 Storm编程入门API系列之Storm的Topology多个Wor ...

  3. Storm编程入门API系列之Storm的Topology多个tasks数目控制实现

    前期博客 Storm编程入门API系列之Storm的Topology默认Workers.默认executors和默认tasks数目 Storm编程入门API系列之Storm的Topology多个Wor ...

  4. Storm编程入门API系列之Storm的定时任务实现

    概念,见博客 Storm概念学习系列之storm的定时任务 Storm的定时任务,分为两种实现方式,都是可以达到目的的. 我这里,分为StormTopologyTimer1.java   和  Sto ...

  5. Storm编程入门API系列之Storm的Topology的stream grouping

    概念,见博客 Storm概念学习系列之stream grouping(流分组) Storm的stream grouping的Shuffle Grouping 它是随机分组,随机派发stream里面的t ...

  6. Storm编程入门API系列之Storm的Topology默认Workers、默认executors和默认tasks数目

    关于,storm的启动我这里不多说了. 见博客 storm的3节点集群详细启动步骤(非HA和HA)(图文详解) 建立stormDemo项目 Group Id :  zhouls.bigdata Art ...

  7. storm 消息确认机制及可靠性

    worker进程死掉 在一个节点 kill work进程 比方 kill 2509  对work没有影响 由于会在其它节点又一次启动进程运行topology任务 supervisor进程死掉 supe ...

  8. SpringBoot集成RabbitMQ消息队列搭建与ACK消息确认入门

    1.RabbitMQ介绍 RabbitMQ是实现AMQP(高级消息队列协议)的消息中间件的一种,最初起源于金融系统,用于在分布式系统中存储转发消息,在易用性.扩展性.高可用性等方面表现不俗.Rabbi ...

  9. Storm概念学习系列之storm的定时任务

    不多说,直接上干货! 至于为什么,有storm的定时任务.这个很简单.但是,这个在工作中非常重要! 假设有如下的业务场景 这个spoult源源不断地发送数据,boilt呢会进行处理.然后呢,处理后的结 ...

随机推荐

  1. linux 常见名词及命令(五)

    计划任务服务之一次性任务: at <时间> 安排一次性任务 atq 或at -l 查看任务列表 at -c 序号 预览任务与设置环境 atrm 序号 删除任务 安排任务示例: 在23:30 ...

  2. React Native学习(五)—— 使用插件react-native-scrollable-tab-view

    本文基于React Native 0.52 Demo上传到Git了,有需要可以看看,写了新内容会上传的.Git地址 https://github.com/gingerJY/React-Native-D ...

  3. Remove Duplicates from Sorted List (链表)

    Given a sorted linked list, delete all duplicates such that each element appear only once. For examp ...

  4. 立面图 平面图 剖面图 CAD

    http://www.qinxue.com/88.html http://www.xsteach.com/course/2855 前后左右各个侧面的外部投影图——立面图:对建筑物各个侧面进行投影所得到 ...

  5. &quot;Simple Factory&quot; vs &quot;Factory Method&quot; vs &quot;Abstract Factory&quot; vs &quot;Reflect&quot;

    ref: http://www.cnblogs.com/zhangchenliang/p/3700820.html 1. "Simple Factory" package torv ...

  6. 【CV论文阅读】Unsupervised deep embedding for clustering analysis

    Unsupervised deep embedding for clustering analysis 偶然发现这篇发在ICML2016的论文,它主要的关注点在于unsupervised deep e ...

  7. Elasticsearch学习系列之配置文件详解

    ################################### Cluster ################################### #定义集群名称,默认是elasticse ...

  8. Android进程间通信之内部类作为事件监听器

    在Android中,使用内部类能够在当前类里面发用改监听器类,由于监听器类是外部类的内部类.所以能够自由訪问外部类的全部界面组件. 下面是一个调用系统内部类实现短信发送的一个样例: SMS类: pac ...

  9. C#之快速排序 C#之插入排序 C#之选择排序 C#之冒泡排序

    C#之快速排序   算法描述 1.假定数组首位元素为“枢轴”,设定数列首位(begin)与末位(end)索引: 2.由末位索引对应元素与“枢轴”进行比较,如果末位索引对应元素大于“枢轴”元素,对末位索 ...

  10. Delphi中处理URL编码解码

    Delphi中处理URL编码解码 一.URL简单介绍     URL是网页的地址,比方 http://www.shanhaiMy.com. Web 浏览器通过 URL 从 web server请求页面 ...