Exceptionless 是一个可以对 ASP.NET Core, ASP.NET MVC，WebAPI, WebForms, WPF, Console 应用提供系统的日志，错误监控、报表等服务实时日志收集框架 。具体介绍：http://www.cnblogs.com/savorboard/p/exceptionless.html 。

日志分析与程序异常在系统开发与运行中占非常重要的地位，在技术选型的过程中需要考虑一些问题

  • 数据分散在多台服务器中，难以查找
  • 数据量大，查询速度慢
  • 涉及多个系统调用，难以快速定位数据问题

开源日志项目
https://github.com/Graylog2/graylog2-server
https://github.com/exceptionless/Exceptionless
https://github.com/elastic
https://github.com/getsentry/sentry
https://github.com/dianping/cat

配置 Elasticsearch 集群

最终我们还是选用个了 Exceptionless ，于是就自己搭建了一套本地环境（Elasticsearch 配置官方推荐：three node  with two master nodes on Linux）。

#配置JAVA运行环境
sudo apt-get update
sudo apt-get upgrade
sudo apt-get install software-properties-common htop
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java8-installer
java -version

# centos
yum install java(openjdk)
tar -zxvf jdk-8u131-linux-x64.tar.gz
#配置环境变量

vi /etc/profile

JAVA_HOME=/opt/jdk1..0_131

CLASSPATH=.:$JAVA_HOME/lib

PATH=$JAVA_HOME/bin:$PATH

export JAVA_HOME CLASSPATH PATH

#生效环境变量

source /etc/profile

#安装elasticsearch
wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.5.0.tar.gz
tar -xzf elasticsearch-5.5.0.tar.gz

#安装插件
sudo bin/elasticsearch-plugin install mapper-size
#配置elasticsearch-head
Running with docker
https://docs.docker.com/engine/installation/linux/docker-ce/ubuntu/
for Elasticsearch 5.x open http://localhost:9100/:
docker run -p 9100:9100 mobz/elasticsearch-head:5

#Enable CORS in elasticsearch
http.cors.enabled: true
http.cors.allow-origin: "*"

#创建elastic用户
useradd elastic (userdel elastic)
#修改所有者
chown -R elastic /opt/elasticsearch-5.5.0

#切换到elastic用户启动
su elastic
#以后台方式启动
./bin/elasticsearch –d

Elasticsearch 配置

# ======================== Elasticsearch Configuration =========================

#

# NOTE: Elasticsearch comes with reasonable defaults for most settings.

#       Before you set out to tweak and tune the configuration, make sure you

#       understand what are you trying to accomplish and the consequences.

#

# The primary way of configuring a node is via this file. This template lists

# the most important settings you may want to configure for a production cluster.

#

# Please consult the documentation for further information on configuration options:

# https://www.elastic.co/guide/en/elasticsearch/reference/index.html

#

# ---------------------------------- Cluster -----------------------------------

#

# Use a descriptive name for your cluster:

# multi node configuration

cluster.name: exceptionless

action.destructive_requires_name: true

action.auto_create_index: .security,.monitoring*,.watches,.triggered_watches,.watcher-history*

#bootstrap.memory_lock: true

#

# ------------------------------------ Node ------------------------------------

#

# Use a descriptive name for the node:

#

node.name: p2_es_node_03

#

# Add custom attributes to the node:

#

#node.attr.rack: r1

#

# ----------------------------------- Paths ------------------------------------

#

# Path to directory where to store the data (separate multiple locations by comma):

#

#path.data: /path/to/data

#

# Path to log files:

#

#path.logs: /path/to/logs

#

# ----------------------------------- Memory -----------------------------------

#

# Lock the memory on startup:

#

#bootstrap.memory_lock: true

#

# Make sure that the heap size is set to about half the memory available

# on the system and that the owner of the process is allowed to use this

# limit.

#

# Elasticsearch performs poorly when the system is swapping the memory.

#

# ---------------------------------- Network -----------------------------------

#

# Set the bind address to a specific IP (IPv4 or IPv6):

#

network.host: 0.0.0.0

#

# Set a custom port for HTTP:

#

http.port:

#

# For more information, consult the network module documentation.

#

# --------------------------------- Discovery ----------------------------------

#

# Pass an initial list of hosts to perform discovery when new node is started:

# The default list of hosts is ["127.0.0.1", "[::1]"]

#

#discovery.zen.ping.unicast.hosts: ["host1", "host2"]

#

# Prevent the "split brain" by configuring the majority of nodes (total number of master-eligible nodes /  + ):

#

#discovery.zen.minimum_master_nodes:

#

# For more information, consult the zen discovery module documentation.

#

# ---------------------------------- Gateway -----------------------------------

#

# Block initial recovery after a full cluster restart until N nodes are started:

#

#gateway.recover_after_nodes:

#

# For more information, consult the gateway module documentation.

#

# ---------------------------------- Various -----------------------------------

#

# Require explicit names when deleting indices:

#

#action.destructive_requires_name: true

# 启用跨域

#Enable CORS in elasticsearch

http.cors.enabled: true

http.cors.allow-origin: "*"

# 集群配置

# 这个配置限制了单机上可以开启的ES存储实例的个数,当我们需要单机多实例，则需要把这个配置赋值2，或者更高。

node.max_local_storage_nodes:

#设置这个集群中节点的数量，默认为2，一旦这N个节点启动，就会立即进行数据恢复。

gateway.expected_nodes:

#设置这个参数来保证集群中的节点可以知道其它N个有master资格的节点。默认为1，对于大的集群来说，可以设置大一点的值（-）

discovery.zen.minimum_master_nodes:

#设置集群中master节点的初始列表，可以通过这些节点来自动发现新加入集群的节点。

discovery.zen.ping.unicast.hosts: ["10.255.131.162","10.255.131.163","10.255.131.164"]

#network.bind_host: [ '_site_', '_local_' ]

#network.publish_host: '_site_'
cluster.name: exceptionless

node.name: exceptionless_node_01

action.destructive_requires_name: true

action.auto_create_index: .security,.monitoring*,.watches,.triggered_watches,.watcher-history*

#bootstrap.memory_lock: true

# Set the bind address to a specific IP (IPv4 or IPv6):

network.host: 0.0.0.0

http.port: 

#Enable CORS in elasticsearch

http.cors.enabled: true

http.cors.allow-origin: "*"

# --------------------------------- Discovery ----------------------------------

# 这个配置限制了单机上可以开启的ES存储实例的个数,当我们需要单机多实例，则需要把这个配置赋值2，或者更高。

node.max_local_storage_nodes:

#设置这个集群中节点的数量，默认为2，一旦这N个节点启动，就会立即进行数据恢复。

gateway.expected_nodes:

#设置这个参数来保证集群中的节点可以知道其它N个有master资格的节点。默认为1，对于大的集群来说，可以设置大一点的值（-）(total number of master-eligible nodes /  + ):

discovery.zen.minimum_master_nodes:

#设置集群中master节点的初始列表，可以通过这些节点来自动发现新加入集群的节点。

discovery.zen.ping.unicast.hosts: ["10.255.131.162","10.255.131.163","10.255.131.164"]

JVM 配置 

## JVM configuration

################################################################

## IMPORTANT: JVM heap size

################################################################

##

## You should always set the min and max JVM heap

## size to the same value. For example, to set

## the heap to  GB, set:

##

## -Xms4g

## -Xmx4g

##

## See https://www.elastic.co/guide/en/elasticsearch/reference/current/heap-size.html

## for more information

##

################################################################

# Xms represents the initial size of total heap space

# Xmx represents the maximum size of total heap space

-Xms4g

-Xmx4g

################################################################

## Expert settings

################################################################

##

## All settings below this section are considered

## expert settings. Don't tamper with them unless

## you understand what you are doing

##

################################################################

## GC configuration

-XX:+UseConcMarkSweepGC

-XX:CMSInitiatingOccupancyFraction=

-XX:+UseCMSInitiatingOccupancyOnly

## optimizations

# disable calls to System#gc

-XX:+DisableExplicitGC

# pre-touch memory pages used by the JVM during initialization

-XX:+AlwaysPreTouch

## basic

# force the server VM (remove on -bit client JVMs)

-server

# explicitly set the stack size (reduce to 320k on -bit client JVMs)

-Xss1m

# set to headless, just in case

-Djava.awt.headless=true

# ensure UTF- encoding by default (e.g. filenames)

-Dfile.encoding=UTF-

# use our provided JNA always versus the system one

-Djna.nosys=true

# use old-style file permissions on JDK9

-Djdk.io.permissionsUseCanonicalPath=true

# flags to configure Netty

-Dio.netty.noUnsafe=true

-Dio.netty.noKeySetOptimization=true

-Dio.netty.recycler.maxCapacityPerThread=

# log4j

-Dlog4j.shutdownHookEnabled=false

-Dlog4j2.disable.jmx=true

-Dlog4j.skipJansi=true

## heap dumps

# generate a heap dump when an allocation from the Java heap fails

# heap dumps are created in the working directory of the JVM

-XX:+HeapDumpOnOutOfMemoryError

# specify an alternative path for heap dumps

# ensure the directory exists and has sufficient space

#-XX:HeapDumpPath=${heap.dump.path}

## GC logging

#-XX:+PrintGCDetails

#-XX:+PrintGCTimeStamps

#-XX:+PrintGCDateStamps

#-XX:+PrintClassHistogram

#-XX:+PrintTenuringDistribution

#-XX:+PrintGCApplicationStoppedTime

# log GC status to a file with time stamps

# ensure the directory exists

#-Xloggc:${loggc}

# By default, the GC log file will not rotate.

# By uncommenting the lines below, the GC log file

# will be rotated every 128MB at most  times.

#-XX:+UseGCLogFileRotation

#-XX:NumberOfGCLogFiles=

#-XX:GCLogFileSize=128M

# Elasticsearch 5.0. will throw an exception on unquoted field names in JSON.

# If documents were already indexed with unquoted fields in a previous version

# of Elasticsearch, some operations may throw errors.

#

# WARNING: This option will be removed in Elasticsearch 6.0. and is provided

# only for migration purposes.

#-Delasticsearch.json.allow_unquoted_field_names=true

运行日志

LOG:

elastic@iZuf60cj5pna5im3va46nlZ:/opt/elasticsearch-5.5.$ ls

bin  config  lib  LICENSE.txt  modules  NOTICE.txt  plugins  README.textile

elastic@iZuf60cj5pna5im3va46nlZ:/opt/elasticsearch-5.5.$ ./bin/elasticsearch

[--12T14::,][INFO ][o.e.n.Node               ] [] initializing ...

[--12T14::,][INFO ][o.e.e.NodeEnvironment    ] [9rZOxk3] using [] data paths, mounts [[/ (/dev/vda1)]], net usable_space [.6gb], net total_space [.9gb], spins? [possibly], types [ext4]

[--12T14::,][INFO ][o.e.e.NodeEnvironment    ] [9rZOxk3] heap size [.9gb], compressed ordinary object pointers [true]

[--12T14::,][INFO ][o.e.n.Node               ] node name [9rZOxk3] derived from node ID [9rZOxk3hS0Wmj6SPvU0ZSg]; set [node.name] to override

[--12T14::,][INFO ][o.e.n.Node               ] version[5.5.], pid[], build[260387d/--30T23::.735Z], OS[Linux/4.4.--generic/amd64], JVM[Oracle Corporation/Java HotSpot(TM) -Bit Server VM/1.8.0_131/25.131-b11]

[--12T14::,][INFO ][o.e.n.Node               ] JVM arguments [-Xms2g, -Xmx2g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+DisableExplicitGC, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-, -Djna.nosys=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j.skipJansi=true, -XX:+HeapDumpOnOutOfMemoryError, -Des.path.home=/opt/elasticsearch-5.5.]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [aggs-matrix-stats]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [ingest-common]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [lang-expression]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [lang-groovy]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [lang-mustache]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [lang-painless]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [parent-join]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [percolator]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [reindex]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [transport-netty3]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded module [transport-netty4]

[--12T14::,][INFO ][o.e.p.PluginsService     ] [9rZOxk3] loaded plugin [mapper-size]

[--12T14::,][INFO ][o.e.d.DiscoveryModule    ] [9rZOxk3] using discovery type [zen]

[--12T14::,][INFO ][o.e.n.Node               ] initialized

[--12T14::,][INFO ][o.e.n.Node               ] [9rZOxk3] starting ...

[--12T14::,][INFO ][o.e.t.TransportService   ] [9rZOxk3] publish_address {127.0.0.1:}, bound_addresses {127.0.0.1:}

[--12T14::,][WARN ][o.e.b.BootstrapChecks    ] [9rZOxk3] max file descriptors [] for elasticsearch process is too low, increase to at least []

[--12T14::,][WARN ][o.e.b.BootstrapChecks    ] [9rZOxk3] max virtual memory areas vm.max_map_count [] is too low, increase to at least []

[--12T14::,][INFO ][o.e.c.s.ClusterService   ] [9rZOxk3] new_master {9rZOxk3}{9rZOxk3hS0Wmj6SPvU0ZSg}{Khs76coWR6qWwC9DjuhyeQ}{127.0.0.1}{127.0.0.1:}, reason: zen-disco-elected-as-master ([] nodes joined)

[--12T14::,][INFO ][o.e.h.n.Netty4HttpServerTransport] [9rZOxk3] publish_address {127.0.0.1:}, bound_addresses {127.0.0.1:}

[--12T14::,][INFO ][o.e.n.Node               ] [9rZOxk3] started

[--12T14::,][INFO ][o.e.g.GatewayService     ] [9rZOxk3] recovered [] indices into cluster_state

问题一：警告提示

[2016-11-06T16:27:21,712][WARN ][o.e.b.JNANatives ] unable to install syscall filter:

Java.lang.UnsupportedOperationException: seccomp unavailable: requires kernel 3.5+ with CONFIG_SECCOMP and CONFIG_SECCOMP_FILTER compiled in
at org.elasticsearch.bootstrap.Seccomp.linuxImpl(Seccomp.java:349) ~[elasticsearch-5.0.0.jar:5.0.0]
at org.elasticsearch.bootstrap.Seccomp.init(Seccomp.java:630) ~[elasticsearch-5.0.0.jar:5.0.0]

报了一大串错误，其实只是一个警告。

解决：使用新的linux版本，就不会出现此类问题了。

问题二：ERROR: bootstrap checks failed

max file descriptors [4096] for elasticsearch process likely too low, increase to at least [65536]
max number of threads [1024] for user [lishang] likely too low, increase to at least [2048]

vi /etc/security/limits.conf
添加如下内容:

* soft nofile 65536
* hard nofile 131072
* soft nproc 2048
* hard nproc 4096

问题三：max number of threads [1024] for user [lish] likely too low, increase to at least [2048]

vi /etc/security/limits.d/90-nproc.conf
#修改为
* soft nproc 2048

问题四：max virtual memory areas vm.max_map_count [65530] likely too low, increase to at least [262144]

解决：切换到root用户修改配置sysctl.conf

vi /etc/sysctl.conf

添加下面配置：
vm.max_map_count=655360
并执行命令：
sysctl -p
然后，重新启动elasticsearch，即可启动成功。

#安装kibana
wget https://artifacts.elastic.co/downloads/kibana/kibana-5.4.0-linux-x86_64.tar.gz
tar -xzf kibana-5.4.0-linux-x86_64.tar.gz
cd kibana/

#查看运行进程
ps -ef |grep java
#kill 进程
kill -9 pid

配置 Exceptionless

  • 配置项目文件权限为users
  • 修改 app.config.*.js 的 BASE_URL 为本机访问IP
  • 修改 Web.config 配置
<configuration>

  <connectionStrings>

    <add name="RedisConnectionString" connectionString="" />

    <add name="ElasticSearchConnectionString" connectionString="http://10.255.131.162:9200" />

    <add name="LdapConnectionString" connectionString="" />

  </connectionStrings>

  <appSettings>

    <!-- Base url for the ui used to build links in emails and other places. -->

    <add key="BaseURL" value="http://10.255.130.67/#" />

    <!-- Controls whether SSL is required. Only enable this if you have SSL configured. -->

    <add key="EnableSSL" value="false" />

    <!--

    Dev: Use this mode when debugging. (Outbound emails will not be sent)

    QA: Use this mode when deployed to staging. (Outbound emails restricted)

    Production: Use this mode when deployed to production.

    -->

    <add key="WebsiteMode" value="Production" />

    <!-- Controls whether users can signup. -->

    <add key="EnableAccountCreation" value="false" />

    <!-- Controls whether daily summary emails are sent -->

    <add key="EnableDailySummary" value="true" />

    <!--

      Email Client Settings (Uncomment the section below to change the default email settings)

      There are three valid SmtpEncryption settings: None, SSL and StartTLS

    -->

    <!-- Email -->

    <add key="SmtpHost" value="smtp.exmail.qq.com" />

    <add key="SmtpPort" value="465" />

    <add key="SmtpEncryption" value="SSL" />

    <add key="SmtpFrom" value="test@test.com" />

    <add key="SmtpUser" value="test@test.com" />

    <add key="SmtpPassword" value="!test." />

    <!-- Folder used to store event post data -->

    <add key="StorageFolder" value="|DataDirectory|\storage" />

    <!-- Runs the jobs in the current website process -->

    <add key="RunJobsInProcess" value="true" />

    <add key="aspnet:UseTaskFriendlySynchronizationContext" value="true" />

    <!--保留日志天数 -->

    <add key="MaximumRetentionDays" value="90" />

    <!--分片数量-->

    <add key="ElasticSearchNumberOfShards" value="3" />

    <!--复制分片数量-->

    <add key="ElasticSearchNumberOfReplicas" value="1" />

  </appSettings>

首次访问注册用户后创建项目即可(EnableAccountCreation 需要配置成 true)

检查服务状态
http://ip/api/v2/status
开放API
http://api.exceptionless.com/docs/index
客户端调用示列
https://github.com/exceptionless/Exceptionless.Net/tree/master/samples

QA:
本地部署使用哪个版本?
使用最新的版本即可
Elasticsearch(v5.5.0)
https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.5.0.tar.gz
Exceptionless(v4.0.2)
https://github.com/exceptionless/Exceptionless/releases

大量记录日志会影响性能吗？
支持 python 或者其他语言收集日志吗?
默认可以使用相关的扩展来实现写入到ES
https://github.com/ReactiveMarkets/NLog.Targets.ElasticSearch
https://github.com/jptoto/log4net.ElasticSearch
也可以使用 Exceptionless 的扩展
https://github.com/serilog/serilog-sinks-exceptionless
https://github.com/exceptionless/Exceptionless.Net/tree/master/src/Platforms
如NLLog:

<nlog>

  <extensions>

    <add assembly="Exceptionless.NLog"/>

  </extensions>

  <targets async="true">

    <target name="exceptionless" apiKey="API_KEY_HERE" xsi:type="Exceptionless">

      <field name="host" layout="${machinename}" />

      <field name="identity" layout="${identity}" />

      <field name="windows-identity" layout="${windows-identity:userName=True:domain=False}" />

      <field name="process" layout="${processname}" />

    </target>

  </targets>

  <rules>

    <logger name="*" minlevel="Trace" writeTo="exceptionless" />

  </rules>

</nlog>

Elasticsearch 主分片与副本数量设定？

修改分片数
curl -XPUT 'http://localhost:9200/_all/_settings?preserve_existing=true' -d '{
  "index.number_of_replicas" : "1",
  "index.number_of_shards" : "5"
}'
Exceptionless 配置 QQ 邮箱发送不了邮件？

配置 <add key="SmtpFrom" value="test@test.com" /> 节点
怎么配置保留日志的天数？
配置 MaximumRetentionDays 属性即可(https://github.com/exceptionless/Exceptionless/issues/139)
每秒产生大量的日志请求 ，会有性能问题吗？
可以使用使用内存存储(UseInMemoryStorage)，相对会稳定很多; Exceptionless 前端做负载（需要配置Redis）
ExceptionlessClient.Default.Configuration.UseInMemoryStorage();
怎么标识是哪个用户操作发生的事件？
https://github.com/exceptionless/Exceptionless/wiki/User-Sessions
用户标识访问者归属地的 DB 下载失败？
怎么样快速查询日志？
怎么样监控日志服务是否正常？
Redis服务是否是必须配置的？
开放了哪些 API 接口 ？
http://api.exceptionless.com/docs/index
怎么分配 Elasticsearch 中的 JVM 的内存大小？
Exceptionless 日志没有实时显示？
检查 IIS 是否配置了 websocket 协议 ; 检查 SignalR 是否连接成功
ws://xx.xx.xxx.xxx/api/v2/push/connect?transport=webSockets&clientProtocol=1.5&access_token=hkm9YhSalvakZWkJmI3ek2M7rB8WTeuANmy0kp54&connectionToken=YQdrdiaOnprcRq%2BsaMBKfdpRwLnUtc5NPZ0ZExJVfb3h4j5SrHkUDqQOOq8NAgzGx7YADZ3azpJ3JIFFt217sSlE7pJf%2B7848sxFTfzXg%2FmAHvvcHjipHirL0Xl3FvfqaQaqo50Tyo5m77GvBM1YrQ%3D%3D&tid=8

REFER:
https://github.com/medcl/elasticsearch-analysis-ik

http://blog.takipi.com/how-to-choose-the-right-log-management-tool/

https://thehftguy.com/2016/09/12/250-gbday-of-logs-with-graylog-lessons-learned/

https://exceptionless.com/sending-log-messages-to-exceptionless/

Self Host 使用 Exceptionless 实时监控程序运行日志服务的更多相关文章

  1. dial tcp 10.96.0.1:443: getsockopt: no route to host --- kubernetes（k8s）DNS 服务反复重启

    kubernetes(k8s)DNS 服务反复重启解决: k8s.io/dns/pkg/dns/dns.go:150: Failed to list *v1.Service: Get https:// ...

  2. （转）dial tcp 10.96.0.1:443: getsockopt: no route to host --- kubernetes（k8s）DNS 服务反复重启

    转:https://blog.csdn.net/shida_csdn/article/details/80028905 kubernetes(k8s)DNS 服务反复重启解决: k8s.io/dns/ ...

  3. 一个轻client，多语言支持，去中心化，自己主动负载，可扩展的实时数据写服务的实现方案讨论

    背景 背景是设计一个实时数据接入的模块,负责接收client的实时数据写入(如日志流,点击流),数据支持直接下沉到HBase上(兴许提供HBase上的查询),或先持久化到Kafka里.方便兴许进行一些 ...

  4. geotrellis使用（三十二）大量GeoTiff文件实时进行TMS服务

    前言 在上一篇文章中我讲了如何直接将Geotiff文件发布为TMS服务,在其中只讲了单幅Geotiff的操作,其实单幅这种量级的数据对Geotrellis来说就是杀鸡焉用牛刀,Geotrellis针对 ...

  5. geotrellis使用（三十二）大量GeoTiff文件实时发布TMS服务

    前言 在上一篇文章中我讲了如何直接将Geotiff文件发布为TMS服务,在其中只讲了单幅Geotiff的操作,其实单幅这种量级的数据对Geotrellis来说就是杀鸡焉用牛刀,Geotrellis针对 ...

  6. rsync实时备份备份服务搭建和使用指南

    一.Rsync企业工作场景说明: 1.利用定时任务+rsync方式实现数据同步 对于网站内部技术人员创建的数据,可以采取定时任务的方式 2.利用实时任务+rsync方式实现数据同步 对于网站外部访问用 ...

  7. 2.supervisor实时监控程序存活状态

    1.supervisor是一款python开发的一个client/server服务,是一款进程管理工具,支持linux/unix系统,但是不支持windows系统. 它可以很方便的监听.启动.停止.重 ...

  8. H5采集pcm流转换采样率实时发送到服务端

    function startTalk(ws2, button) { var arrBuffer = new ArrayBuffer(320 * 2); var sendBuffer = new Dat ...

  9. .NET Core微服务之基于Exceptionless实现分布式日志记录

    Tip: 此篇已加入.NET Core微服务基础系列文章索引 一.Exceptionless极简介绍 Exceptionless 是一个开源的实时的日志收集框架,它可以应用在基于 ASP.NET,AS ...

随机推荐

  1. Selenium库，Python精品教程！

    什么是Selenium selenium基本使用 用python写爬虫的时候,主要用的是selenium的Webdriver,我们可以通过下面的方式先看看Selenium.Webdriver支持哪些浏 ...

  2. BZOJ_4128_Matrix_矩阵乘法+哈希+BSGS

    BZOJ_4128_Matrix_矩阵乘法+哈希+BSGS Description 给定矩阵A,B和模数p,求最小的x满足 A^x = B (mod p) Input 第一行两个整数n和p,表示矩阵的 ...

  3. BZOJ_1097_[POI2007]旅游景点atr_状压DP

    BZOJ_1097_[POI2007]旅游景点atr_状压DP 题面描述: FGD想从成都去上海旅游.在旅途中他希望经过一些城市并在那里欣赏风景,品尝风味小吃或者做其他的有趣 的事情.经过这些城市的顺 ...

  4. BZOJ_1827_[Usaco2010 Mar]gather 奶牛大集会_树形DP

    BZOJ_1827_[Usaco2010 Mar]gather 奶牛大集会_树形DP 题意:Bessie正在计划一年一度的奶牛大集会,来自全国各地的奶牛将来参加这一次集会.当然,她会选择最方便的地点来 ...

  5. MYSQL一键安装

    #!/bin/bash #baishuchao qq:995345781 ############################################################### ...

  6. appium在android 7.0真机上运行报错command failed shell:............ps:'uiautomator"的解决方式

    appium版本:1_4_16 在CSDN中找到相关解决的方案,根据此解决方案顺利的解决了让人惆怅的问题,再次记录. 1.找到appium安装目录下的adb.js文件,目录为:Appium\node_ ...

  7. 汽车之家汽车品牌Logo信息抓取 DotnetSpider实战[三]

    一.正题前的唠叨 第一篇实战博客,阅读量1000+,第二篇,阅读量200+,两篇文章相差近5倍,这个差异真的令我很费劲,截止今天,我一直在思考为什么会有这么大的差距,是因为干货变少了,还是什么原因,一 ...

  8. redis的Sorted Set类型！！！！

    一.概述: Sorted Set(有序集合)和Set类型极为相似,它们都是字符串的集合,都不允许重复的成员出现在一个Set中.它们之间的主要差别是Sorted Set中的每一个成员都会有一个分数(sc ...

  9. MongoDB 小记

    之前本人说过一款非关系型数据库的代表 Redis 的 < Redis 小记 >文章,觉得意犹未尽,今天就来介绍一款数据库 MongoDB ,先来看一下 MongoDB是一款基于分布式文件存 ...

  10. mysql开发规范(优化)

    规范 库名.表名.字段名必须使用小写字母, 并采用下划线分割, 禁止超过32个字符(整齐.易读) 临时库.表名须以tmp加日期为后缀; 使用Innodb存储引擎.[好处: 支持事务和行级锁] 字符集统 ...