Acqusition_and_Processing.xml Moving templates to own directory to make repo cleaner
  CADF_Parser.xml Moving templates to own directory to make repo cleaner 6 months ago
  CassandraProcessors.xml Adding templates for processors released in NiFi 0.6.0 3 months ago
  Convert_To_Avro_From_CSV_and_JSON.xml Added a template showcasing Avro processors 6 months ago
  Decompression_Circular_Flow.xml Moving templates to own directory to make repo cleaner 6 months ago
  Decrypt_Alter_Encrypt_OpenSSL.xml Moving templates to own directory to make repo cleaner 6 months ago
  ElasticsearchDemonstration.xml Adding templates for processors released in NiFi 0.6.0 3 months ago
  Fun_with_HBase.xml Updating the Fun_with_HBase template a month ago
  GetFileEncodingInFlight.xml Moving templates to own directory to make repo cleaner 6 months ago
  Get_CSV_data_validate_it_and_route_to_Kafka.xml Moving templates to own directory to make repo cleaner 6 months ago
  GroovyJsonToJsonExample.xml Added ExecuteScript example using Groovy for JSON-to-JSON transform 4 months ago
  HandleNifiReports.xml Adding Ambari report handler template 3 months ago
  Hello_NiFi_Web_Service.xml Adding new templates 6 months ago
  HttpExecuteLsCommand.xml Moving templates to own directory to make repo cleaner 6 months ago
  InvokeHttp_And_Route_Original_On_Status.xml Fixing InvokeHttp_And_Route_Original_On_Status.xml template 6 months ago
  List_and_Fetch_SFTP_template.xml Forgot to add template 6 months ago
  MongoDB_Get_and_Put_Example.xml Added a MongoDB template 5 months ago
  NetworkActvityExample.xml Moving templates to own directory to make repo cleaner 6 months ago
  PostHTTP_Content-Type.xml Adding the PostHTTP_Content-Type template that demonstrates how to sp… 6 months ago
  Publish_Consume_JMS.xml Adding templates for processors released in NiFi 0.6.0 3 months ago
  Pull_from_Twitter_Garden_Hose.xml Moving templates to own directory to make repo cleaner 6 months ago
  ReplaceText_Expression_Language_CSV_Reformatting.xml Moving templates to own directory to make repo cleaner 6 months ago
  Retry_Count_Loop.xml Moving templates to own directory to make repo cleaner 6 months ago
  Self_Referencing_Http_Client_and_Server.xml Moving templates to own directory to make repo cleaner 6 months ago
  SplitRouteMerge.xml Moving templates to own directory to make repo cleaner 6 months ago
  SplitRouteMergeVsRouteText.xml Moving templates to own directory to make repo cleaner 6 months ago
  Splunk_Processors_with_Listen_TCP.xml Adding templates for processors released in NiFi 0.6.0 3 months ago
  Stress_Test_Framework.xml Moving templates to own directory to make repo cleaner 6 months ago
  SyslogExample.xml Moving templates to own directory to make repo cleaner 6 months ago
  Syslog_HBase.xml Adding new templates 6 months ago
  Twitter_Dashboard.xml Adding new templates 6 months ago
  Twitter_Solr.xml Moving templates to own directory to make repo cleaner 6 months ago
  WebCrawler.xml Update WebCrawler.xml 3 months ago
  Web_Scraper_Sample.xml Touching up Web_Scraper_Sample.xml 3 months ago
  Working_With_CSV.xml Moving templates to own directory to make repo cleaner 6 months ago
  Working_with_Logs.xml Moving templates to own directory to make repo cleaner 6 months ago
  csv-to-json-flow.xml Moving templates to own directory to make repo cleaner 6 months ago
  pgp_encryption.xml Adding template to demonstrate PGP Encrypt/Decrypt. Credit to Andrew … 3 months ago
  replacetextwithmapping-example.xml Adding a simple example using the ReplaceTextWithMapping processor. C… 3 months ago
  self_reference_flow_fix.xml Moving templates to own directory to make repo cleaner 6 months ago
  simple-httpget-route-flow.xml Moving templates to own directory to make repo cleaner 6 months ago

collect-stream-logs

This flow shows workflow for log collection, aggregation, store and display.

  1. Ingest logs from folders.
  2. Listen for syslogs on UDP port.
  3. Merge syslogs and drop-in logs and persist merged logs to Solr for historical search.
  4. Dashboard: stream real-time log events to dashboard and enable cross-filter search on historical logs data.

csv-to-json

This flow shows how to convert a CSV entry to a JSON document using ExtractText and ReplaceText.

decompression

This flow demonstrates taking an archive that is created with several levels of compression and then continuously decompressing it using a loop until the archived file is extracted out.

http-get-route

his flow pulls from a web service (example is nifi itself), extracts text from a specific section, makes a routing decision on that extracted value, prepares to write to disk using PutFile.

invoke-http-route

This flow demonstrates how to call an HTTP service based on an incoming FlowFile, and route the original FlowFile based on the status code returned from the invocation. In this example, every 30 seconds a FlowFile is produced, an attribute is added to the FlowFile that sets q=nifi, the google.com is invoked for that FlowFile, and any response with a 200 is routed to a relationship called 200.

retry-count-loop

This process group can be used to maintain a count of how many times a flowfile goes through it. If it reaches some configured threshold it will route to a 'Limit Exceeded' relationship otherwise it will route to 'retry'. Great for processes which you only want to run X number of times before you give up.

split-route

This flow demonstrates splitting a file on line boundaries, routing the splits based on a regex in the content, merging the less important files together for storage somewhere, and sending the higher priority files down another path to take immediate action.

twitter-garden-hose

This flow pulls from Twitter using the garden hose setting; it pulls out some basic attributes from the Json and then routes only those items that are actually tweets.

twitter-solr

This flow shows how to index tweets with Solr using NiFi. Pre-requisites for this flow are NiFi 0.3.0 or later, the creation of a Twitter application, and a running instance of Solr 5.1 or later with a tweets collection. Here are sample steps to set this up (along with Banana dashboard) on HDP Sandbox.

 

 

 

NIFI 中国社区 QQ群:595034369

Nifi 模板的更多相关文章

  1. nifi1.6.0汉化

    1.1 测试机 l  Apache NiFi 1.6.0 l  HDP 2.6.3 l  集群规模:单节点 l  操作系统:CentOs7 l  以下所有操作均在root用户下执行 1.2 安装环境 ...

  2. 【NIFI】 开发自定义Nifi Processor

    本例需要基础知识:[NIFI] Apache NiFI 安装及简单的使用 Nifi不光可以使用自带的Processor,还可以自定义Processor.本例简单介绍开发一个Processor 开发 1 ...

  3. Apache Nifi在Windows环境下搭建伪群集及证书登录

    代码地址如下:http://www.demodashi.com/demo/11986.html 前些时间做了关于Apache Nifi分布式集群的搭建分享,但很多时候要搭建分布式集群机器资源是个问题, ...

  4. NiFi汉化

    ①在源文件中的 source-nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/src中修 ...

  5. Apache NiFi 开发 处理器使用说明

    NIFI的使用: 注意:FlowFile由[属性]和[内容]组成,在解析的过程中这个概念非常重要,因为有些组件操作的是属性,有些组件操作的是内容,在配置组件时Destination配置项的选择很重要, ...

  6. 初识Apache NiFi

    一. NiFi介绍 Apache NiFi支持功能强大且可扩展的数据路由,转换和系统中介逻辑的有向图. Apache NiFi的一些高级功能和目标包括: 基于Web的用户界面 设计,控制,反馈和监控之 ...

  7. Apache NiFi 核心概念和关键特性

    本文来源于官方文档翻译 NiFi 的核心概念 NiFi 最早是美国国家安全局内部使用的工具,用来投递海量的传感器数据.后来由 apache 基金会开源.天生就具备强大的基因.NiFi基本设计理念与 F ...

  8. Nifi简介及核心概念整理

    简介 Apache NiFi 是一个易于使用.功能强大而且可靠的数据拉取.数据处理和分发系统,用于自动化管理系统间的数据流. 它支持高度可配置的指示图的数据路由.转换和系统中介逻辑,支持从多种数据源动 ...

  9. Apache nifi 第一篇(概述)

    1.什么是Apache NiFi? 简单地说,NiFi是为了自动化系统之间的数据流.虽然数据流这种形式很容易理解,但我们在此使用它来表示系统之间的自动化和不同系统之间数据的流转.企业拥有多个系统,其中 ...

随机推荐

  1. tomcat server.xml各个端口的作用

    <Server port="8005" shutdown="SHUTDOWN"> <!-- port:指定一个端口,这个端口负责监听关闭Tom ...

  2. IDEA 各版本在线激活(激活码)

    lan yu 大佬的授权又被封杀了,还好我收藏了一些其他的服务器地址. 在线授权服务器 https://jetlicense.nss.im/ 授权代码 K03CHKJCFT-eyJsaWNlbnNlS ...

  3. 优化CSS重排重绘与浏览器性能

    关于CSS重排和重绘的概念,最近看到不少这方面的文章,觉得挺有用,在制作中考虑浏览器的性能,减少重排能够节省浏览器对其子元素及父类元素的重新渲染:避免过分的重绘也能节省浏览器性能:优化动画,使用3D启 ...

  4. python爬虫之win7Mongod安装使用

    1.下载地址:https://www.mongodb.com/download-center#community 下载完成以后下一步下一步安装. 安装路径 还需要建立一个数据库存储位置C:\mongo ...

  5. WPF通过DynamicResource实现给界面动态更换皮肤

    在我们的程序中有时候需要去实现动态更换皮肤的效果,从而完成一些个性化的设置,那么我们究竟怎样去实现动态换皮肤的效果呢?那么我们经常用到的就是设置不同的Style,并且在主程序的xaml文件中通过Dyn ...

  6. ConnectTimeout和ReadTimeout所代表的意义

    参考:ConnectTimeout和ReadTimeout所代表的意义 ConnectTimeout 指的是建立连接所用的时间,适用于网络状况正常的情况下,两端连接所用的时间. 在java中,网络状况 ...

  7. js splice vs slice

    js splice vs slice https://stackoverflow.com/questions/37601282/javascript-array-splice-vs-slice htt ...

  8. python数据结构与算法第十一天【希尔排序】

    1.希尔排序的原理 2.代码实现 def shell_sort(alist): n = len(alist) # 初始步长 gap = n / 2 while gap > 0: # 按步长进行插 ...

  9. python之if使用方法举例

    if使用方法举例: import random #随机生成1-100的整数 n = random.randint(1, 100) if n > 50: print(n, "> 5 ...

  10. 【数模】day06-数理统计I

    数理统计. 以样本推断总体,进而用总体研究问题. 分两部分学习,第一部分是基础统计.参数估计.假设检验以及bootstrap方法. 1. 基础统计 假设有如下数据: 要做频数表.直方图.折线图.饼状图 ...