http://vinoyang.com/

http://wuchong.me

Apache Flink源码解析之stream-source

https://yq.aliyun.com/articles/259154

Flink - watermark

https://yq.aliyun.com/articles/73191

http://wuchong.me/blog/2016/05/04/flink-internal-how-to-build-streamgraph/

http://vinoyang.com/

https://ci.apache.org/projects/flink/flink-docs-release-1.3/internals/task_lifecycle.html

https://www.slideshare.net/dataArtisans/flink-training-system-overv

https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals

http://www.cnblogs.com/fxjwind/p/5955990.html

http://www.cnblogs.com/fxjwind/category/778309.html

http://vinoyang.com/2016/04/14/akka-in-flink/

https://cwiki.apache.org/confluence/display/FLINK/Akka+and+Actors

Key GROUPS

https://issues.apache.org/jira/browse/FLINK-3755

https://dataartisans.github.io/flink-training/slides/flink_stream_statefulOps.pdf

http://blogoloquy.blogspot.hk/2016/02/getting-close-to-apache-flink-albeit-in.html

https://arxiv.org/pdf/1506.08603.pdf

http://flink.apache.org/news/2017/06/01/release-1.3.0.html

https://issues.apache.org/jira/browse/FLINK-5929

https://www.user.tu-berlin.de/asteriosk/assets/publications/flink-deb.pdf

https://cds.cern.ch/record/2208322/files/report.pdf

A {@link Trigger} that fires once the number of elements in a pane reaches the given count or the timeout expires, whichever happens first.

https://gist.github.com/shikhar/2cb9f1b792be31b7c16e

https://stackoverflow.com/questions/36305123/why-is-only-one-instance-of-globalwindow-used/36305578?noredirect=1#comment75752054_36305578

培训材料

https://stackoverflow.com/questions/44382329/can-we-combine-both-and-count-and-process-time-trigger-in-flink

https://github.com/apache/flink/blob/2bfead7d9bef51713ed203fa7979f71f23525733/flink-libraries/flink-table/src/main/scala/org/apache/flink/table/runtime/triggers/StateCleaningCountTrigger.scala

how-do-i-debug-apache-flink

https://stackoverflow.com/questions/37659176/how-do-i-debug-apache-flink

https://stackoverflow.com/questions/21114066/attach-intellij-idea-debugger-to-a-running-java-process

build source code

https://github.com/apache/flink/blob/master/docs/internals/ide_setup.md#intellij-idea

https://github.com/apache/flink

windowing

https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/event_time.html

https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/event_timestamps_watermarks.html

https://stackoverflow.com/questions/36305123/why-is-only-one-instance-of-globalwindow-used/36305578?noredirect=1#comment75752054_36305578

https://stackoverflow.com/questions/36305123/why-is-only-one-instance-of-globalwindow-used

https://github.com/apache/flink/tree/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/windowing

https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/windows.html

https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/stream/process_function.html

https://stackoverflow.com/questions/42200261/is-there-a-way-to-define-a-flink-count-window-which-evicts-all-messages-after-a

process_function

https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/stream/state.html

https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/stream/process_function.html

https://github.com/apache/flink/blob/12b4185c6c09101b64e12a84c33dc4d28f95cff9/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java

/**
* Windows this {@code KeyedStream} into tumbling count windows.
*
* @param size The size of the windows in number of elements.
*/
public WindowedStream<T, KEY, GlobalWindow> countWindow(long size) {

https://github.com/apache/flink/blob/12b4185c6c09101b64e12a84c33dc4d28f95cff9/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/KeyedStream.java

windowing/assigners

https://github.com/apache/flink/tree/12b4185c6c09101b64e12a84c33dc4d28f95cff9/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/windowing/assigners

KeyGroupStreamPartitioner

https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/partitioner/KeyGroupStreamPartitioner.java

KeyedStream.Java

https://github.com/apache/flink/blob/12b4185c6c09101b64e12a84c33dc4d28f95cff9/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/KeyedStream.java

KeyedStream.scala

countWindow,timeWindow,window,reduce,fold,max,min,sum,minby,

https://github.com/apache/flink/blob/54ceec16c11655da4181c0816a3b12d1c4bab465/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/KeyedStream.scala

https://github.com/apache/flink/blob/61914abffa83a55d4f0a339dbcf64c540962a9cd/flink-libraries/flink-table/src/main/scala/org/apache/flink/table/plan/nodes/datastream/DataStreamGroupWindowAggregate.scala

WindowedStream.scala

https://github.com/apache/flink/blob/67c4be648b1f51ceadae3a9e3dd41807802a89ef/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/WindowedStream.scala

WindowedStream.Java

https://github.com/apache/flink/blob/545f50026c863c80978a2d0b9446ad6bf87a3596/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/WindowedStream.java

basic transformations

https://github.com/apache/flink/blob/545f50026c863c80978a2d0b9446ad6bf87a3596/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/KeyedStream.java

keyBy

DataStream

https://github.com/apache/flink/blob/545f50026c863c80978a2d0b9446ad6bf87a3596/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/DataStream.java

def keyBy ,map,flatMap,filter,timeWindowAll,split,print

https://github.com/apache/flink/blob/67c4be648b1f51ceadae3a9e3dd41807802a89ef/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala

kafaka consumer

KafkaConsumerThread

StringGeneratingSourceFunction
package org.apache.flink.streaming.connectors.kafka.internal;

https://stackoverflow.com/questions/42200261/is-there-a-way-to-define-a-flink-count-window-which-evicts-all-messages-after-a

https://stackoverflow.com/questions/44382329/can-we-combine-both-and-count-and-process-time-trigger-in-flink

Flink源码分析的更多相关文章

  1. Flink源码分析 - 源码构建

    原文地址:https://mp.weixin.qq.com/s?__biz=MzU2Njg5Nzk0NQ==&mid=2247483692&idx=1&sn=18cddc1ee ...

  2. Flink源码分析 - 剖析一个简单的Flink程序

    本篇文章首发于头条号Flink程序是如何执行的?通过源码来剖析一个简单的Flink程序,欢迎关注头条号和微信公众号"大数据技术和人工智能"(微信搜索bigdata_ai_tech) ...

  3. [源码分析] 从源码入手看 Flink Watermark 之传播过程

    [源码分析] 从源码入手看 Flink Watermark 之传播过程 0x00 摘要 本文将通过源码分析,带领大家熟悉Flink Watermark 之传播过程,顺便也可以对Flink整体逻辑有一个 ...

  4. flink checkpoint 源码分析 (二)

    转发请注明原创地址http://www.cnblogs.com/dongxiao-yang/p/8260370.html flink checkpoint 源码分析 (一)一文主要讲述了在JobMan ...

  5. 从flink-example分析flink组件(3)WordCount 流式实战及源码分析

    前面介绍了批量处理的WorkCount是如何执行的 <从flink-example分析flink组件(1)WordCount batch实战及源码分析> <从flink-exampl ...

  6. Flink 源码解析 —— Standalone Session Cluster 启动流程深度分析之 Job Manager 启动

    Job Manager 启动 https://t.zsxq.com/AurR3rN 博客 1.Flink 从0到1学习 -- Apache Flink 介绍 2.Flink 从0到1学习 -- Mac ...

  7. Flink 源码解析 —— Standalone Session Cluster 启动流程深度分析之 Task Manager 启动

    Task Manager 启动 https://t.zsxq.com/qjEUFau 博客 1.Flink 从0到1学习 -- Apache Flink 介绍 2.Flink 从0到1学习 -- Ma ...

  8. Flink的Job启动TaskManager端(源码分析)

    前面说到了  Flink的JobManager启动(源码分析)  启动了TaskManager 然后  Flink的Job启动JobManager端(源码分析)  说到JobManager会将转化得到 ...

  9. Flink中Idle停滞流机制(源码分析)

    前几天在社区群上,有人问了一个问题 既然上游最小水印会决定窗口触发,那如果我上游其中一条流突然没有了数据,我的窗口还会继续触发吗? 看到这个问题,我蒙了???? 对哈,因为我是选择上游所有流中水印最小 ...

随机推荐

  1. spring事务——try{...}catch{...}中事务不回滚的几种处理方式

    当希望在某个方法中添加事务时,我们常常在方法头上添加@Transactional注解 @ResponseBody @RequestMapping(value = "/payment" ...

  2. 【mysql】关于InnoDB存储引擎 text blob 大字段的存储和优化

    最近在数据库优化的时候,看到一些表在设计上使用了text或者blob的字段,单表的存储空间已经达到了近100G,这种情况再去改变和优化就非常难了 一.简介 为了清楚大字段对性能的影响,我们必须要知道i ...

  3. 总结一下关于mysql 5.6 新特性

    一直断断续续的看一些mysql特性,今天总结一下,以下是列表,网址 http://mariadb.org/ (也是类似的特性), http://mysql.com/ 最近在看关于mysql新特性的一些 ...

  4. ios持久化存储

    前言 iOS中常用的持久化存储方式有好几种: 偏好设置(NSUserDefaults) plist文件存储 归档 SQLite3 Core Data 沙盒 每个iOS应用都有自己的应用沙盒(应用沙盒就 ...

  5. du命令解决linux磁盘空间满的问题(很不错的哦)

    首先你要确定是不是真正的是因为数据空间占满磁盘,经常是因为某个程序的日志占满了空间.当发现磁盘满了以后不要着急,使用以下命令从根目录开始排除查找哪个文件夹最大: du --max-depth=1 找到 ...

  6. 工作8年对技术学习过程的一些 总结 与 感悟 为什么有时迷茫、无奈 学习编程语言的最高境界最重要的是编程思想 T 字发展 学技术忌讳”什么都会“ 每天进步一点等式图 时间管理矩阵

    工作这些年对技术学习过程的一些 总结 与 感悟(一) 引言 工作了8年,一路走来总有些感触时不时的浮现在脑海中.写下来留个痕迹,也顺便给大家一点参考.希望能给初学者一点帮助. 入门 进入计算机行业,起 ...

  7. XP、Windows7下自动关机vbs脚本,使用windows计划任务+vbs脚本在XP、Windows7下实现定时自动关机

    VBScript(Microsoft Visual Basic Script Edition).,微软公司可视化BASIC脚本版). 正如其字面所透露的信息, VBS(VBScript的进一步简写)是 ...

  8. openstack neutron中涉及的网络设备

    一.openstack neutron网络设备介绍 Bridge(网桥) 用于将两个LAN连接起来,主要靠的MAC地址学习机制.当网桥的Port收到包时会将包的源mac和port ID关联起来记入ma ...

  9. 《安卓考试》通用版ver-2,截图和源码

    首先放出源码:https://github.com/chenyoca/AndroidTopicBankEx 然后是实际应用运行效果截图: 最后说明一下: 1.应用没有完成,应用的数据是模拟的. 2.应 ...

  10. 12C -- 配置EM Express的端口

    EM Express是基于web接口的图形化数据库管理工具. 内嵌到数据库中,可以用来监控.管理数据的性能和完成大多数管理工作. EM Express是轻量级的管理工具,减少了数据库服务器的开销.没有 ...