源文地址 (September 2008) For the last couple of years, I've been working on European Space Agency (ESA) projects - writing rather complex code generators. In the ESA project I am currently working on, I am also the technical lead; and I recently faced t…

上篇我们讨论了静态数据源(Static Source, snapshot).这种方式只能在预知数据规模有限的情况下使用,对于超大型的数据库表也可以说是不安全的资源使用方式.Slick3.x已经增加了支持Reactive-Streams功能,可以通过Reactive-Streams API来实现有限内存空间内的无限规模数据读取,这正符合了FunDA的设计理念:高效.便捷.安全的后台数据处理工具库.我们在前面几篇讨论里介绍了Iteratee模式,play-iteratees支持Reactive-St…

今天我写点NTFS的交换数据流以及其带来的安全问题(Alternate Data Stream/ADS) ========================================================================================================================================================================= 1.什么是ADS?   要了解什么是ADS我们必须先了…

https://github.com/onurakpolat/awesome-bigdata A curated list of awesome big data frameworks, resources and other awesomeness. Inspired by awesome-php, awesome-python, awesome-ruby, hadoopecosystemtable & big-data. Your contributions are always welco…

相当长一段时间以来,大数据社区已经普遍认识到了批量数据处理的不足.很多应用都对实时查询和流式处理产生了迫切需求.最近几年,在这个理念的推动下,催生出了一系列解决方案,Twitter Storm,Yahoo S4,Cloudera Impala,Apache Spark和Apache Tez纷纷加入大数据和NoSQL阵营.本文尝试探讨流式处理系统用到的技术,分析它们与大规模批量处理和OLTP/OLAP数据库的关系,并探索一个统一的查询引擎如何才能同时支持流式.批量和OLAP处理. 在Grid Dy…

Exploring the 7 Different Types of Data Stories What makes a story truly data-driven? For one, the numbers aren’t caged in a sidebar graph. Instead, the data helps drive the narrative. Data can help narrate as many types of stories as there are angle…

FIO14-C. Understand the difference between text mode and binary mode with file streams     Skip to end of metadata   Created by Justin Pincar, last modified by Carol J. Lallier on Oct 14, 2013 Go to start of metadata   Input and output are mapped int…

The R qgraph Package: Using R to Visualize Complex Relationships Among Variables in a Large Dataset, Part One A Tutorial by D. M. Wiig, Professor of Political Science, Grand View University In my most recent tutorials I have discussed the use of the …

January 22, 2019Use Cases, Apache Flink Lasse Nedergaard     Recently there has been significant discussion about edge computing as a major technology trend in 2019. Edge computing brings computing capabilities away from the cloud, and rather close t…

deep api integration makes getting value from your big data easy 深度api集成使你大数据訪问更加easy Elasticsearch is quickly becoming the de facto search and analytics solution that organizations are using to provide real-time insights into their Hadoop data. Elas…