ORCFILE IN HDP 2: BETTER COMPRESSION, BETTER PERFORMANCE by Carter Shanklin   The upcoming Hive 0.12 is set to bring some great new advancements in the storage layer in the forms of higher compression and better query performance. HIGHER COMPRESSION…

原文地址: https://hortonworks.com/blog/orcfile-in-hdp-2-better-compression-better-performance/ ORCFILE IN HDP 2: BETTER COMPRESSION, BETTER PERFORMANCE by Carter Shanklin ORCFILE IN HDP 2:更好的压缩,更高的性能 The upcoming Hive 0.12 is set to bring some great new…

MongoDB3.0中的压缩选项 在MongoDB 3.0中,WiredTiger为集合提供三个压缩选项: 无压缩 Snappy(默认启用) – 很不错的压缩,有效利用资源 zlib(类似gzip) – 出色的压缩,但需要占用更多资源 有索引的两个压缩选项: 无压缩 前缀(默认启用) – 良好的压缩,资源的有效利用 请记住哪些适用于MongoDB的3.0所有压缩选项: 随机数据不能压缩 二进制数据不能压缩(它可能已经被压缩) 文本压缩效果特别好 对于文件中的字段名压缩效果特别好(尤其对短字段名来…

原文地址:http://wiki.apache.org/solr/SolrPerformanceFactors Contents Schema Design Considerations indexed fields Stored fields Configuration Considerations mergeFactor mergeFactor Tradeoffs HashDocSet Max Size Considerations Cache autoWarm Count Consider…

RMAN高级设置. 本章内容: Configuring Advanced Channel Options  高级通道选项 Configuring Advanced Backup Options 高级备份选项 Configuring Auxiliary Instance Data File Names 配置辅助实例文件名 Configuring the Snapshot Control File Location 配置控制文件快照 Configuring RMAN for Use with a S…

1.ext2产生的历史 最早的Linux内核是从MINIX系统过渡发展而来的.Linux最早的文件系统就是MINIX文件系统.MINIX文件系统几乎到处都是bug,采用的是16bit偏移量,最大容量为64M,文件名最长为14字符. Linux内核0.96版本,包含了虚拟文件系统(vitual file system, VFS),VFS中提供了基础的API用于简化扩展新的文件系统——扩展的文件系统(extended file system, ext)基于VFS API. 1992年Linux发布的…

压缩表是我们维护管理中常常会用到的.以下我们看都oracle给我们提供了哪些压缩方式. 文章摘自"Oracle® Database Administrator's Guide11g Release 2 (11.2)".由于Hybrid Columnar Compression压缩仅仅有在Exadata上才支持,眼下用的比較少,我们会重点说一下basic和oltp两种压缩方式. Consider Using Table Compression As your database grows…

MongoDB 3.0 WiredTiger Compression and Performance One of the most exciting developments over the lifetime of MongoDB must be the inclusion of the WiredTiger storage engine in MongoDB 3.0. Its very design and core architecture are legions ahead of th…

一.file format ORCFile在HDP 2:更好的压缩,更好的性能: https://zh.hortonworks.com/blog/orcfile-in-hdp-2-better-compression-better-performance/ 官方ORCfile介绍: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC 官方PARQUET介绍: https://cwiki.apache.org/co…

5 WAYS TO MAKE YOUR HIVE QUERIES RUN FASTER 今天看了一篇[文章] (http://zh.hortonworks.com/blog/5-ways-make-hive-queries-run-faster/),讲述了优化Hive的5个建议.其中每个建议细说的话,都可以写一篇或者多篇文章.下面简要记录下,后续慢慢补充: 1: USE TEZ Tez 是一个开源的支持DAG作业的计算框架,它来源于MapReduce框架.可以通过设置 set hive.exec…

本文,帮助了解响应压缩的一些知识及用法(大部分翻译于官网,英文水平有限,不准确之处,欢迎指正). 什么是响应压缩?响应压缩简单的说就是为了减少网络带宽,而把返回的响应压缩,使之体积缩小,从而加快响应的一种技术(个人理解) 网络带宽是有限的资源.减少响应(response)的大小通常可以增加应用的响应性(即减少响应的大小可以加快响应的速度),这是很引人注目的(often dramatically).压缩(压缩compress)应用的响应可以减少装载的大小. 当使用响应压缩中间件时(Response…

http://social.technet.microsoft.com/wiki/contents/articles/7926.sharepoint-2010-tips-for-dealing-with-performance-issues.aspx http://www.aptimize.com/upload/docs/sharepoint-performance-optimization-10-steps.pdf How to tune SharePoint 2010 Server for…

1 compress & mr hive默认的execution engine是mr hive> set hive.execution.engine;hive.execution.engine=mr 所以针对mr的优化就是hive的优化,比如压缩和临时目录 mapred-site.xml <property> <name>mapreduce.map.output.compress</name> <value>true</value>…

原地址:http://blog.sina.com.cn/s/blog_72b936d801013ptr.html icense Comparisons http://unity3d.com/unity/licenses#iphone Optimizing Graphics Performance http://unity3d.com/support/documentation/Manual/Optimizing Graphics Performance.html iOS A useful bac…

Features Pricing Add-ons Resources | Log in Sign up   Guides & Tutorials Web Server Guides Nginx How to Configure Nginx for Optimized Performance   How to Configure Nginx for Optimized Performance Updated Wednesday, September 9th, 2015 by LinodeContr…

DesktopGood performance is critical to the success of many games. Below are some simple guidelines for maximizing the speed of your game's graphical rendering. 好的性能,是很多游戏成功 的关键.下面是一些简单的指引,最大限度地提高你的游戏图形渲染速度. Optimizing Meshes 优化网格You only pay a render…

https://msdn.microsoft.com/en-us/library/ff647787.aspx Retired Content This content is outdated and is no longer being maintained. It is provided as a courtesy for individuals who are still using these technologies. This page may contain URLs that we…

Survey Recent Advances in Efficient Computation of Deep Convolutional Neural Networks, [arxiv '18] A Survey of Model Compression and Acceleration for Deep Neural Networks [arXiv '17] Quantization The ZipML Framework for Training Models with End-to-En…

Apache Kafka is optimized for small messages. According to benchmarks, the best performance occurs with 1 KB messages. Larger messages (for example, 10 MB to 100 MB) can decrease throughput and significantly impact operations. This topic describes op…

The database can use table compression to eliminate duplicate values in a data block. This section describes the format of data blocks that use compression. The format of a data block that uses basic and advanced row compression is essentially the sa…

http://www.ilsistemista.net/index.php/virtualization/1-virtual-machines-performance-comparison.html?limitstart=0 Today, "Virtual machine" seems to be a magic words in the computer industry. Why? Simply stated, this technology promise better serv…

5.在安装的时候遇到的问题 5.1使用ambari-server start的时候出现ERROR: Exiting with exit code -1. 5.1.1REASON: Ambari Server java process died with exitcode 255. Check /var/log/ambari-server/ambari-server.out for more information 解决: 由于是重新安装,所以在使用/etc/init.d/postgresql …

本文转自:https://magedirect.co/how-to-speed-up-magento-2-maximum-performance/ Introduction In this article, we’ll show you how to run a Magento 2 store at maximum speed. We will review the most popular techniques that you can quickly implement today. So,…

本文转自:https://www.mgt-commerce.com/blog/magento-on-steroids-best-practice-for-highest-performance/ There are plenty of blog posts with tips how to increase the performance of a magento store this shows us how important the speed of a magento store is.…

来自:http://blog.liveramp.com/2013/04/08/kafka-0-8-producer-performance-2/ At LiveRamp, we constantly face scaling challenges as the volume of data that our infrastructure must deal with continues to grow. One such challenge involves the logging system…

1. Parameter pruning and sharing 1.1 Quantization and Binarization Compressing deep convolutional networks using vector quantization Quantized convolutional neural networks for mobile devices Improving the speed of neural networks on cpus Deep learni…

Convolutional Neural Networks ImageNet Models Architecture Design Activation Functions Visualization Fast Convolution Low-Rank Filter Approximation Low Precision Parameter Pruning Transfer Learning Theory 3D Data Hardware ImageNet Models 2017 CVPR Xc…

看U3D文档,心得:对于3D场景,使用分层次的距离裁剪,小物件分到一个层,稍远时就被裁掉,大物体分到一个层,距离很远时才裁掉,甚至不载.中物体介于二者之间. 文档如下: Good performance is critical to the success of many games. Below are some simple guidelines for maximizing the speed of your game’s rendering. Locate high graphics i…

Now I will introduce a way to compress a text. When we are confronted with numerous data, and the data has a similar structure, we can take advantage of the feature to improve the performance of compression. In most of times, we could take the method…

ASP.NET Web API is a great piece of technology. Writing Web API is so easy that many developers don’t take the time to structure their applications for great performance. In this article, I am going to cover 8 techniques for improving ASP.NET Web API…