[http://arloz.me/tornado/2014/06/27/uploadvideotornado.html]

[NGINX REFRER:Nginx upload module]

由于tornado通过表达上传的数据最大限制在100M，所以如果需要上传视屏文件的情况在需要通过其他方式实现， 此处采用nginx的nginx-upload-module和jQuery-File-Upload实现。

1.编译安装nginx-upload-module

  • 下载nginx-1.5.8
  • 下载nginx-upload-module2.0
  • 由于nginx-upload-module不支持最新版的nginx，直接编译会出错，需要打补丁 davromaniak.txt
tar xzf nginx-1.5.

tar xzf nginx_upload_module-2.0..tar.gz

cd nginx_upload_moule-2.0.

patch ngx_http_upload_module.c davromaniak.txt

cd ../nginx-1.5.

./configure --add-module=../nginx_upload_moule-2.0.

make & sudo make install

2.配置nginx的upload-module

upstream tornadoserver{

    server 127.0.0.1:;

}

server {

listen       ;

server_name  localhost;

location / {

    proxy_pass_header Server;

    proxy_set_header Host $http_host;

    proxy_redirect off;

    proxy_set_header X-Real-IP $remote_addr;

    proxy_set_header X-Scheme $scheme;

    proxy_pass http://tornadoserver;

}

client_max_body_size 4G;

client_body_buffer_size 1024k;

if ($host !~* ^(localhost) ) {

}

location = /uploads {

    if ($request_method = OPTIONS) {

        add_header Pragma no-cache;

        add_header X-Content-Type-Options nosniff;

        # Access control for CORS

        add_header Access-Control-Allow-Origin "http://localhost";

        add_header Access-Control-Allow-Methods "GET, POST, PUT, DELETE, OPTIONS";

        add_header Access-Control-Allow-Headers "cache-control, content-range, accept,\

            origin, session-id, content-disposition, x-requested-with, ctent-type,\

            content-description, referer, user-agent";

        add_header Access-Control-Allow-Credentials "true";

        #  minute pre-flight approval

        add_header Access-Control-Max-Age ;

        return ;

    }

    if ($request_method = POST) {

        add_header Pragma no-cache;

        add_header X-Content-Type-Options nosniff;

        #add_header Cache-control "no-story, no-cache, must-revalidate";

        # Access control for CORS

        add_header Access-Control-Allow-Origin "http://localhost";

        add_header Access-Control-Allow-Methods "GET, POST, PUT, DELETE, OPTIONS";

        add_header Access-Control-Allow-Headers "cache-control, content-range, accept,\

                origin, session-id, content-disposition, x-requested-with,\

                content-type, content-description, referer, user-agent";

        add_header Access-Control-Allow-Credentials "true";

        #  minute pre-flight approval

        add_header Access-Control-Max-Age ;

        upload_set_form_field $upload_field_name.name "$upload_file_name";

        upload_set_form_field $upload_field_name.content_type "$upload_content_type";

        upload_set_form_field $upload_field_name.path "$upload_tmp_path";

        upload_pass_form_field "^X-Progress-ID$|^authenticity_token$";

        upload_cleanup    -;

    }

    upload_pass @fast_upload_endpoint;

    # {a..z} not usefull when use zsh

    # mkdir {..} {a..z} {A..Z}

    upload_store /tmp/uploads ;

    # set permissions on the uploaded files

    upload_store_access user:rw group:rw all:r;

}

location @fast_upload_endpoint {

    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

    proxy_set_header X-Forwarded-Proto $scheme;

    proxy_set_header Host $http_host;

    proxy_redirect off;

    proxy_pass_header 'Access-Control-Allow-Origin';

    proxy_pass http://tornadoserver;

}

}

3.demo页面

<!DOCTYPE HTML>

<html>

<head> <meta charset="utf-8">

    <title>jQuery File Upload Example</title>

    <style>

    .bar {

        height: 18px;

        background: green;

    }

</style></head>

<body>

    <input id="fileupload" type="file" name="files[]" data-url="uploads" multiple>

    <script src=""></script>

    <script src="/static/js/vendor/jquery.ui.widget.js"></script>

    <script src="/static/js/jquery.iframe-transport.js"></script>

    <script src="/static/js/jquery.fileupload.js"></script>

    <script>

        $(function () {

            $('#fileupload').fileupload({

                dataType: 'json',

                done: function (e, data) {

                    $.each(data.result.files, function (index, file) {

                       $('<p/>').text(file.name+"  "+file.size).appendTo(document.body);

                    });

                },

                progressall: function (e, data) {

                    var progress = parseInt(data.loaded / data.total * 100, 10);

                    $('#progress .bar').css( 'width', progress + '%');

                }

            });

        });

    </script>

    <div id="progress">

        <div class="bar" style="width: 10%;"></div>

    </div>

</body>

</html>

4.tornado处理

当nginx的upload-module完成视频文件的传输之后，其会设置表单数据，并转发给后台tornado服务器处理。

通过如下方式获得相关参数：

name = self.get_argument("files[].name","")

content_type = self.get_argument("files[].content_type","")

oldpath = self.get_argument("files[].path","")

size = os.path.getsize(oldpath)

files = []

files.append({"name":name,"type":content_type,"size":size})

ret = {"files":files}

self.write(tornado.escape.json_encode(ret))

5.其它配置文件参考
user root;

worker_processes 1;

#error_log logs/error.log;

#error_log logs/error.log notice;

#error_log logs/error.log info;

#pid logs/nginx.pid;

events {

worker_connections 1024;

}

http {

include mime.types;

default_type application/octet-stream;

#log_format main '$remote_addr - $remote_user [$time_local] "$request" '

# '$status $body_bytes_sent "$http_referer" '

# '"$http_user_agent" "$http_x_forwarded_for"';

#access_log logs/access.log main;

sendfile on;

#tcp_nopush on;

#keepalive_timeout 0;

keepalive_timeout 65;

#gzip on;

server {

upload_resumable on;

client_max_body_size 100m;

listen 8888;

server_name localhost;

# Upload form should be submitted to this location

location /upload {

# Pass altered request body to this location

upload_pass @test;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Pass altered request body to a backend

location @test {

proxy_pass http://mongrel;

}

}

server{

listen 30091;

root /var/www/sms/public/video;

}

upstream mongrel {

server 127.0.0.1:3001;

server 127.0.0.1:3002;

server 127.0.0.1:3003;

}

server {

upload_resumable on;

client_max_body_size 100m;

listen 3000;

root /var/www/sms/public;

access_log /var/www/sms/log/nginx.access.log;

if (-f $document_root/system/maintenance.html) {

rewrite ^(.*)$ /system/maintenance.html last;

break;

}

#upload video

location /upload_video {

# Pass altered request body to this location

upload_pass @rails;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Upload image

location /upload_image {

# Pass altered request body to this location

upload_pass @rails;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Pass altered request body to a backend

location @rails {

proxy_pass http://mongrel;

}

location / {

proxy_set_header X-Real-IP $remote_addr;

# needed for HTTPS

proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

proxy_set_header Host $http_host;

proxy_redirect off;

proxy_max_temp_file_size 0;

if (-f $request_filename) {

break;

}

if (-f $request_filename/index.html) {

rewrite (.*) $1/index.html break;

}

if (-f $request_filename.html) {

rewrite (.*) $1.html break;

}

if (!-f $request_filename) {

proxy_pass http://mongrel;

break;

}

}

error_page 500 502 503 504 /500.html;

location = /500.html {

root /var/www/sms/public;

}

}

}

　　

 
 

tornado+nginx上传视频文件的更多相关文章

  1. 以springMVC为例获取上传视频文件时长

    毕设项目是一个在线学习系统,教师用户有上传视频的功能,在答辩之前赶了一个demo出来,好多功能都写死了,比如课程学习进度就是被我写死在前端的一个变量,最近导师要我把项目打包发给他,这才心慌慌赶紧把这些 ...

  2. plupload分片上传视频文件源码展示

    plupload分片上传视频文件目录结构如下: |- images//视频上传小图片 |-js// plupload js文件 |-uploads//视频文件存放文件夹 里面是按日期存放 |-ajax ...

  3. java上传视频文件

    需求:项目要支持大文件上传功能,经过讨论,初步将文件上传大小控制在500M内,因此自己需要在项目中进行文件上传部分的调整和配置,自己将大小都以501M来进行限制. 第一步: 前端修改 由于项目使用的是 ...

  4. 利用bootstrap上传视频文件，mvc做后台处理

    @{ Layout = null; } <!DOCTYPE html> <html> <head> <meta name="viewport&quo ...

  5. DJANGO技巧两则：模拟MKDIR -P及配合NGINX上传大文件不使超时

    这都是在开发当哪遇到的问题,网上转转,作个记录: http://blog.chinaunix.net/uid-25525723-id-1596574.html http://bookshadow.co ...

  6. 使用HttpUtils 上传视频文件

    private void shangchuan(){                 //文件的路径        //File file=new File(path);        File fi ...

  7. h5上传视频文件

    从一开始我就掉坑里了,<input type="file" style="display: block;" id="img-upload&quo ...

  8. nginx上传大文件，413错误解决

    在nginx里增加了配置. client_max_body_size 500m; proxy_connect_timeout 600; proxy_read_timeout 600; proxy_se ...

  9. 使用resumable.js上传大文件（视频）兵转换flv格式

    前台代码 <%@ Page Language="C#" AutoEventWireup="true" CodeBehind="Video.asp ...

随机推荐

  1. 1020. Tree Traversals (25) ——树的遍历

    //题目 通过后续遍历 中序遍历 得出一棵树 ,然后按树的层次遍历打印 PS:以前对于这种用指针的题目是比较头痛的,现在做了一些链表操作后,感觉也不难 先通过后续中序建一棵树,然后通过BFS遍历这棵树 ...

  2. 在 windows7 中使用 vs2003 时，“在文件中查找”导致无响应的问题

    解决 Win7 32bit/64bit环境下,在使用VS2003的查找功能时,会导致VS2003无响应. 解决方法:找到VS2003的安装目录,修改"...\Microsoft Visual ...

  3. php排序集合

    如果你已经使用了一段时间PHP的话,那么,你应该已经对它的数组比较熟悉了——这种数据结构允许你在单个变量中存储多个值,并且可以把它们作为一个集合进行操作. 经常,开发人员发现在PHP中使用这种数据结构 ...

  4. elasticsearch5.6.8中文分词器

    安装分词器,务必确保版本一致! 下载地址:https://github.com/medcl/elasticsearch-analysis-ik 为了保证一致,我特地将elasticsearch进行降级 ...

  5. MySQL写出高效SQL

    mysql设计标准事务处理标准索引使用标准约束设计sql语句标准 怎么写出高效SQL清晰无误的了知业务需求满足业务需求,不做无用功知道表数据量和索引基本情况知道完成SQL需要扫描的数据量级SQL执行计 ...

  6. 第一章 初识MySQL（待续）

    ···········

  7. oracle 11g R2 标准版 64位linux安装

    安装环境:Redhat es 5.5 64位 ,系统内存8G,swap 10G ,oracle 11G R2 标准版 一,Oracle 安装前的准备检查一下包,必须全部安装:binutils-2.17 ...

  8. 「小程序JAVA实战」 小程序wxss样式文件的使用（七）

    转自:https://idig8.com/2018/08/09/xiaochengxu-chuji-07/ 细说下微信小程序的wxss样式文件.源码:https://github.com/liming ...

  9. 幂等性的含义和 HTTP请求方法的幂等性

    幂等性的含义和 HTTP请求方法的幂等性 1.什么是幂等性 =============== 幂等性,英文是idempotent,读作[aɪ'dɛmpətənt]. 它的含义如下: “Methods c ...

  10. Java基础知识（二）之控制语句

    1.条件运算符   ⑴if...else... ⑵三目表达式——X?Y:Z 当X为真时,结果为Y:反之,为Z. ⑶switch(表达式){ case 1:    执行代码块 1; break: cas ...