[http://arloz.me/tornado/2014/06/27/uploadvideotornado.html]

[NGINX REFRER:Nginx upload module]

由于tornado通过表达上传的数据最大限制在100M，所以如果需要上传视屏文件的情况在需要通过其他方式实现， 此处采用nginx的nginx-upload-module和jQuery-File-Upload实现。

1.编译安装nginx-upload-module

  • 下载nginx-1.5.8
  • 下载nginx-upload-module2.0
  • 由于nginx-upload-module不支持最新版的nginx，直接编译会出错，需要打补丁 davromaniak.txt
tar xzf nginx-1.5.

tar xzf nginx_upload_module-2.0..tar.gz

cd nginx_upload_moule-2.0.

patch ngx_http_upload_module.c davromaniak.txt

cd ../nginx-1.5.

./configure --add-module=../nginx_upload_moule-2.0.

make & sudo make install

2.配置nginx的upload-module

upstream tornadoserver{

    server 127.0.0.1:;

}

server {

listen       ;

server_name  localhost;

location / {

    proxy_pass_header Server;

    proxy_set_header Host $http_host;

    proxy_redirect off;

    proxy_set_header X-Real-IP $remote_addr;

    proxy_set_header X-Scheme $scheme;

    proxy_pass http://tornadoserver;

}

client_max_body_size 4G;

client_body_buffer_size 1024k;

if ($host !~* ^(localhost) ) {

}

location = /uploads {

    if ($request_method = OPTIONS) {

        add_header Pragma no-cache;

        add_header X-Content-Type-Options nosniff;

        # Access control for CORS

        add_header Access-Control-Allow-Origin "http://localhost";

        add_header Access-Control-Allow-Methods "GET, POST, PUT, DELETE, OPTIONS";

        add_header Access-Control-Allow-Headers "cache-control, content-range, accept,\

            origin, session-id, content-disposition, x-requested-with, ctent-type,\

            content-description, referer, user-agent";

        add_header Access-Control-Allow-Credentials "true";

        #  minute pre-flight approval

        add_header Access-Control-Max-Age ;

        return ;

    }

    if ($request_method = POST) {

        add_header Pragma no-cache;

        add_header X-Content-Type-Options nosniff;

        #add_header Cache-control "no-story, no-cache, must-revalidate";

        # Access control for CORS

        add_header Access-Control-Allow-Origin "http://localhost";

        add_header Access-Control-Allow-Methods "GET, POST, PUT, DELETE, OPTIONS";

        add_header Access-Control-Allow-Headers "cache-control, content-range, accept,\

                origin, session-id, content-disposition, x-requested-with,\

                content-type, content-description, referer, user-agent";

        add_header Access-Control-Allow-Credentials "true";

        #  minute pre-flight approval

        add_header Access-Control-Max-Age ;

        upload_set_form_field $upload_field_name.name "$upload_file_name";

        upload_set_form_field $upload_field_name.content_type "$upload_content_type";

        upload_set_form_field $upload_field_name.path "$upload_tmp_path";

        upload_pass_form_field "^X-Progress-ID$|^authenticity_token$";

        upload_cleanup    -;

    }

    upload_pass @fast_upload_endpoint;

    # {a..z} not usefull when use zsh

    # mkdir {..} {a..z} {A..Z}

    upload_store /tmp/uploads ;

    # set permissions on the uploaded files

    upload_store_access user:rw group:rw all:r;

}

location @fast_upload_endpoint {

    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

    proxy_set_header X-Forwarded-Proto $scheme;

    proxy_set_header Host $http_host;

    proxy_redirect off;

    proxy_pass_header 'Access-Control-Allow-Origin';

    proxy_pass http://tornadoserver;

}

}

3.demo页面

<!DOCTYPE HTML>

<html>

<head> <meta charset="utf-8">

    <title>jQuery File Upload Example</title>

    <style>

    .bar {

        height: 18px;

        background: green;

    }

</style></head>

<body>

    <input id="fileupload" type="file" name="files[]" data-url="uploads" multiple>

    <script src=""></script>

    <script src="/static/js/vendor/jquery.ui.widget.js"></script>

    <script src="/static/js/jquery.iframe-transport.js"></script>

    <script src="/static/js/jquery.fileupload.js"></script>

    <script>

        $(function () {

            $('#fileupload').fileupload({

                dataType: 'json',

                done: function (e, data) {

                    $.each(data.result.files, function (index, file) {

                       $('<p/>').text(file.name+"  "+file.size).appendTo(document.body);

                    });

                },

                progressall: function (e, data) {

                    var progress = parseInt(data.loaded / data.total * 100, 10);

                    $('#progress .bar').css( 'width', progress + '%');

                }

            });

        });

    </script>

    <div id="progress">

        <div class="bar" style="width: 10%;"></div>

    </div>

</body>

</html>

4.tornado处理

当nginx的upload-module完成视频文件的传输之后，其会设置表单数据，并转发给后台tornado服务器处理。

通过如下方式获得相关参数：

name = self.get_argument("files[].name","")

content_type = self.get_argument("files[].content_type","")

oldpath = self.get_argument("files[].path","")

size = os.path.getsize(oldpath)

files = []

files.append({"name":name,"type":content_type,"size":size})

ret = {"files":files}

self.write(tornado.escape.json_encode(ret))

5.其它配置文件参考
user root;

worker_processes 1;

#error_log logs/error.log;

#error_log logs/error.log notice;

#error_log logs/error.log info;

#pid logs/nginx.pid;

events {

worker_connections 1024;

}

http {

include mime.types;

default_type application/octet-stream;

#log_format main '$remote_addr - $remote_user [$time_local] "$request" '

# '$status $body_bytes_sent "$http_referer" '

# '"$http_user_agent" "$http_x_forwarded_for"';

#access_log logs/access.log main;

sendfile on;

#tcp_nopush on;

#keepalive_timeout 0;

keepalive_timeout 65;

#gzip on;

server {

upload_resumable on;

client_max_body_size 100m;

listen 8888;

server_name localhost;

# Upload form should be submitted to this location

location /upload {

# Pass altered request body to this location

upload_pass @test;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Pass altered request body to a backend

location @test {

proxy_pass http://mongrel;

}

}

server{

listen 30091;

root /var/www/sms/public/video;

}

upstream mongrel {

server 127.0.0.1:3001;

server 127.0.0.1:3002;

server 127.0.0.1:3003;

}

server {

upload_resumable on;

client_max_body_size 100m;

listen 3000;

root /var/www/sms/public;

access_log /var/www/sms/log/nginx.access.log;

if (-f $document_root/system/maintenance.html) {

rewrite ^(.*)$ /system/maintenance.html last;

break;

}

#upload video

location /upload_video {

# Pass altered request body to this location

upload_pass @rails;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Upload image

location /upload_image {

# Pass altered request body to this location

upload_pass @rails;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Pass altered request body to a backend

location @rails {

proxy_pass http://mongrel;

}

location / {

proxy_set_header X-Real-IP $remote_addr;

# needed for HTTPS

proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

proxy_set_header Host $http_host;

proxy_redirect off;

proxy_max_temp_file_size 0;

if (-f $request_filename) {

break;

}

if (-f $request_filename/index.html) {

rewrite (.*) $1/index.html break;

}

if (-f $request_filename.html) {

rewrite (.*) $1.html break;

}

if (!-f $request_filename) {

proxy_pass http://mongrel;

break;

}

}

error_page 500 502 503 504 /500.html;

location = /500.html {

root /var/www/sms/public;

}

}

}

　　

 
 

tornado+nginx上传视频文件的更多相关文章

  1. 以springMVC为例获取上传视频文件时长

    毕设项目是一个在线学习系统,教师用户有上传视频的功能,在答辩之前赶了一个demo出来,好多功能都写死了,比如课程学习进度就是被我写死在前端的一个变量,最近导师要我把项目打包发给他,这才心慌慌赶紧把这些 ...

  2. plupload分片上传视频文件源码展示

    plupload分片上传视频文件目录结构如下: |- images//视频上传小图片 |-js// plupload js文件 |-uploads//视频文件存放文件夹 里面是按日期存放 |-ajax ...

  3. java上传视频文件

    需求:项目要支持大文件上传功能,经过讨论,初步将文件上传大小控制在500M内,因此自己需要在项目中进行文件上传部分的调整和配置,自己将大小都以501M来进行限制. 第一步: 前端修改 由于项目使用的是 ...

  4. 利用bootstrap上传视频文件，mvc做后台处理

    @{ Layout = null; } <!DOCTYPE html> <html> <head> <meta name="viewport&quo ...

  5. DJANGO技巧两则：模拟MKDIR -P及配合NGINX上传大文件不使超时

    这都是在开发当哪遇到的问题,网上转转,作个记录: http://blog.chinaunix.net/uid-25525723-id-1596574.html http://bookshadow.co ...

  6. 使用HttpUtils 上传视频文件

    private void shangchuan(){                 //文件的路径        //File file=new File(path);        File fi ...

  7. h5上传视频文件

    从一开始我就掉坑里了,<input type="file" style="display: block;" id="img-upload&quo ...

  8. nginx上传大文件，413错误解决

    在nginx里增加了配置. client_max_body_size 500m; proxy_connect_timeout 600; proxy_read_timeout 600; proxy_se ...

  9. 使用resumable.js上传大文件（视频）兵转换flv格式

    前台代码 <%@ Page Language="C#" AutoEventWireup="true" CodeBehind="Video.asp ...

随机推荐

  1. 【openCV学习笔记】在Mac上配置openCV步骤详解

    (1)安装Homebrew:(需要Ruby) 注:因为snow leopard 以后已经自带Ruby了,所有可以不用自己安装Ruby. 看一下Homebrew的官网: http://mxcl.gith ...

  2. 73个word使用终极技巧

    1.问:Word里边怎样设置每页不同的页眉?如何使不同的章节显示的页眉不同? 答:分节,每节可以设置不同的页眉.文件——页面设置——版式——页眉和页脚——首页不同 2.问:请问Word中怎样让每一章用 ...

  3. Stratix IV内嵌DPA电路的基本结构

    StratixIV内嵌DPA电路的基本结构 Altera DPA电路特点如下. 可以放松高速接口对时钟到数据通道和数据通道之间对Skew的严格要求. 最高支持1.6Gbit/s应用. 专用硬件DPA ...

  4. FPGA中的“门”

    逻辑门 在ASIC的世界里,衡量器件容量的常用标准是等效门.这是因为不同的厂商在单元库里提供了不同的功能模块,而每个功能模块的实现都要求不同数量的晶体管.这样在两个器件之间比较容量和复杂度就很困难. ...

  5. python开发面向对象基础：接口类&抽象类&多态&钻石继承

    一,接口类 继承有两种用途: 一:继承基类的方法,并且做出自己的改变或者扩展(代码重用) 二:声明某个子类兼容于某基类,定义一个接口类Interface,接口类中定义了一些接口名(就是函数名)且并未实 ...

  6. 四、 kafka consumer 配置

    consumer配置 #指明当前消费进程所属的消费组,一个partition只能被同一个消费组的一个消费者消费(同一个组的consumer不会重复消费同一个消息) group.id #针对一个part ...

  7. 第2章 深入分析java I/O的工作机制（下）

    2.6 设计模式解析之适配器模式 2.6.1 适配器模式的结构 把一个类的接口变换成一客户端能接受的另一个接口. Target(目标接口): 要转换的期待的接口. Adaptee(源角色):需要适配的 ...

  8. jenkins学习(1)

    (1)  按照JAVA, 增加环境变量JAVA_HOME     =      C:\Program Files\Java\jdk1.8.0_31  增加环境变量CLASS_PATH     =   ...

  9. springboot成神之——spring jdbc的使用

    本文介绍spring jdbc的使用 目录结构 pom配置 properties配置 model层User类 Dao层QueryForListDao config层AppConfiguration 程 ...

  10. Window setInterval() 方法

    Window 对象 转自:https://www.w3cschool.cn/jsref/met-win-setinterval.html 定义和用法 setInterval() 方法可按照指定的周期( ...