[http://arloz.me/tornado/2014/06/27/uploadvideotornado.html]

[NGINX REFRER:Nginx upload module]

由于tornado通过表达上传的数据最大限制在100M，所以如果需要上传视屏文件的情况在需要通过其他方式实现， 此处采用nginx的nginx-upload-module和jQuery-File-Upload实现。

1.编译安装nginx-upload-module

  • 下载nginx-1.5.8
  • 下载nginx-upload-module2.0
  • 由于nginx-upload-module不支持最新版的nginx，直接编译会出错，需要打补丁 davromaniak.txt
tar xzf nginx-1.5.

tar xzf nginx_upload_module-2.0..tar.gz

cd nginx_upload_moule-2.0.

patch ngx_http_upload_module.c davromaniak.txt

cd ../nginx-1.5.

./configure --add-module=../nginx_upload_moule-2.0.

make & sudo make install

2.配置nginx的upload-module

upstream tornadoserver{

    server 127.0.0.1:;

}

server {

listen       ;

server_name  localhost;

location / {

    proxy_pass_header Server;

    proxy_set_header Host $http_host;

    proxy_redirect off;

    proxy_set_header X-Real-IP $remote_addr;

    proxy_set_header X-Scheme $scheme;

    proxy_pass http://tornadoserver;

}

client_max_body_size 4G;

client_body_buffer_size 1024k;

if ($host !~* ^(localhost) ) {

}

location = /uploads {

    if ($request_method = OPTIONS) {

        add_header Pragma no-cache;

        add_header X-Content-Type-Options nosniff;

        # Access control for CORS

        add_header Access-Control-Allow-Origin "http://localhost";

        add_header Access-Control-Allow-Methods "GET, POST, PUT, DELETE, OPTIONS";

        add_header Access-Control-Allow-Headers "cache-control, content-range, accept,\

            origin, session-id, content-disposition, x-requested-with, ctent-type,\

            content-description, referer, user-agent";

        add_header Access-Control-Allow-Credentials "true";

        #  minute pre-flight approval

        add_header Access-Control-Max-Age ;

        return ;

    }

    if ($request_method = POST) {

        add_header Pragma no-cache;

        add_header X-Content-Type-Options nosniff;

        #add_header Cache-control "no-story, no-cache, must-revalidate";

        # Access control for CORS

        add_header Access-Control-Allow-Origin "http://localhost";

        add_header Access-Control-Allow-Methods "GET, POST, PUT, DELETE, OPTIONS";

        add_header Access-Control-Allow-Headers "cache-control, content-range, accept,\

                origin, session-id, content-disposition, x-requested-with,\

                content-type, content-description, referer, user-agent";

        add_header Access-Control-Allow-Credentials "true";

        #  minute pre-flight approval

        add_header Access-Control-Max-Age ;

        upload_set_form_field $upload_field_name.name "$upload_file_name";

        upload_set_form_field $upload_field_name.content_type "$upload_content_type";

        upload_set_form_field $upload_field_name.path "$upload_tmp_path";

        upload_pass_form_field "^X-Progress-ID$|^authenticity_token$";

        upload_cleanup    -;

    }

    upload_pass @fast_upload_endpoint;

    # {a..z} not usefull when use zsh

    # mkdir {..} {a..z} {A..Z}

    upload_store /tmp/uploads ;

    # set permissions on the uploaded files

    upload_store_access user:rw group:rw all:r;

}

location @fast_upload_endpoint {

    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

    proxy_set_header X-Forwarded-Proto $scheme;

    proxy_set_header Host $http_host;

    proxy_redirect off;

    proxy_pass_header 'Access-Control-Allow-Origin';

    proxy_pass http://tornadoserver;

}

}

3.demo页面

<!DOCTYPE HTML>

<html>

<head> <meta charset="utf-8">

    <title>jQuery File Upload Example</title>

    <style>

    .bar {

        height: 18px;

        background: green;

    }

</style></head>

<body>

    <input id="fileupload" type="file" name="files[]" data-url="uploads" multiple>

    <script src=""></script>

    <script src="/static/js/vendor/jquery.ui.widget.js"></script>

    <script src="/static/js/jquery.iframe-transport.js"></script>

    <script src="/static/js/jquery.fileupload.js"></script>

    <script>

        $(function () {

            $('#fileupload').fileupload({

                dataType: 'json',

                done: function (e, data) {

                    $.each(data.result.files, function (index, file) {

                       $('<p/>').text(file.name+"  "+file.size).appendTo(document.body);

                    });

                },

                progressall: function (e, data) {

                    var progress = parseInt(data.loaded / data.total * 100, 10);

                    $('#progress .bar').css( 'width', progress + '%');

                }

            });

        });

    </script>

    <div id="progress">

        <div class="bar" style="width: 10%;"></div>

    </div>

</body>

</html>

4.tornado处理

当nginx的upload-module完成视频文件的传输之后，其会设置表单数据，并转发给后台tornado服务器处理。

通过如下方式获得相关参数：

name = self.get_argument("files[].name","")

content_type = self.get_argument("files[].content_type","")

oldpath = self.get_argument("files[].path","")

size = os.path.getsize(oldpath)

files = []

files.append({"name":name,"type":content_type,"size":size})

ret = {"files":files}

self.write(tornado.escape.json_encode(ret))

5.其它配置文件参考
user root;

worker_processes 1;

#error_log logs/error.log;

#error_log logs/error.log notice;

#error_log logs/error.log info;

#pid logs/nginx.pid;

events {

worker_connections 1024;

}

http {

include mime.types;

default_type application/octet-stream;

#log_format main '$remote_addr - $remote_user [$time_local] "$request" '

# '$status $body_bytes_sent "$http_referer" '

# '"$http_user_agent" "$http_x_forwarded_for"';

#access_log logs/access.log main;

sendfile on;

#tcp_nopush on;

#keepalive_timeout 0;

keepalive_timeout 65;

#gzip on;

server {

upload_resumable on;

client_max_body_size 100m;

listen 8888;

server_name localhost;

# Upload form should be submitted to this location

location /upload {

# Pass altered request body to this location

upload_pass @test;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Pass altered request body to a backend

location @test {

proxy_pass http://mongrel;

}

}

server{

listen 30091;

root /var/www/sms/public/video;

}

upstream mongrel {

server 127.0.0.1:3001;

server 127.0.0.1:3002;

server 127.0.0.1:3003;

}

server {

upload_resumable on;

client_max_body_size 100m;

listen 3000;

root /var/www/sms/public;

access_log /var/www/sms/log/nginx.access.log;

if (-f $document_root/system/maintenance.html) {

rewrite ^(.*)$ /system/maintenance.html last;

break;

}

#upload video

location /upload_video {

# Pass altered request body to this location

upload_pass @rails;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Upload image

location /upload_image {

# Pass altered request body to this location

upload_pass @rails;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Pass altered request body to a backend

location @rails {

proxy_pass http://mongrel;

}

location / {

proxy_set_header X-Real-IP $remote_addr;

# needed for HTTPS

proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

proxy_set_header Host $http_host;

proxy_redirect off;

proxy_max_temp_file_size 0;

if (-f $request_filename) {

break;

}

if (-f $request_filename/index.html) {

rewrite (.*) $1/index.html break;

}

if (-f $request_filename.html) {

rewrite (.*) $1.html break;

}

if (!-f $request_filename) {

proxy_pass http://mongrel;

break;

}

}

error_page 500 502 503 504 /500.html;

location = /500.html {

root /var/www/sms/public;

}

}

}

　　

 
 

tornado+nginx上传视频文件的更多相关文章

  1. 以springMVC为例获取上传视频文件时长

    毕设项目是一个在线学习系统,教师用户有上传视频的功能,在答辩之前赶了一个demo出来,好多功能都写死了,比如课程学习进度就是被我写死在前端的一个变量,最近导师要我把项目打包发给他,这才心慌慌赶紧把这些 ...

  2. plupload分片上传视频文件源码展示

    plupload分片上传视频文件目录结构如下: |- images//视频上传小图片 |-js// plupload js文件 |-uploads//视频文件存放文件夹 里面是按日期存放 |-ajax ...

  3. java上传视频文件

    需求:项目要支持大文件上传功能,经过讨论,初步将文件上传大小控制在500M内,因此自己需要在项目中进行文件上传部分的调整和配置,自己将大小都以501M来进行限制. 第一步: 前端修改 由于项目使用的是 ...

  4. 利用bootstrap上传视频文件，mvc做后台处理

    @{ Layout = null; } <!DOCTYPE html> <html> <head> <meta name="viewport&quo ...

  5. DJANGO技巧两则：模拟MKDIR -P及配合NGINX上传大文件不使超时

    这都是在开发当哪遇到的问题,网上转转,作个记录: http://blog.chinaunix.net/uid-25525723-id-1596574.html http://bookshadow.co ...

  6. 使用HttpUtils 上传视频文件

    private void shangchuan(){                 //文件的路径        //File file=new File(path);        File fi ...

  7. h5上传视频文件

    从一开始我就掉坑里了,<input type="file" style="display: block;" id="img-upload&quo ...

  8. nginx上传大文件，413错误解决

    在nginx里增加了配置. client_max_body_size 500m; proxy_connect_timeout 600; proxy_read_timeout 600; proxy_se ...

  9. 使用resumable.js上传大文件（视频）兵转换flv格式

    前台代码 <%@ Page Language="C#" AutoEventWireup="true" CodeBehind="Video.asp ...

随机推荐

  1. Linux Samba目录服务搭建与Java客户端访问

    前言: 本文比较简略,只求快速入门,若要了解详情,推荐一篇文章:http://www.cnblogs.com/mchina/archive/2012/12/18/2816717.html 1,安装sa ...

  2. git忽略一些提交上传的文件

    在项目开发的过程中有两种文件是不需要提交的. 1.一些很重要的配置文件 包括服务器地址 账号密码 数据库密码 公私钥等等 2.一些由于开发和沙箱环境和线上环境的差异 不能使用同一个时候 需要同一个文件 ...

  3. Oracle 分区表-Range分区

    原文:http://www.tuicool.com/articles/MzeM7r 一.什么是分区表 Oracle提供了分区技术以支持VLDB(Very Large DataBase).分区表通过对分 ...

  4. day5心得

    import 模块 1.定义: 模块:用来从逻辑上组织python代码(变量.函数.类.逻辑:实现一个功能),本质就是.py结尾的python文件(文件名test.py 模块名:test) 2导入方法 ...

  5. python----python使用mysql

    Python操作MySQL主要使用两种方式: 原生模块 pymsql ORM框架 SQLAchemy pymql pymsql是Python中操作MySQL的模块,在windows中的安装: pip ...

  6. DRF之REST规范介绍及View请求流程分析

    编程是数据结构和算法的结合,而在Web类型的App中,我们对于数据的操作请求是通过url来承载的,本文详细介绍了REST规范和CBV请求流程. 编程是数据结构和算法的结合,小程序如简单的计算器,我们输 ...

  7. 前端自动化之webstrom

    前端自动化之webstrom 在刚接触前端的时候,使用的就一直是webstrom,版本是webstrom 8. 前端自动画使用的时候,因为webstrom 8版本是没有集成gulp的.所以每次使用都默 ...

  8. jenkins 学习记录2

    主题 在之前的学习中(http://www.cnblogs.com/abcwt112/p/6274575.html)我已经学会怎么打包了..这篇文章记录分享我学习如何利用jenkins将打完的包发布到 ...

  9. mac配置git mergetool为p4merge（2013笔记整理）

    既有环境: 1)下载安装p4merge 2)安装git 下面是配置p4merge为git mergetool的步骤 1. /usr/local/bin下创建extMerge文件: $ cat > ...

  10. 使用GDB调试PHP代码，解决PHP代码死循环

    最近在帮同事解决Swoole Server问题时,发现有1个worker进程一直处于R的状态,而且CPU耗时非常高.初步断定是PHP代码中发生死循环. 下面通过一段代码展示如何解决PHP死循环问题. ...