tornado+nginx上传视频文件

[http://arloz.me/tornado/2014/06/27/uploadvideotornado.html]

由于tornado通过表达上传的数据最大限制在100M，所以如果需要上传视屏文件的情况在需要通过其他方式实现，此处采用nginx的nginx-upload-module和jQuery-File-Upload实现。

1.编译安装nginx-upload-module

下载nginx-1.5.8
下载nginx-upload-module2.0
由于nginx-upload-module不支持最新版的nginx，直接编译会出错，需要打补丁 davromaniak.txt

tar xzf nginx-1.5.

tar xzf nginx_upload_module-2.0..tar.gz

cd nginx_upload_moule-2.0.

patch ngx_http_upload_module.c davromaniak.txt

cd ../nginx-1.5.

./configure --add-module=../nginx_upload_moule-2.0.

make & sudo make install

2.配置nginx的upload-module

upstream tornadoserver{

    server 127.0.0.1:;

}

server {

listen       ;

server_name  localhost;

location / {

    proxy_pass_header Server;

    proxy_set_header Host $http_host;

    proxy_redirect off;

    proxy_set_header X-Real-IP $remote_addr;

    proxy_set_header X-Scheme $scheme;

    proxy_pass http://tornadoserver;

}

client_max_body_size 4G;

client_body_buffer_size 1024k;

if ($host !~* ^(localhost) ) {

}

location = /uploads {

    if ($request_method = OPTIONS) {

        add_header Pragma no-cache;

        add_header X-Content-Type-Options nosniff;

        # Access control for CORS

        add_header Access-Control-Allow-Origin "http://localhost";

        add_header Access-Control-Allow-Methods "GET, POST, PUT, DELETE, OPTIONS";

        add_header Access-Control-Allow-Headers "cache-control, content-range, accept,\

            origin, session-id, content-disposition, x-requested-with, ctent-type,\

            content-description, referer, user-agent";

        add_header Access-Control-Allow-Credentials "true";

        #  minute pre-flight approval

        add_header Access-Control-Max-Age ;

        return ;

    }

    if ($request_method = POST) {

        add_header Pragma no-cache;

        add_header X-Content-Type-Options nosniff;

        #add_header Cache-control "no-story, no-cache, must-revalidate";

        # Access control for CORS

        add_header Access-Control-Allow-Origin "http://localhost";

        add_header Access-Control-Allow-Methods "GET, POST, PUT, DELETE, OPTIONS";

        add_header Access-Control-Allow-Headers "cache-control, content-range, accept,\

                origin, session-id, content-disposition, x-requested-with,\

                content-type, content-description, referer, user-agent";

        add_header Access-Control-Allow-Credentials "true";

        #  minute pre-flight approval

        add_header Access-Control-Max-Age ;

        upload_set_form_field $upload_field_name.name "$upload_file_name";

        upload_set_form_field $upload_field_name.content_type "$upload_content_type";

        upload_set_form_field $upload_field_name.path "$upload_tmp_path";

        upload_pass_form_field "^X-Progress-ID$|^authenticity_token$";

        upload_cleanup    -;

    }

    upload_pass @fast_upload_endpoint;

    # {a..z} not usefull when use zsh

    # mkdir {..} {a..z} {A..Z}

    upload_store /tmp/uploads ;

    # set permissions on the uploaded files

    upload_store_access user:rw group:rw all:r;

}

location @fast_upload_endpoint {

    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

    proxy_set_header X-Forwarded-Proto $scheme;

    proxy_set_header Host $http_host;

    proxy_redirect off;

    proxy_pass_header 'Access-Control-Allow-Origin';

    proxy_pass http://tornadoserver;

}

}

3.demo页面

<!DOCTYPE HTML>

<html>

<head> <meta charset="utf-8">

    <title>jQuery File Upload Example</title>

    <style>

    .bar {

        height: 18px;

        background: green;

    }

</style></head>

<body>

    <input id="fileupload" type="file" name="files[]" data-url="uploads" multiple>

    <script src=""></script>

    <script src="/static/js/vendor/jquery.ui.widget.js"></script>

    <script src="/static/js/jquery.iframe-transport.js"></script>

    <script src="/static/js/jquery.fileupload.js"></script>

    <script>

        $(function () {

            $('#fileupload').fileupload({

                dataType: 'json',

                done: function (e, data) {

                    $.each(data.result.files, function (index, file) {

                       $('<p/>').text(file.name+"  "+file.size).appendTo(document.body);

                    });

                },

                progressall: function (e, data) {

                    var progress = parseInt(data.loaded / data.total * 100, 10);

                    $('#progress .bar').css( 'width', progress + '%');

                }

            });

        });

    </script>

    <div id="progress">

        <div class="bar" style="width: 10%;"></div>

    </div>

</body>

</html>

4.tornado处理

当nginx的upload-module完成视频文件的传输之后，其会设置表单数据，并转发给后台tornado服务器处理。

通过如下方式获得相关参数：

name = self.get_argument("files[].name","")

content_type = self.get_argument("files[].content_type","")

oldpath = self.get_argument("files[].path","")

size = os.path.getsize(oldpath)

files = []

files.append({"name":name,"type":content_type,"size":size})

ret = {"files":files}

self.write(tornado.escape.json_encode(ret))


5.其它配置文件参考

user root;

worker_processes 1;

#error_log logs/error.log;

#error_log logs/error.log notice;

#error_log logs/error.log info;

#pid logs/nginx.pid;

events {

worker_connections 1024;

}

http {

include mime.types;

default_type application/octet-stream;

#log_format main '$remote_addr - $remote_user [$time_local] "$request" '

# '$status $body_bytes_sent "$http_referer" '

# '"$http_user_agent" "$http_x_forwarded_for"';

#access_log logs/access.log main;

sendfile on;

#tcp_nopush on;

#keepalive_timeout 0;

keepalive_timeout 65;

#gzip on;

server {

upload_resumable on;

client_max_body_size 100m;

listen 8888;

server_name localhost;

# Upload form should be submitted to this location

location /upload {

# Pass altered request body to this location

upload_pass @test;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Pass altered request body to a backend

location @test {

proxy_pass http://mongrel;

}

}

server{

listen 30091;

root /var/www/sms/public/video;

}

upstream mongrel {

server 127.0.0.1:3001;

server 127.0.0.1:3002;

server 127.0.0.1:3003;

}

server {

upload_resumable on;

client_max_body_size 100m;

listen 3000;

root /var/www/sms/public;

access_log /var/www/sms/log/nginx.access.log;

if (-f $document_root/system/maintenance.html) {

rewrite ^(.*)$ /system/maintenance.html last;

break;

}

#upload video

location /upload_video {

# Pass altered request body to this location

upload_pass @rails;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Upload image

location /upload_image {

# Pass altered request body to this location

upload_pass @rails;

upload_store /tmp 1;

upload_store_access user:r;

upload_set_form_field $upload_field_name[name] "$upload_file_name";

upload_set_form_field $upload_field_name[content_type] "$upload_content_type";

upload_set_form_field $upload_field_name[path] "$upload_tmp_path";

upload_aggregate_form_field "$upload_field_name[md5]" "$upload_file_md5";

upload_aggregate_form_field "$upload_field_name[size]" "$upload_file_size";

upload_pass_form_field "^submit$|^description$";

upload_cleanup 400 404 499 500-505;

}

# Pass altered request body to a backend

location @rails {

proxy_pass http://mongrel;

}

location / {

proxy_set_header X-Real-IP $remote_addr;

# needed for HTTPS

proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

proxy_set_header Host $http_host;

proxy_redirect off;

proxy_max_temp_file_size 0;

if (-f $request_filename) {

break;

}

if (-f $request_filename/index.html) {

rewrite (.*) $1/index.html break;

}

if (-f $request_filename.html) {

rewrite (.*) $1.html break;

}

if (!-f $request_filename) {

proxy_pass http://mongrel;

break;

}

}

error_page 500 502 503 504 /500.html;

location = /500.html {

root /var/www/sms/public;

}

}

}

tornado+nginx上传视频文件的更多相关文章

以springMVC为例获取上传视频文件时长
毕设项目是一个在线学习系统,教师用户有上传视频的功能,在答辩之前赶了一个demo出来,好多功能都写死了,比如课程学习进度就是被我写死在前端的一个变量,最近导师要我把项目打包发给他,这才心慌慌赶紧把这些 ...
plupload分片上传视频文件源码展示
plupload分片上传视频文件目录结构如下: |- images//视频上传小图片 |-js// plupload js文件 |-uploads//视频文件存放文件夹里面是按日期存放 |-ajax ...
java上传视频文件
需求:项目要支持大文件上传功能,经过讨论,初步将文件上传大小控制在500M内,因此自己需要在项目中进行文件上传部分的调整和配置,自己将大小都以501M来进行限制. 第一步: 前端修改由于项目使用的是 ...
利用bootstrap上传视频文件，mvc做后台处理
@{ Layout = null; } <!DOCTYPE html> <html> <head> <meta name="viewport&quo ...
DJANGO技巧两则：模拟MKDIR -P及配合NGINX上传大文件不使超时
这都是在开发当哪遇到的问题,网上转转,作个记录: http://blog.chinaunix.net/uid-25525723-id-1596574.html http://bookshadow.co ...
使用HttpUtils 上传视频文件
private void shangchuan(){ //文件的路径 //File file=new File(path); File fi ...
h5上传视频文件
从一开始我就掉坑里了,<input type="file" style="display: block;" id="img-upload&quo ...
nginx上传大文件，413错误解决
在nginx里增加了配置. client_max_body_size 500m; proxy_connect_timeout 600; proxy_read_timeout 600; proxy_se ...
使用resumable.js上传大文件（视频）兵转换flv格式
前台代码 <%@ Page Language="C#" AutoEventWireup="true" CodeBehind="Video.asp ...

随机推荐

yum 报错
Loaded plugins: fastestmirror, prestoLoading mirror speeds from cached hostfileCould not retrieve mi ...
分布式锁之二：zookeeper分布式锁2
示例: package com.util; import org.slf4j.Logger; import org.slf4j.LoggerFactory; import org.apache.zoo ...
codeforce 980B - Marlin(构造）
Marlin time limit per test 1 second memory limit per test 256 megabytes input standard input output ...
如果axios请求失败，如何获取后端接口返回的状态码及错误信息
这两天在工作中遇到一个问题,一个请求返回400错误,我需要向用户展示后端返回的错误信息,但是用普通的catch方法只能获取到浏览器返回的400错误提示,不能获取到后端返回的,后经查阅得出下面方法: a ...
python开发mysql:表关系&单表简单查询
一一对多,多对一 1.1 建立多对一 ,一对多的关系需要注意先建立被关联的表,被关联的字段必须保证时唯一的在创建关联的表,关联的字段一定是可以重复的 1.2 示例: 出版社多对一,多个老师可能 ...
python开发socket套接字：套接字&通信循环&链接循环&模拟远程命令
一,套接字先从服务器端说起.服务器端先初始化Socket,然后与端口绑定(bind),对端口进行监听(listen),调用accept阻塞,等待客户端连接.在这时如果有个客户端初始化一个Socket ...
Python多线程-队列
队列就是存东西取东西,多用于多线程中按照顺序对传入的数据按规定的顺序输出 # -*- coding:utf-8 -*- __author__ = "MuT6 Sch01aR" ...
Windows修改MySQL用户root密码
MySQL是一个关系型数据库管理系统,在 WEB 应用方面 MySQL 是最好的 RDBMS (Relational Database Management System,关系数据库管理系统) 应用软 ...
Centos安装php高版本
安装 1.检查当前是否有安装php rpm -qa|grep php 如果有安装PHP,那么请先删除这些安装包: yum remove php* 2.安装php源 Centos 5 安装php源: ...
delphi 四舍五入
trunc取整四舍五入 formatfloat('0.00', 2.1850) 看第二位,然后对后面的数字处理,偶数的话舍去,奇数四舍五入 System.Math.RoundTo(tempval,- ...