Celery+redis实现异步

Celery+redis实现异步

目录

• Celery+redis实现异步
  • 安装redis
  • 安装celery-with-redis
  • 添加celery相关配置
  • 创建异步运行任务tasks.py
  • 启动

安装redis

sudo apt-get install redis-server

安装celery-with-redis

进入虚拟环境

source bin/active

pip 安装

pip install celery-with-redis

这一步会安装几个包 具体每个有什么用我也不知道 反正好用就行

添加celery相关配置

在项目配置目录下(即 settings.py 所在目录)添加 celery.py 文件

#!/usr/bin/env python
# -*- coding: utf-8 -*-

from __future__ import absolute_import
import os
from celery import Celery
from django.conf import settings

# set the default Django settings module for the program.
os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'project_name.settings')
app = Celery('project_name')  # 这里project_name填写项目名称, 注意不是app名称

# Using a string here means the worker will not have to
# pickle the object when using Windows.
app.config_from_object('django.conf:settings')
app.autodiscover_tasks(lambda: settings.INSTALLED_APPS)

@app.task(bind=True)
def debug_task(self):
    print('Request: {0!r}'.format(self.request))

这样还不够, 还需要让python能够启动celery, 所以修改项目配置目录下(即 settings.py 所在目录)的 __init__.py 文件, 在其中添加

from .celery import app as celery_app

同时, 还需在 settings.py 中添加

BROKER_URL = 'redis://localhost:6379'
CELERY_RESULT_BACKEND = 'redis://localhost:6379'
CELERY_ACCEPT_CONTENT = ['application/json']  # 这个地方可以按照需求增加或改动
CELERY_TASK_SERIALIZER = 'json'
CELERY_RESULT_SERIALIZER = 'json'
CELERY_TIMEZONE = TIME_ZONE  # 使用settings.py中的时区

因为redis默认开的端口是6379, 没有更改配置的话就是这样配置

创建异步运行任务tasks.py

在app目录下创建tasks.py如下

#!/usr/bin/env python
# -*- coding: utf-8 -*-
from __future__ import absolute_import, unicode_literals
import time
from celery import Celery
from django.core.mail import send_mail, EmailMultiAlternatives, BadHeaderError
from .models import common_member, common_member_email_send_time

celery = Celery('tasks', broker='redis://localhost:6379/0')

@celery.task
def add(x, y):
    return x + y

@celery.task
def run_test_suit(ts_id):
    print("++++++++++++++++++++++++++++++++++++")
    print('jobs[ts_id=%s] running....' % ts_id)
    time.sleep(10.0)
    print('jobs[ts_id=%s] done' % ts_id)
    result = True
    return result

# @celery.task
# def send_email_1(msg):
#     msg.send()

这个地方我又按照廖雪峰的教程重新配置了celery, 可能有重复配置, 但是能用.

在 views.py 中添加相关视图

from django.http import HttpResponse
from .tasks import run_test_suit

def tasks(request):
    print('before run_test_suit')
    result = run_test_suit.delay('110')
    print('after run_test_suit')
    return HttpResponse("job is runing background~")

注意用了delay方法, 这个方法是放在装饰器里面的.

添加urls.py

略

启动

• 启动redis

  redis-server

• 启动celery

  celery -A project_name worker -l info

  启动celery后, 在终端可以看到celery的log信息, 对于debug很有帮助

• 启动django

  python manage.py runserver