twisted reactor calllater实现

1.      calllater实现代码

测试源码:

from twisted.internet import reactor
from twisted.internet import defer

def func_1():
    print('calllater测试')
    time.sleep(5)
    print('calllater结束')

# error handle
def test_deferred_a():
    #d = test_retrurn_deferred()
   
reactor.callLater(4, func_1)
   
reactor.callLater(15, reactor.stop)
    reactor.run() if __name__ == '__main__':
    test_deferred_a()

1.1.    第一步:调用calllater

reactor.callLater(3, d.callback, 8)

先找到calllater

# <twisted.internet.selectreactor.SelectReactor object at 0x000000CE3BFC72B0>
@implementer(IReactorCore, IReactorTime,
IReactorPluggableResolver,
            
IReactorPluggableNameResolver, _ISupportsExitSignalCapturing)
class ReactorBase(object):
    """
    Default base class for Reactors.
    """
   
def callLater(self,
_seconds, _f, *args, **kw):
        """See
twisted.internet.interfaces.IReactorTime.callLater.
        """
       
assert callable(_f), "%s
is not callable"
% _f
        assert _seconds
>= 0, \
               "%s
is not greater than or equal to 0 seconds"
% (_seconds,)
        tple = DelayedCall(self.seconds()
+ _seconds, _f, args, kw,
                           self._cancelCallLater,
                           self._moveCallLaterSooner,
                           seconds=self.seconds)
        self._newTimedCalls.append(tple)
        return tple

DelayedCall基本上可以把它当作一个中间类,用于保存一些信息。

结果就是向self._newTimedCalls添加一个定时调用

self._newTimedCalls.append(tple)

可以看一下它的具体内容

_newTimedCalls= <class 'list'>:
[<twisted.internet.base.DelayedCall object at 0x000000CE3C2EA668>]

1.2.   
第二步

reactor.run()

跳过一些前置处理内容,直接到mainloop

def mainLoop(self):
    while self._started:
        try:
            while self._started:
                # Advance
simulation time in delayed event
                # processors.
               
self.runUntilCurrent()
                t2 = self.timeout()
                t = self.running and t2
                self.doIteration(t)
        except:
            log.msg("Unexpected
error in main loop."
)
            log.err()
        else:
            log.msg('Main loop
terminated.'
)

进入self.runUntilCurrent()

def runUntilCurrent(self):
    """

        运行所有挂起的calls
    Run all pending timed calls.
    """
   
if self.threadCallQueue:
        # Keep track of how
many calls we actually make, as we're
        # making them, in case another
call is added to the queue
        # while we're in this loop.
        
count = 0
        total = len(self.threadCallQueue)
        for (f, a,
kw) in self.threadCallQueue:
            try:
                f(*a, **kw)
            except:
                log.err()
            count += 1
            if count ==
total:
                break
        del
self.threadCallQueue[:count]
        if self.threadCallQueue:
            self.wakeUp()

# insert new delayed
calls now
   
self._insertNewDelayedCalls()

now = self.seconds()
while self._pendingTimedCalls and (self._pendingTimedCalls[0].time
<= now):
    call = heappop(self._pendingTimedCalls)
    if call.cancelled:
        self._cancellations-=1
        continue

if call.delayed_time
> 0:
        call.activate_delay()
        heappush(self._pendingTimedCalls,
call)
        continue

try:
        call.called = 1
        call.func(*call.args,
**call.kw)
    except:
        log.deferr()
        if hasattr(call, "creator"):
            e = "\n"
           
e += " C:
previous exception occurred in "
+ \
                 "a DelayedCall
created here:
\n"
           
e += "
C:"
           
e += "".join(call.creator).rstrip().replace("\n","\n C:")
            e += "\n"
           
log.msg(e)

if (self._cancellations > 50 and
    
self._cancellations
> len(self._pendingTimedCalls) >> 1):
    self._cancellations
= 0
    self._pendingTimedCalls
= [x for x in self._pendingTimedCalls
                               if not x.cancelled]
    heapify(self._pendingTimedCalls)

if self._justStopped:
    self._justStopped
= False
   
self.fireSystemEvent("shutdown")

进入self._insertNewDelayedCalls()

def _insertNewDelayedCalls(self):
    for call in self._newTimedCalls:
        if call.cancelled:
            self._cancellations-=1
        else:
            call.activate_delay()
            heappush(self._pendingTimedCalls,
call)
    self._newTimedCalls
= []

从self._newTimedCalls中获取DelayedCall()实例,放入self._pendingTimedCalls

在runUntilCurrent中会调用self._pendingTimedCallsk列表相关对象,也就是执行func_1.

2.     
其它

2.1.   
代码解析1

heappush(self._pendingTimedCalls,
call)

函数heappush源自heapq.py

def heappush(heap, item):
    """Push
item onto heap, maintaining the heap invariant."""
   
heap.append(item)
    _siftdown(heap, 0, len(heap)-1)

简单点说,它会构建一个有序堆,默认最小堆。

在构建有序堆过程中肯定是要比较int类型了,但call是一个类。

这里要回顾python类的特殊方法了,已有文档,不赘述。

call是DelayedCall类的实例,查看相关代码。

def __le__(self, other):
    """
    Implement C{<=} operator between
two L{DelayedCall} instances.

Comparison is based on the C{time}
attribute (unadjusted by the
    delayed time).
    """
   
return self.time
<= other.time

def __lt__(self, other):
    """
    Implement C{<} operator between
two L{DelayedCall} instances.

Comparison is based on the C{time}
attribute (unadjusted by the
    delayed time).
    """
   
return self.time
< other.time

twisted reactor calllater实现的更多相关文章

  1. (三)认识twisted reactor

    一.reactor是单线程模型,简单粗暴,也就是说网络IO和我们的业务逻辑一般是在一个线程里,其中网络IO通过event loop的方式去异步执行,效率也很高.看下官网的这幅图,比较清晰 twiste ...

  2. twisted reactor分析

    调用reactor.run(),就会调用到mainloop函数,从而调用到select或epoll,监控fd的读写. posixbase.py: def listenTCP(self, port, f ...

  3. twisted reactor 实现源码解析

    twisted reactor 实现源码解析 1.      reactor源码解析 1.1.    案例分析代码: from twisted.internet import protocol fro ...

  4. twisted reactor执行流程

    #reactorbase的主循环 def mainLoop(self): while self._started: try: while self._started: # Advance simula ...

  5. Python Twisted、Reactor

    catalogue . Twisted理论基础 . 异步编程模式与Reactor . Twisted网络编程 . reactor进程管理编程 . Twisted并发连接 1. Twisted理论基础 ...

  6. 理解twisted中的reactor和deferred(二)

    Deferred可以添加多个回调函数,每个回调函数的结果作为下一个回调函数的参数 代码实例(可在pycharm中运行,摘自 https://twistedmatrix.com/documents/cu ...

  7. 理解twisted中的reactor和deferred(一)

    Deferred是一个延迟加载对象,这个概念类似于tornado future,是调用异步操作返回的一个对象,其中包括了操作成功后的回调处理,错误后的回调处理. 简单讲,当我们需要执行一个耗时操作,比 ...

  8. 笔记-twisted源码-import reactor解析

    笔记-twisted源码-import reactor解析 1.      twisted源码解析-1 twisted reactor实现原理: 第一步: from twisted.internet ...

  9. Python中reactor,factory,protocol

    最为简单的情况下,除了了解清reactor的简单使用,你还要了解Protocol和Factory.它们最终都会由reactor的侦听建立和run来统一调度起来. 建立服务器的第一个要解决的问题就是服务 ...

随机推荐

  1. 题解【BZOJ4145】「AMPPZ2014」The Prices

    题目描述 你要购买 \(m\) 种物品各一件,一共有 \(n\) 家商店,你到第 \(i\) 家商店的路费为 \(d[i]\),在第 \(i\) 家商店购买第 \(j\) 种物品的费用为 \(c[i] ...

  2. 问题 B: 奇怪的电梯

    问题 B: 奇怪的电梯 时间限制: 1 Sec  内存限制: 128 MB[命题人:admin] 题目描述 大楼的每一层楼都可以停电梯,而且第i层楼(1<=i<=N)上有一个数字Ki(0& ...

  3. 转载:DRC

    https://cn.mathworks.com/help/audio/ug/dynamic-range-control.html?requestedDomain=cn.mathworks.com h ...

  4. C#中如何将字符串或者字符串数组写入文本文件

    using System; using System.Collections.Generic; using System.Linq; using System.Text; using System.T ...

  5. IntelliJ IDEA 2017.3尚硅谷-----滚轮修改字体大小

  6. KMP字符串匹配算法详解

    KMP算法利用匹配失败后的信息,尽量减少模式串与主串的匹配次数以达到快速匹配的目的.具体实现就是实现一个next()函数,函数本身包含了模式串的局部匹配信息.时间复杂度O(m+n). Next()函数 ...

  7. 搭建 Kubernetes 高可用集群

    使用 3 台阿里云服务器(k8s-master0, k8s-master1, k8s-master2)作为 master 节点搭建高可用集群,负载均衡用的是阿里云 SLB ,需要注意的是由于阿里云负载 ...

  8. Bugku-CTF之多次

    Day33   多次 http://123.206.87.240:9004 本题有2个flag flag均为小写 flag格式 flag{}  

  9. cookie、session以及中间件

    cookie cookie是保存客户端浏览器上的键值对,是服务端设置在客户端浏览器上的键值对,也就意味着浏览器其实可以拒绝服务端的'命令',默认情况下浏览器都是直接让服务端设置键值对 设置cookie ...

  10. Nuxt 环境搭建已经编写第一个Nuxt应用

    在学习Nuxt 之前 首先我们要有node ,然后因为Nuxt 是一个基于 Vue.js 的轻量级应用框架,所以在开发之前需要安装(后面纯属作者猜想并且猜想就是这个原因...) npm install ...