twisted reactor calllater实现
twisted reactor calllater实现
1. calllater实现代码
测试源码:
from twisted.internet import reactor
from twisted.internet import defer
def func_1():
print('calllater测试')
time.sleep(5)
print('calllater结束')
# error handle
def test_deferred_a():
#d = test_retrurn_deferred()
reactor.callLater(4, func_1)
reactor.callLater(15, reactor.stop)
reactor.run() if __name__ == '__main__':
test_deferred_a()
1.1. 第一步:调用calllater
reactor.callLater(3, d.callback, 8)
先找到calllater
# <twisted.internet.selectreactor.SelectReactor object at 0x000000CE3BFC72B0>
@implementer(IReactorCore, IReactorTime,
IReactorPluggableResolver,
IReactorPluggableNameResolver, _ISupportsExitSignalCapturing)
class ReactorBase(object):
"""
Default base class for Reactors.
"""
def callLater(self,
_seconds, _f, *args, **kw):
"""See
twisted.internet.interfaces.IReactorTime.callLater.
"""
assert callable(_f), "%s
is not callable" % _f
assert _seconds
>= 0, \
"%s
is not greater than or equal to 0 seconds" % (_seconds,)
tple = DelayedCall(self.seconds()
+ _seconds, _f, args, kw,
self._cancelCallLater,
self._moveCallLaterSooner,
seconds=self.seconds)
self._newTimedCalls.append(tple)
return tple
DelayedCall基本上可以把它当作一个中间类,用于保存一些信息。
结果就是向self._newTimedCalls添加一个定时调用
self._newTimedCalls.append(tple)
可以看一下它的具体内容
_newTimedCalls= <class 'list'>:
[<twisted.internet.base.DelayedCall object at 0x000000CE3C2EA668>]
1.2.
第二步
reactor.run()
跳过一些前置处理内容,直接到mainloop
def mainLoop(self):
while self._started:
try:
while self._started:
# Advance
simulation time in delayed event
# processors.
self.runUntilCurrent()
t2 = self.timeout()
t = self.running and t2
self.doIteration(t)
except:
log.msg("Unexpected
error in main loop.")
log.err()
else:
log.msg('Main loop
terminated.')
进入self.runUntilCurrent()
def runUntilCurrent(self):
"""
运行所有挂起的calls
Run all pending timed calls.
"""
if self.threadCallQueue:
# Keep track of how
many calls we actually make, as we're
# making them, in case another
call is added to the queue
# while we're in this loop.
count = 0
total = len(self.threadCallQueue)
for (f, a,
kw) in self.threadCallQueue:
try:
f(*a, **kw)
except:
log.err()
count += 1
if count ==
total:
break
del self.threadCallQueue[:count]
if self.threadCallQueue:
self.wakeUp()
# insert new delayed
calls now
self._insertNewDelayedCalls()
now = self.seconds()
while self._pendingTimedCalls and (self._pendingTimedCalls[0].time
<= now):
call = heappop(self._pendingTimedCalls)
if call.cancelled:
self._cancellations-=1
continue
if call.delayed_time
> 0:
call.activate_delay()
heappush(self._pendingTimedCalls,
call)
continue
try:
call.called = 1
call.func(*call.args,
**call.kw)
except:
log.deferr()
if hasattr(call, "creator"):
e = "\n"
e += " C:
previous exception occurred in " + \
"a DelayedCall
created here:\n"
e += "
C:"
e += "".join(call.creator).rstrip().replace("\n","\n C:")
e += "\n"
log.msg(e)
if (self._cancellations > 50 and
self._cancellations
> len(self._pendingTimedCalls) >> 1):
self._cancellations
= 0
self._pendingTimedCalls
= [x for x in self._pendingTimedCalls
if not x.cancelled]
heapify(self._pendingTimedCalls)
if self._justStopped:
self._justStopped
= False
self.fireSystemEvent("shutdown")
进入self._insertNewDelayedCalls()
def _insertNewDelayedCalls(self):
for call in self._newTimedCalls:
if call.cancelled:
self._cancellations-=1
else:
call.activate_delay()
heappush(self._pendingTimedCalls,
call)
self._newTimedCalls
= []
从self._newTimedCalls中获取DelayedCall()实例,放入self._pendingTimedCalls
在runUntilCurrent中会调用self._pendingTimedCallsk列表相关对象,也就是执行func_1.
2.
其它
2.1.
代码解析1
heappush(self._pendingTimedCalls,
call)
函数heappush源自heapq.py
def heappush(heap, item):
"""Push
item onto heap, maintaining the heap invariant."""
heap.append(item)
_siftdown(heap, 0, len(heap)-1)
简单点说,它会构建一个有序堆,默认最小堆。
在构建有序堆过程中肯定是要比较int类型了,但call是一个类。
这里要回顾python类的特殊方法了,已有文档,不赘述。
call是DelayedCall类的实例,查看相关代码。
def __le__(self, other):
"""
Implement C{<=} operator between
two L{DelayedCall} instances.
Comparison is based on the C{time}
attribute (unadjusted by the
delayed time).
"""
return self.time
<= other.time
def __lt__(self, other):
"""
Implement C{<} operator between
two L{DelayedCall} instances.
Comparison is based on the C{time}
attribute (unadjusted by the
delayed time).
"""
return self.time
< other.time
twisted reactor calllater实现的更多相关文章
- (三)认识twisted reactor
一.reactor是单线程模型,简单粗暴,也就是说网络IO和我们的业务逻辑一般是在一个线程里,其中网络IO通过event loop的方式去异步执行,效率也很高.看下官网的这幅图,比较清晰 twiste ...
- twisted reactor分析
调用reactor.run(),就会调用到mainloop函数,从而调用到select或epoll,监控fd的读写. posixbase.py: def listenTCP(self, port, f ...
- twisted reactor 实现源码解析
twisted reactor 实现源码解析 1. reactor源码解析 1.1. 案例分析代码: from twisted.internet import protocol fro ...
- twisted reactor执行流程
#reactorbase的主循环 def mainLoop(self): while self._started: try: while self._started: # Advance simula ...
- Python Twisted、Reactor
catalogue . Twisted理论基础 . 异步编程模式与Reactor . Twisted网络编程 . reactor进程管理编程 . Twisted并发连接 1. Twisted理论基础 ...
- 理解twisted中的reactor和deferred(二)
Deferred可以添加多个回调函数,每个回调函数的结果作为下一个回调函数的参数 代码实例(可在pycharm中运行,摘自 https://twistedmatrix.com/documents/cu ...
- 理解twisted中的reactor和deferred(一)
Deferred是一个延迟加载对象,这个概念类似于tornado future,是调用异步操作返回的一个对象,其中包括了操作成功后的回调处理,错误后的回调处理. 简单讲,当我们需要执行一个耗时操作,比 ...
- 笔记-twisted源码-import reactor解析
笔记-twisted源码-import reactor解析 1. twisted源码解析-1 twisted reactor实现原理: 第一步: from twisted.internet ...
- Python中reactor,factory,protocol
最为简单的情况下,除了了解清reactor的简单使用,你还要了解Protocol和Factory.它们最终都会由reactor的侦听建立和run来统一调度起来. 建立服务器的第一个要解决的问题就是服务 ...
随机推荐
- HttpRunner接口自动化框架的使用
简介: HttpRunner 是一款面向 HTTP(S) 协议的通用测试框架,只需编写维护一份 YAML/JSON 脚本,即可实现自动化测试.性能测试.线上监控.持续集成等多种测试需求. HttpRu ...
- Flink架构(五)- 检查点,保存点,与状态恢复
检查点,保存点,与状态恢复 Flink是一个分布式数据处理系统,这种场景下,它需要处理各种异常,例如进程终止.机器故障.网络中断等.因为tasks在本地维护它们的state,Flink必须确保在出现故 ...
- 如何在Go中获得 "A1","B2" 类似字符+数字的字符串
package main import ( "fmt" ) func main() { // 字符串 str := "ABCDEFGHIJKLMNOPQRSTUVWXYZ ...
- testng的prioriy
todo: 同一个class中的priority: 1.不标priority的case和标注priority的case,谁先谁后? 2.标注相同priority的case,谁先谁后?是不是并发? 3. ...
- ansible playbook详解
ansible playbook是由yml语法书写,结构清晰,可读性强,所以必须掌握yml基础语法 语法 描述 缩进 YAML使用固定的缩进风格表示层级结构,每个缩进由两个空格组成,不能使用tabs键 ...
- Pycharm调试django项目时发现断点失效
解决方法: 第一步: 第二步: 点击 Edit Configuration 第三步 : 点击 + 选择python 填写相关参数信息 或者 点击ok 完成配置 重启 IDE 注意 重启IDE ...
- python 递归调用 返回值问题
当使用递归时并有返回值时,调用自身函数时需要加上return语句如下: def daxiao(biao1,biao2): #判断两个列表的大小,根据里面的元素大小 #如果biao1大于 ...
- 如何预测股票分析--自动ARIMA
在上一篇中,我们发现knn和线性回归一样,表现的不是特别好,来看看时间序列的表现 时间序列预测法其实是一种回归预测方法,属于定量预测,其基本原理是;一方面承认事物发展的延续性,运用过去时间序列的数据进 ...
- centos6.5下安装mysql数据库
centos6.5下安装mysql数据库 1.安装mysql数据库:yum install mysql-server 2.临时启动数据库:service mysqld start 3.开机启动数据库: ...
- 矩阵快速幂+概率DP poj 3744
题意:在一条不满地雷的路上,你现在的起点在1处.在N个点处布有地雷,1<=N<=10.地雷点的坐标范围:[1,100000000]. 每次前进p的概率前进一步,1-p的概率前进1-p步.问 ...