5.airflow问题

1.

Traceback (most recent call last):
  File "/usr/bin/airflow", line 28, in <module>
    args.func(args)
  File "/usr/lib/python2.7/site-packages/airflow/bin/cli.py", line 858, in serve_logs
    host='0.0.0.0', port=WORKER_LOG_SERVER_PORT)
  File "/usr/lib64/python2.7/site-packages/flask/app.py", line 843, in run
    run_simple(host, port, self, **options)
  File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 736, in run_simple
    inner()
  File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 696, in inner
    fd=fd)
  File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 590, in make_server
    passthrough_errors, ssl_context, fd=fd)
  File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 501, in __init__
    HTTPServer.__init__(self, (host, int(port)), handler)
  File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__
    self.server_bind()
  File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind
    SocketServer.TCPServer.server_bind(self)
  File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
    self.socket.bind(self.server_address)
  File "/usr/lib64/python2.7/socket.py", line 224, in meth
    return getattr(self._sock,name)(*args)
socket.error: [Errno 98] Address already in use

上面报了WORKER_LOG_SERVER_PORT这个，查下配置文件，是celeryexecutor像master合并日志的端口。

用root执行：

[root@bqdpsit1 ~]# netstat -apn | grep 8793
tcp        0      0 0.0.0.0:8793            0.0.0.0:*               LISTEN      85717/airflow serve
[root@bqdpsit1 ~]#
[root@bqdpsit1 ~]# ps -ef|grep 85717
root      85717      1  0 09:33 ?        00:00:01 /usr/bin/python /usr/bin/airflow serve_logs
root      90578  90367  0 09:58 pts/15   00:00:00 grep --color=auto 85717
[root@bqdpsit1 ~]# kill 85717

可以看到原因是：之前错误的用root执行了airflow worker命令，启动了一个服务，占了这个端口。kill掉后用bqadm启动airflow worker即可。

来自为知笔记(Wiz)