redis-py提升AttributeError

Question

在什么情况下，redis-py会引发以下AttributeError异常？

redis-py不是被设计成只引发基于redis.exceptions.RedisError的异常吗？

什么是合理的处理逻辑？

Traceback (most recent call last):
  File "c:\Python27\Lib\threading.py", line 551, in __bootstrap_inner
    self.run()
  File "c:\Python27\Lib\threading.py", line 504, in run
    self.__target(*self.__args, **self.__kwargs)
  File C:\Users\Administrator\Documents\my_proj\my_module.py", line 33, in inner
    ret = protected_func(*args, **kwargs)
  File C:\Users\Administrator\Documents\my_proj\my_module.py", line 104, in _listen
    for message in _pubsub.listen():
  File "C:\Users\Administrator\virtual_environments\my_env\lib\site-packages\redis\client.py", line 1555, in listen
    r = self.parse_response()
  File "C:\Users\Administrator\virtual_environments\my_env\lib\site-packages\redis\client.py", line 1499, in parse_response
    response = self.connection.read_response()
  File "C:\Users\Administrator\virtual_environments\my_env\lib\site-packages\redis\connection.py", line 306, in read_response
    response = self._parser.read_response()
  File "C:\Users\Administrator\virtual_environments\my_env\lib\site-packages\redis\connection.py", line 104, in read_response
    response = self.read()
  File "C:\Users\Administrator\virtual_environments\my_env\lib\site-packages\redis\connection.py", line 89, in read
    return self._fp.readline()[:-2]
AttributeError: 'NoneType' object has no attribute 'readline'

Answer 1

这似乎是一个老问题，但我最近也遇到了同样的问题。我的设置是使用芹菜和redis作为代理。ThreadPoolExecutor使用共享的芹菜对象将任务批处理给工作进程。batcher函数使用celery.result.ResultSet等待提交的任务完成。

经过快速调查，我发现芹菜在某处使用pub/sub机制来等待任务完成。就是这样，根据官方的自述https://github.com/andymccurdy/redis-py#thread-safety，发布/订阅在线程安全方面做得并不好

老实说，我并没有试图证明我的理论，而是通过切换到ProcessPoolExecutor来解决我的问题。