如何通过python multiProcess分解套接字对象？它会引发EOFError

Question

我试图用简单的代码测试multiProcess Procee类。

但是，当我将socket对象作为进程中的参数传递时，它会引发EOFError。

下面是简单代码和例外情况。

import multiprocessing
import socket

class Multi(multiprocessing.Process):

    def __init__(self, s):
        multiprocessing.Process.__init__(self)
        self.s = s

    def run(self):
        for i in range(100):
            print "aaaa"


if __name__ in "__main__":
    s = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
    p = Multi(s)
    p.start()
    p.join()

。

Traceback (most recent call last):
  File "C:\Users\sangmin\workspace\multiProcessTest\multiProcessTest.py", line 24, in <module>
    p.start()
  File "C:\Python27\lib\multiprocessing\process.py", line 130, in start
    self._popen = Popen(self)
  File "C:\Python27\lib\multiprocessing\forking.py", line 277, in __init__
    dump(process_obj, to_child, HIGHEST_PROTOCOL)
  File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump
    ForkingPickler(file, protocol).dump(obj)
  File "C:\Python27\lib\pickle.py", line 224, in dump
    self.save(obj)
  File "C:\Python27\lib\pickle.py", line 331, in save
    self.save_reduce(obj=obj, *rv)
  File "C:\Python27\lib\pickle.py", line 419, in save_reduce
    save(state)
  File "C:\Python27\lib\pickle.py", line 286, in save
    f(self, obj) # Call unbound method with explicit self
  File "C:\Python27\lib\pickle.py", line 649, in save_dict
    self._batch_setitems(obj.iteritems())
  File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems
    save(v)
  File "C:\Python27\lib\pickle.py", line 331, in save
    self.save_reduce(obj=obj, *rv)
  File "C:\Python27\lib\pickle.py", line 419, in save_reduce
    save(state)
  File "C:\Python27\lib\pickle.py", line 286, in save
    f(self, obj) # Call unbound method with explicit self
  File "C:\Python27\lib\pickle.py", line 548, in save_tuple
    save(element)
  File "C:\Python27\lib\pickle.py", line 286, in save
    f(self, obj) # Call unbound method with explicit self
  File "C:\Python27\lib\pickle.py", line 649, in save_dict
    self._batch_setitems(obj.iteritems())
  File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems
    save(v)
  File "C:\Python27\lib\pickle.py", line 286, in save
    f(self, obj) # Call unbound method with explicit self
  File "C:\Python27\lib\pickle.py", line 748, in save_global
    (obj, module, name))
pickle.PicklingError: Can't pickle <built-in method recvfrom_into of _socket.socket object at 0x020C94A0>: it's not found as __main__.recvfrom_into
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Python27\lib\multiprocessing\forking.py", line 381, in main
    self = load(from_parent)
  File "C:\Python27\lib\pickle.py", line 1378, in load
    return Unpickler(file).load()
  File "C:\Python27\lib\pickle.py", line 858, in load
    dispatch[key](self)
  File "C:\Python27\lib\pickle.py", line 880, in load_eof
    raise EOFError
EOFError

Answer 1

在Windows中，multiprocessing使用泡菜在进程之间传输对象。套接字对象不能被腌制，因此您看到的问题。

您的代码确实在Linux中工作，这是因为multiprocessing在该平台上使用了fork。分叉进程的子进程继承父进程的文件句柄，其中一个是套接字。

还不清楚你想达到什么目的。您可以将主机名和端口信息传递到子进程，并让它创建自己的套接字。

您还应该能够让它使用threading而不是multiprocessing。