在python的elasticsearch中批量插入时的连接错误

Question

我已经编写了将json导入elasticsearch的代码，但是当'Connection中止‘、error(104，由对等方重置连接’‘)时，我得到了连接错误

代码是

from pyelasticsearch import ElasticSearch
import sys, json

ES_CLUSTER = 'http://localhost:9200/'
ES_INDEX = 'test'
ES_TYPE = 'doc'
es = ElasticSearch(ES_CLUSTER)

json_docs = []
with open(r'sample_data.json') as open_file:
        data = json.load(open_file)
        for js in data:
                json_docs.append(js)

es.bulk(ES_INDEX, ES_TYPE, json_docs)

错误是

Traceback (most recent call last):
  File "el_ex.py", line 18, in <module>
    es.bulk(ES_INDEX, ES_TYPE, json_docs) 
  File "/home/tradevigil123/.local/lib/python2.7/site-packages/pyelasticsearch/client.py", line 93, in decorate
    return func(*args, query_params=query_params, **kwargs)
  File "/home/tradevigil123/.local/lib/python2.7/site-packages/pyelasticsearch/client.py", line 448, in bulk
    query_params=query_params)
  File "/home/tradevigil123/.local/lib/python2.7/site-packages/pyelasticsearch/client.py", line 281, in send_request
    raise exc.info
urllib3.exceptions.ProtocolError: ('Connection aborted.', error(104, 'Connection reset by peer'))

有人能帮我吗？

Answer 1

此错误消息通常意味着另一方已关闭连接。这不应该发生在Elasticsearch，除了垃圾收集或进程死亡之类的坏问题。你查过Elasticsearch日志了吗？那之后你能连接到Elasticsearch吗？你的批量要求有多大？你试过像10 for这样的批量尺寸吗？