使用pysolr连接到solr云集

Question

我已经配置了一个多核solr云。创建了一个具有两个碎片且没有复制的集合。

​

通过solr 192.168.1.56:8983，我能够获得查询的结果。

我也想对pysolr做同样的操作，所以尝试运行以下命令：

import pysolr
zookeeper = pysolr.ZooKeeper("192.168.1.56:2181,192.168.1.55:2182")
solr = pysolr.SolrCloud(zookeeper, "random_collection")

即使在那里，最后一行也找不到集合。下面是一个错误跟踪：

---------------------------------------------------------------------------
SolrError                                 Traceback (most recent call last)
<ipython-input-43-9f03eca3b645> in <module>()
----> 1 solr = pysolr.SolrCloud(zookeeper, "patent_colllection")

/usr/local/lib/python2.7/dist-packages/pysolr.pyc in __init__(self, zookeeper, collection, decoder, timeout, retry_timeout, *args, **kwargs)
   1176 
   1177     def __init__(self, zookeeper, collection, decoder=None, timeout=60, retry_timeout=0.2, *args, **kwargs):
-> 1178         url = zookeeper.getRandomURL(collection)
   1179 
   1180         super(SolrCloud, self).__init__(url, decoder=decoder, timeout=timeout, *args, **kwargs)

/usr/local/lib/python2.7/dist-packages/pysolr.pyc in getRandomURL(self, collname, only_leader)
   1315 
   1316     def getRandomURL(self, collname, only_leader=False):
-> 1317         hosts = self.getHosts(collname, only_leader=only_leader)
   1318         if not hosts:
   1319             raise SolrError('ZooKeeper returned no active shards!')

/usr/local/lib/python2.7/dist-packages/pysolr.pyc in getHosts(self, collname, only_leader, seen_aliases)
   1281         hosts = []
   1282         if collname not in self.collections:
-> 1283             raise SolrError("Unknown collection: %s", collname)
   1284         collection = self.collections[collname]
   1285         shards = collection[ZooKeeper.SHARDS]

SolrError: (u'Unknown collection: %s', 'random_collection')

Solr版本为6.6.2，动物园管理员版本为3.4.10

如何创建到solr云集合的连接？

Answer 1

Pysolr目前不支持外部动物园管理员集群。Pysolr检查clusterstate.json中的集合，Solr为每个集群临时编写成state.json，clusterstate.json保持为空。

要解决单个集合的问题，可以在ZooKeeper.CLUSTER_STATE中硬编码pysolr.py变量，如下所示：

ZooKeeper.CLUSTER_STATE = '/collections/random_collection/state.json'

pysolr.py可以在/usr/local/lib/python2.7/dist-packages上找到，并且可以尝试用

pip install -e /usr/local/lib/python2.7/dist-packages/pysolr.py

Answer 2

即使对于SolrCloud，常规HTTP客户端也能很好地工作。

这在Solr7.5和PySolr 3.9.0中进行了测试：

import pysolr

solr_url="https://my.solr.url"
collection = "my_collection"
solr_connection = pysolr.Solr("{}/solr/{}".format(solr_url, collection), timeout=10)
results = solr_connection.search(...)

print(results.docs)

Answer 3

更好的方法是以一种通用的方式提供这些集合：

import pysolr
import json

zookeeper = pysolr.ZooKeeper("ZK_STRING")
collections = {}
for c in zookeeper.zk.get_children("collections"):
    collections.update(json.loads(zookeeper.zk.get("collections/{}/state.json".format(c))[0].decode("ascii")))
zookeeper.collections = collections