笔记本中lda2vec模块中的缺失属性

Question

jupyter笔记本无法从dirichlet_likelihood.py中导入lda2vec。

这个py文件存在于当前lda2vec的github中。

我安装了模块，打开了工作簿，然后尝试运行它。我怀疑我的问题有一个很简单的原因。

笔记本是newsgroups/lda2vec/lda2vec.ipynb

当我在python命令行(在当前环境中)尝试下面的内容时，它不会给出下面的错误，而是需要我安装的keras。在命令行上，它说它不能导入预处理。

uname -a
Linux ubuntu 4.18.0-15-generic #16~18.04.1-Ubuntu SMP Thu Feb 7 14:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
sudo apt-get install python3-venv
python3.6 -m venv .env  
source .env/bin/activate
pip install --upgrade pip
pip install jupyter
pip install lda2vec

from lda2vec import preprocess, Corpus

---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-4-2b87256bea6b> in <module>
----> 1 from lda2vec import preprocess, Corpus
      2 import matplotlib.pyplot as plt
      3 import numpy as np
      4 get_ipython().run_line_magic('matplotlib', 'inline')
      5 

~/.env/lib/python3.6/site-packages/lda2vec/__init__.py in <module>
----> 1 import lda2vec.dirichlet_likelihood as dirichlet_likelihood
      2 import lda2vec.embedding_mixture as embedding_mixture
      3 from lda2vec.Lda2vec import Lda2vec as model
      4 import lda2vec.word_embedding as word_embedding
      5 import lda2vec.nlppipe as nlppipe

AttributeError: module 'lda2vec' has no attribute 'dirichlet_likelihood'

python
from lda2vec import preprocess, Corpus

Using TensorFlow backend.
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: cannot import name 'preprocess'

编辑

我做了这些事情--让ubuntu-18.04.2-桌面-amd64.iso-将BIOS虚拟化设置更改为hyper在VMWare中创建一个VM -将内存增加到3G -给它40G的磁盘。

然后在终点站

sudo apt install python2.7
sudo apt install python-pip
pip install virtualenv
Mkdir 2.7env
Cd 2.7env
python2.7 -m venv .env
python2.7 -m virtualenv .env
source .env/bin/activate
pip install --upgrade pip
pip install jupyter
pip install -U spacy
python -m spacy download en
pip install wheel nltk gensim pyLDAvis lda2vec
sudo apt install git
git clone https://github.com/cemoody/lda2vec.git
cp ~/lda2vec/build/lib.linux-x86_64-2.7/lda2vec/corpus.py ~/2.7env/.env/lib/python2.7/site-packages/lda2vec/Corpus.py
cp ~/lda2vec/build/lib.linux-x86_64-2.7/lda2vec/preprocess.py ~/2.7env/.env/lib/python2.7/site-packages/lda2vec/preprocess.py
python -m pip install ipykernel
python -m ipykernel install --user
python lda2vec/examples/twenty_newsgroups/lda2vec/lda2vec_run.py
cd lda2vec/examples/twenty_newsgroups/lda2vec/
jupyter notebook
change the kernel to 2

在firefox lda2vec.ipynb中

如前所述，我现在正试图让它重新创建twenty_newsgroups npz文件，以便最终提供我自己的内容。如果有人对此有更好的理解，我怀疑尝试在内存很少的VM上运行这个脚本可能是问题所在，但错误报告为

(.env) craig@ubuntu:~/whcjimmy/lda2vec/examples/twenty_newsgroups/data$ python preprocess.py 
Traceback (most recent call last):
  File "preprocess.py", line 31, in <module>
    n_threads=4)
  File "/home/craig/whcjimmy/.env/lib/python3.6/site-packages/lda2vec-0.1-py3.6.egg/lda2vec/preprocess.py", line 104, in tokenize
    vocab = {v: nlp.vocab[v].lower_ for v in uniques if v != skip}
  File "/home/craig/whcjimmy/.env/lib/python3.6/site-packages/lda2vec-0.1-py3.6.egg/lda2vec/preprocess.py", line 104, in <dictcomp>
    vocab = {v: nlp.vocab[v].lower_ for v in uniques if v != skip}
  File "vocab.pyx", line 242, in spacy.vocab.Vocab.__getitem__
  File "lexeme.pyx", line 44, in spacy.lexeme.Lexeme.__init__
  File "vocab.pyx", line 157, in spacy.vocab.Vocab.get_by_orth
  File "strings.pyx", line 138, in spacy.strings.StringStore.__getitem__
KeyError: "[E018] Can't retrieve string for hash '9243420536193520'. This usually refers to an issue with the `Vocab` or `StringStore`."

Answer 1

好吧，我来处理。问题是

1. 选择正确的python来运行一个4岁的git项目。Python 2.7。
2. 检查已安装模块是否有来自git的代码。
3. 在python终端中运行这个问题
4. 复制和编辑python文件到3

上面的一个问题是对依赖项进行修改的API。ImportError: No module named 'spacy.en'最初的问题可能是因为我不熟悉的git或python。尽管如此，git项目的自我测试都失败了，其构建也失败了。但我有我的jupyter笔记本运行和生产令人信服的输出。