如何在google中使用GPU来训练空间关系提取模型，[E002]找不到用于语言英语(en)的“转换器”工厂

Question

我在google上运行关系提取空间模型，当我使用!spacy project run all或!spacy project run train_cpu时，它可以工作，但是当我运行!spacy project run train_gpu时，它会返回以下错误：

================================= train_gpu =================================
Running command: /usr/bin/python3 -m spacy train configs/rel_trf.cfg --output training --paths.train data/train.spacy --paths.dev data/dev.spacy -c ./scripts/custom_functions.py --gpu-id 0
ℹ Saving to output directory: training
ℹ Using GPU: 0

=========================== Initializing pipeline ===========================
Traceback (most recent call last):
  File "/usr/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.7/dist-packages/spacy/__main__.py", line 4, in <module>
    setup_cli()
  File "/usr/local/lib/python3.7/dist-packages/spacy/cli/_util.py", line 71, in setup_cli
    command(prog_name=COMMAND)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/typer/main.py", line 497, in wrapper
    return callback(**use_params)  # type: ignore
  File "/usr/local/lib/python3.7/dist-packages/spacy/cli/train.py", line 45, in train_cli
    train(config_path, output_path, use_gpu=use_gpu, overrides=overrides)
  File "/usr/local/lib/python3.7/dist-packages/spacy/cli/train.py", line 72, in train
    nlp = init_nlp(config, use_gpu=use_gpu)
  File "/usr/local/lib/python3.7/dist-packages/spacy/training/initialize.py", line 41, in init_nlp
    nlp = load_model_from_config(raw_config, auto_fill=True)
  File "/usr/local/lib/python3.7/dist-packages/spacy/util.py", line 531, in load_model_from_config
    validate=validate,
  File "/usr/local/lib/python3.7/dist-packages/spacy/language.py", line 1784, in from_config
    raw_config=raw_config,
  File "/usr/local/lib/python3.7/dist-packages/spacy/language.py", line 794, in add_pipe
    validate=validate,
  File "/usr/local/lib/python3.7/dist-packages/spacy/language.py", line 652, in create_pipe
    raise ValueError(err)
ValueError: [E002] Can't find factory for 'transformer' for language English (en). This usually happens when spaCy calls `nlp.create_pipe` with a custom component name that's not registered on the current language class. If you're using a Transformer, make sure to install 'spacy-transformers'. If you're using a custom component, make sure you've added the decorator `@Language.component` (for function components) or `@Language.factory` (for class components).

Available factories: attribute_ruler, tok2vec, merge_noun_chunks, merge_entities, merge_subtokens, token_splitter, doc_cleaner, parser, beam_parser, entity_linker, ner, beam_ner, entity_ruler, lemmatizer, tagger, morphologizer, senter, sentencizer, textcat, spancat, textcat_multilabel, relation_extractor, en.lemmatizer

如果GPU没有正确调用，我使用了以下两种安装(可互换)：!pip安装-U spacycuda101 #!pip安装-U spacy-每晚--预

Answer 1

您还没有安装spacy-transformers。最简单的方法可能是spacy download en_core_web_trf。

我建议您再次检查安装快速启动 --我不认为spacy-nightly是在大约一年前发布的v3发布后更新的。还要检查讨论常见问题 --我们已经有一段时间没有听说过它了，但是不久前，为了在Colab上获得GPU支持，您必须明确地不安装cupy (也就是说，不使用pip install spacy[cuda101])。