AttributeError:模块“”transformers.modeling_bert“”没有特性“”gelu“”

Question

import pandas as pd
from ast import literal_eval

from cdqa.utils.filters import filter_paragraphs
from cdqa.utils.download import download_model, download_bnpp_data
from cdqa.pipeline.cdqa_sklearn import QAPipeline

# Download data and models
download_bnpp_data(dir='./data/bnpp_newsroom_v1.1/')
download_model(model='bert-squad_1.1', dir='./models')

# Loading data and filtering / preprocessing the documents
df = pd.read_csv('data/bnpp_newsroom_v1.1/bnpp_newsroom-v1.1.csv', converters={'paragraphs': literal_eval})
df = filter_paragraphs(df)

# Loading QAPipeline with CPU version of BERT Reader pretrained on SQuAD 1.1
cdqa_pipeline = QAPipeline(reader='C:/models/bert_qa.joblib')

# Fitting the retriever to the list of documents in the dataframe
cdqa_pipeline.fit_retriever(X=df)

我试图加载模型，但cdqa_pipeline = QAPipeline(reader='C:/models/bert_qa.joblib')行抛出一个错误，提示AttributeError:模块'transformers.modeling_bert‘没有'gelu’属性

我使用的是transformers版本3.5

Answer 1

我最终使用了一个不同的版本。问题是我对这个版本有一个要求，所以我也改变了我程序的其他部分。