使用hugging_face load_dataset从发出错误的公共声音中加载数据

Question

我正在使用facebook拥抱脸转换器处理语音数据集，但无法从公共语音论坛加载数据。

from datasets import load_dataset, load_metric
common_voice_train = load_dataset("common_voice", "id", split="train+validation")
common_voice_test = load_dataset("common_voice", "id", split="test")

给出了以下误差

  Couldn't find file locally at common_voice/common_voice.py, or remotely at https://raw.githubusercontent.com/huggingface/datasets/1.4.1/datasets/common_voice/common_voice.py.
The file was picked from the master branch on github instead at https://raw.githubusercontent.com/huggingface/datasets/master/datasets/common_voice/common_voice.py.

Answer 1

您正在使用Hugging轻量级数据集库加载公共语音存储库数据集。id参数必须替换为构建器配置参数，例如，如果要从公共语料库加载英语数据集，则构建器配置参数为en。

您可以检查公共语音存储库中的参数。它以提到版本的地方为前缀。