GCS桶的文件夹中有一些CSV文件。我使用这些代码作为熊猫数据访问和读取那些CSV文件:
from google.cloud import storage
import gcsfs
import fsspec
storage_client = storage.Client()
blobs = storage_client.list_blobs('pipe_ml-data', prefix='postive_data_file/')
all_files = list(blobs)
all_files = all_files[1::]
for blob in all_files:
file_path = "gs://pipe_ml-data/{}".format(blob.name)
content = pd.read_csv(file_path)
content.head()
break但是得到以下错误:
---------------------------------------------------------------------------
ImportError Traceback (most recent call last)
/var/folders/9q/h73jxwsx0f1629kdwpdfmdb80000gn/T/ipykernel_31809/388262887.py in <module>
1 from google.cloud import storage
----> 2 import gcsfs
3 import fsspec
4 storage_client = storage.Client()
5
/opt/anaconda3/lib/python3.9/site-packages/gcsfs/__init__.py in <module>
3 __version__ = get_versions()["version"]
4 del get_versions
----> 5 from .core import GCSFileSystem
6 from .mapping import GCSMap
7
/opt/anaconda3/lib/python3.9/site-packages/gcsfs/core.py in <module>
18 from fsspec.utils import stringify_path, setup_logging
19 from fsspec.callbacks import NoOpCallback
---> 20 from fsspec.implementations.http import get_client
21 from .retry import retry_request, validate_response
22 from .checkers import get_consistency_checker
/opt/anaconda3/lib/python3.9/site-packages/fsspec/implementations/http.py in <module>
16 from fsspec.exceptions import FSTimeoutError
17 from fsspec.spec import AbstractBufferedFile
---> 18 from fsspec.utils import DEFAULT_BLOCK_SIZE, isfilelike, nullcontext, tokenize
19
20 from ..caching import AllBytes
ImportError: cannot import name 'isfilelike' from 'fsspec.utils' (/opt/anaconda3/lib/python3.9/site-packages/fsspec/utils.py)我已经安装和导入了gcsfs以及fsspec库。什么都帮不上忙。你能给我一个解决办法吗?
发布于 2022-06-17 18:22:04
fsspec.utils.isfilelike看起来是很新的,就像在最近几个月(4月22日),所以我想您可能遇到了某种版本问题(比如您正在导入fsspec 2022.3.0或更高版本,而不是2022.5.0或更高版本)。
使用像pip show fsspec这样的命令来查看是否安装了2022.5.0或更高版本。
https://stackoverflow.com/questions/72658817
复制相似问题