我希望能够直接从TensorFlow使用BlueData的datatap。
使用pyspark,我可以这样做:
df.write.parquet('dtap://OtherDataTap/airline-safety_zero_incidents.parquet')请注意,我不需要设置任何库-它已准备好开箱即用。
通过DataTap从Tensorflow读取/写入数据需要做什么?
发布于 2019-11-07 05:11:13
根据文档:http://docs.bluedata.com/40_datatap-tensorflow-support
import tensorflow as tf
import os
from tensorflow.python.framework.versions import CXX11_ABI_FLAG
CXX11_ABI_FLAG
bdfs_file_system_library = os.path.join("/opt/bluedata","libbdfs_file_system_shared_r1_9.so")
tf.load_file_system_library(bdfs_file_system_library)
with tf.gfile.Open("dtap://TenantStorage/tmp/tensorflow/dtap.txt", 'w') as f:
f.write("This is the dtap test file")
with tf.gfile.Open("dtap://TenantStorage/tmp/tensorflow/dtap.txt", 'r') as f:
content = f.read() https://stackoverflow.com/questions/58738544
复制相似问题