首页
学习
活动
专区
圈层
工具
发布
社区首页 >问答首页 >如何使用glusterfs-hadoop插件?

如何使用glusterfs-hadoop插件?
EN

Stack Overflow用户
提问于 2015-04-14 18:09:06
回答 1查看 433关注 0票数 3

我安装了glusterfs并且工作正常,之后我安装了Hadoop1.x并且可以很好地使用hdfs,但是当我使用glusterfs-hadoop插件来使用glusterfs作为我的hadoop的文件系统后端时,我得到了错误,我使用github站点来安装glusterfs-hadoop插件。并将jar文件复制到hadoop库目录,并将我的core-site.xml更改为:

代码语言:javascript
复制
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>

<property>
<name>fs.glusterfs.impl</name>
<value>org.apache.hadoop.fs.glusterfs.GlusterFileSystem</value>
</property>

<property>
<name>fs.default.name</name>
<value>glusterfs://fedora1:9010</value>
</property>

<property>
<name>fs.AbstractFileSystem.glusterfs.impl</name>
<value>org.apache.hadoop.fs.local.GlusterFs</value>
</property>

<property>
<name>fs.glusterfs.volumes</name>
<value>test1</value>
</property>

<property>
<name>fs.glusterfs.volume.fuse.test1</name>
<value>/mnt/Hadoop</value>
</property>

</configuration>

当执行start-mapred.sh时,jobtracker和tasktracker start会忽略任何问题,但当执行以下命令"hadoop fs -mkdir ossl“时,我会得到以下输出:

代码语言:javascript
复制
15/04/14 12:52:53 INFO glusterfs.GlusterVolume: Initializing gluster volume..
15/04/14 12:52:53 INFO glusterfs.GlusterFileSystem: Configuring GlusterFS
15/04/14 12:52:53 INFO glusterfs.GlusterFileSystem: Initializing GlusterFS,  CRC disabled.
15/04/14 12:52:53 INFO glusterfs.GlusterFileSystem: GIT INFO={git.commit.id.abbrev=f0fee73, git.commit.user.email=bchilds@redhat.com, git.commit.message.full=Merge pull request #122 from childsb/getfattrparse

Refactor and cleanup the BlockLocation parsing code, git.commit.id=f0fee73c336ac19461d5b5bb91a77e05cff73361, git.commit.message.short=Merge pull request #122 from childsb/getfattrparse, git.commit.user.name=bradley childs, git.build.user.name=Unknown, git.commit.id.describe=GA-12-gf0fee73, git.build.user.email=Unknown, git.branch=master, git.commit.time=31.03.2015 @ 00:36:46 IRDT, git.build.time=12.04.2015 @ 14:45:49 IRDT}
15/04/14 12:52:53 INFO glusterfs.GlusterFileSystem: GIT_TAG=GA
15/04/14 12:52:53 INFO glusterfs.GlusterFileSystem: Configuring GlusterFS
15/04/14 12:52:53 INFO glusterfs.GlusterVolume: Initializing gluster volume..
15/04/14 14:36:01 INFO glusterfs.GlusterVolume: Gluster volume: test at : /mnt/hadoop
15/04/14 14:36:01 INFO glusterfs.GlusterVolume: Working directory is : /
15/04/14 14:36:01 INFO glusterfs.GlusterVolume: Write buffer size : 131072
15/04/14 14:36:01 INFO glusterfs.GlusterVolume: Default block size : 67108864
15/04/14 14:36:01 INFO glusterfs.GlusterVolume: Directory list order : fs ordering
15/04/14 14:36:01 INFO glusterfs.GlusterVolume: File timestamp lease significant digits removed : 0
mkdir: Error undefined volume:fedora1:9010 in path: glusterfs://fedora1:9010/ossl

请帮帮我,谢谢你的回复。

EN

回答 1

Stack Overflow用户

发布于 2015-10-30 22:30:41

如果我没记错的话,这应该是可行的:

代码语言:javascript
复制
<property>
  <name>fs.default.name</name>
  <value>glusterfs:///fedora1:9010</value>
</property>
票数 -1
EN
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接:

https://stackoverflow.com/questions/29624607

复制
相关文章

相似问题

领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档