将文件从本地移动到hdfs的Oozie工作流

Question

我已经编写了一个oozie工作流，将文件从本地复制到hdfs。运行作业后不会显示任何错误，但不会将文件放入hdfs

以下是我的代码

nameNode=hdfs://localhost:8020
jobTracker=localhost:8032
queueName=default
oozie.wf.application.path=${nameNode}/crazyoozie
focusNodeLogin=cloudera
shellScriptPath= /home/cloudera/Desktop/script.sh

workflow.xml

<workflow-app name="WorkFlowForSshAction" xmlns="uri:oozie:workflow:0.1">
<start to="sshAction"/>
<action name="sshAction">
    <ssh xmlns="uri:oozie:ssh-action:0.1">
    <host>${focusNodeLogin}</host>
    <command>${shellScriptPath}</command>
        <capture-output/>
    </ssh>
<ok to="end"/>
<error to="killAction"/>
</action>
<kill name="killAction">
    <message>"Killed job due to error"</message>
</kill>
<end name="end"/>
</workflow-app>`

script.sh

hadoop fs -put /home/cloudera/Desktop/oozieinput /oozieresults-sshAction
status=$?
if [ $status = 0 ]; then
    echo "STATUS=SUCCESS"
else
    echo "STATUS=FAIL"
fi

script.sh在本地文件系统中。输出目录oozieresults-sshAction在hdfs上。你能在这方面帮我吗？

Answer 1

    I see that you are using a ssh action and using a shell script which is conflicting. For executing a shell script you need to create a shell action which will be like this :

    <workflow-app name="WorkFlowForShellAction" xmlns="uri:oozie:workflow:0.3">
        <start to='shell' />
        <action name='shell'>
            <shell xmlns="uri:oozie:shell-action:0.1">
                <job-tracker>${jobTracker}</job-tracker>
                <name-node>${nameNode}</name-node>
                <configuration>
                    <property>
                      <name>mapred.job.queue.name</name>
                      <value>${queueName}</value>
                    </property>
                </configuration>
                <exec>${shellScriptPath}</exec>  
                <file>${shellScriptPath}#${shellscript}</file>                                                  
            </shell>
            <ok to="end" />
            <error to="fail" />
        </action>
        <kill name="fail">
            <message>Script failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
        </kill>
        <end name='end' />
    </workflow-app>
===============================================================
JOB.PROPERTIES
===============================================================

nameNode=hdfs://localhost:8020
jobTracker=localhost:8032
queueName=default
oozie.wf.application.path=${nameNode}/crazyoozie
focusNodeLogin=cloudera
shellScriptPath= /path/to/hdfs/script.sh
shellscript= script.sh


In the shellScriptPath give the hdfs path where you place the script