Oozie java操作

Question

hadoop jar \
/usr/lib/solr/contrib/mr/search-mr-1.0.0-cdh5.4.2-job.jar \
org.apache.solr.hadoop.MapReduceIndexerTool -D \
'mapreduce.map.java.opts=-Xmx500m' --morphline-file \
/home/cloudera/Desktop/response_morphline.conf --output-dir \
hdfs://quickstart.cloudera:8020/user/cloudera/index \
--go-live \
--zk-host 127.0.0.1:2181/solr \
--collection RES \
hdfs://quickstart.cloudera:8020/user/hive/warehouse/esb_response \
--mappers 1 --reducers 1;

我的workflow.xml:：

<workflow-app name="ESB_response" xmlns="uri:oozie:workflow:0.5">
    <start to="java-a6ca"/>
    <kill name="Kill">
        <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <action name="java-a6ca">
        <java>
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <configuration>
                <property>
                    <name></name>
                    <value></value>
                </property>
            </configuration>
            <main-class>org.apache.solr.hadoop.MapReduceIndexerTool</main-class>
            <java-opts>[{u&#39;value&#39;: u&#39;-Dmapreduce.map.java.opts=-Xmx500m&#39;}]</java-opts>
            <arg>--morphline-file /user/hue/oozie/workspaces/hue-oozie-1446554691.71/response_morphline.conf</arg>
            <arg>--output-dir hdfs://quickstart.cloudera:8020/user/cloudera/index</arg>
            <arg>--go-live</arg>
            <arg>--zk-host 127.0.0.1:2181/solr</arg>
            <arg>--collection RES</arg>
            <arg>--mappers 1</arg>
            <arg>--reducers 1</arg>
            <file>#</file>
            <archive>#</archive>
        </java>
        <ok to="End"/>
        <error to="Kill"/>
    </action>
    <end name="End"/>
</workflow-app>

嗨，我需要通过oozie安排这个作业吗？有人能帮上忙吗？我已经通过拖放功能创建了这个工作流，它抛出了一个错误:：org.apache.oozie.action.ActionExecutorException: hue..but : Can IllegalArgumentException at a empty string at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:445) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1008) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1162)在org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)在org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)在org.apache.oozie.command.XCommand.call(XCommand.java:286)在org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:321)在org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:250)在org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745)

Answer 1

尝试从workflow.xml中删除<file>#</file>和<archive>#</archive>

Answer 2

如果您在oozie工作流中使用和标记，那么我建议给出您想要包含在oozie工作流中的文件的完整路径。

因为这里Oozie正在寻找你所引用的文件，但是它没有得到。

因此，要么在tagg中传递文件路径，要么删除该路径，如果您不想在oozie作业中添加任何文件。

问候