WSO2BAM中介统计数据库(配置单元不在数据库中创建表)

Question

大家好，我正在配置WSO2ESB 4.8.1和WSO2BAM 2.4.0以查看统计数据，我正在将数据从ESB发送到BAM，这些数据存储在Cassandra中，但问题是当我通过BAM Toolbox部署Mediation_Statistics_Monitoring时，我在控制台中看到以下错误：

[2014-02-07 13:45:21,638] ERROR {org.apache.hadoop.hive.ql.exec.Task} -  /var/www/formascloud/apps/wso2bam-2.4.0/repository/logs//wso2carbon.log
[2014-02-07 13:45:21,638] ERROR {org.apache.hadoop.hive.ql.exec.ExecDriver} -  Execution failed with exit status: 2
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
[2014-02-07 13:45:21,639] ERROR {org.apache.hadoop.hive.ql.Driver} -  FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
[2014-02-07 13:45:21,640] ERROR {org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl} -  Error while executing Hive script.
Query returned non-zero code: 9, cause: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
java.sql.SQLException: Query returned non-zero code: 9, cause: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
        at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:189)
        at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.executeHiveQuery(HiveExecutorServiceImpl.java:569)
        at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:282)
        at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl$ScriptCallable.call(HiveExecutorServiceImpl.java:189)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)
[2014-02-07 13:45:21,641] ERROR {org.wso2.carbon.analytics.hive.task.HiveScriptExecutorTask} -  Error while executing script : esb_stats_296
org.wso2.carbon.analytics.hive.exception.HiveExecutionException: Error while executing Hive script.Query returned non-zero code: 9, cause: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
        at org.wso2.carbon.analytics.hive.impl.HiveExecutorServiceImpl.execute(HiveExecutorServiceImpl.java:115)
        at org.wso2.carbon.analytics.hive.task.HiveScriptExecutorTask.execute(HiveScriptExecutorTask.java:60)
        at org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter.execute(TaskQuartzJobAdapter.java:67)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)

[2014-02-07 13:45:21,443] ERROR {org.wso2.carbon.hadoop.hive.jdbc.storage.db.DBOperation} -  Failed to get total row count
org.postgresql.util.PSQLException: ERROR: relation "mediation_stats_summary_per_minute" does not exist
  Position: 38
        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2103)
        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1836)
        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:512)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:388)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:273)
        at org.wso2.carbon.hadoop.hive.jdbc.storage.db.DBOperation.getTotalCount(DBOperation.java:335)
        at org.wso2.carbon.hadoop.hive.jdbc.storage.input.JDBCSplit.getSplits(JDBCSplit.java:113)
        at org.wso2.carbon.hadoop.hive.jdbc.storage.input.JDBCDataInputFormat.getSplits(JDBCDataInputFormat.java:41)
        at org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:302)
        at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:292)
        at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:933)
        at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:925)
        at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:839)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:792)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1123)
        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:792)
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:766)
        at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:460)
        at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:733)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
java.lang.NullPointerException
        at org.wso2.carbon.hadoop.hive.jdbc.storage.db.DBOperation.getTotalCount(DBOperation.java:344)
        at org.wso2.carbon.hadoop.hive.jdbc.storage.input.JDBCSplit.getSplits(JDBCSplit.java:113)
        at org.wso2.carbon.hadoop.hive.jdbc.storage.input.JDBCDataInputFormat.getSplits(JDBCDataInputFormat.java:41)
        at org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:302)
        at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:292)
        at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:933)
        at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:925)
        at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:839)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:792)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1123)
        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:792)
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:766)
        at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:460)
        at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:733)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

如您所见，我使用的是Postgresql，我创建了一个名为BAM_STATS_DB的数据库，下面是存储在master-datasources.xml中的配置：

<datasource>
    <name>WSO2BAM_DATASOURCE</name>
    <description>The datasource used for analyzer data</description>
    <definition type="RDBMS">
        <configuration>                             <url>jdbc:postgresql://localhost:5432/BAM_STATS_DB</url>
                    <username>gregadmin</username>
                    <password>gregadmin</password>
                    <driverClassName>org.postgresql.Driver</driverClassName>
                                <maxActive>80</maxActive>
                            <maxWait>60000</maxWait>
                                <minIdle>5</minIdle>
                                <testOnBorrow>true</testOnBorrow>
                                <validationQuery>select version();</validationQuery>
                             <validationInterval>30000</validationInterval>
                </configuration>
            </definition>
        </datasource>

我做错了什么？我遵循WSOBAM文档中的配置。

Answer 1

看起来BAM工具箱不支持PostgreSQL数据库。

BAM Toolbox具有以下构件

1. Stream definitions
2. Analytics
3. Dashboard components

分析具有配置单元脚本以及那些依赖于用于WSO2BAM_DATASOURCE的底层数据库的脚本

如果您查看wso2bam-2.4.0/samples/toolboxes，您将看到根据数据库的不同有多个工具箱。

例如，Mediation Statistics Monitoring工具箱有3个不同的tbox文件。

1. Mediation_Statistics_Monitoring_MSSQL.tbox
2. Mediation_Statistics_Monitoring_Oracle.tbox
3. Mediation_Statistics_Monitoring.tbox

如果通过管理控制台UI安装工具箱，则将安装默认工具箱。在本例中为Mediation_Statistics_Monitoring.tbox。

此默认工具箱适用于少数数据库，没有任何问题。例如MySQL。

您只需编辑分析脚本即可使用PostgreSQL数据库。

您可以解压缩工具箱(Mediation_Statistics_Monitoring.tbox)并编辑/Mediation_Statistics_Monitoring/analytics/esb_stats

修复JDBCStorageHandler使用的所有“CREATE TABLE”SQL。

然后再次创建tbox归档并复制到wso2bam-2.4.0/repository/deployment/server/bam-toolbox

请确保先取消部署已有的工具箱。

我希望这能帮到你。