我试图使用以前工作过的代码将数据从BigQuery导出到GCS:
logger.log("Exporting BigQuery data for date:" + dayString + "<br/>");
JobConfigurationExtract extractConfig = new JobConfigurationExtract();
extractConfig.setDestinationFormat("NEWLINE_DELIMITED_JSON");
String applicationId = ServerUtils.getApplicationId();
String dataFile = "gs://"+applicationId+"_analytics/" + accountName + "-" + dayString + "-*.json";
extractConfig.setDestinationUri(dataFile);
String tableName = dayString.replaceAll("-","_");
TableReference bigQuerytableToExtractFrom = new TableReference().setProjectId(BigQueryUtils.PROJECT_NUMBER).setDatasetId(getDatasetName(accountName)).setTableId(tableName);
extractConfig.setSourceTable(bigQuerytableToExtractFrom);
JobConfiguration config = new JobConfiguration().setExtract(extractConfig);
Job job = new Job().setConfiguration(config);
Job queuedJob = BigqueryUtils.getClient().jobs().insert(BigQueryUtils.PROJECT_NUMBER, job).execute();
String jobIdString = queuedJob.getJobReference().getJobId();
jobIdString = jobIdString.substring(jobIdString.indexOf(':')+1);
return jobIdString;然而,今天作业信息总是返回:
{"errorResult":{"message":"Unexpected. Please try again.","reason":"internalError"},"errors":[{"message":"Unexpected. Please try again.","reason":"internalError"}],"state":"DONE"}BigQuery今天有问题吗?如果是的话,预计什么时候会有ETA呢?
根据奔腾10的建议,下面是几个失败的工作ids: job_nGY3gTVibV07Y38PWJRIQ79SxaE,job_lJJBUibG_W42Lrl8Bwux0_RD_yw,
发布于 2014-04-01 23:30:12
啊..。问题是您要导出的表是通过流导入写入的。这目前无法工作,因为我们的导出管道不知道如何读取流缓冲区。我申请了一个窃听器。
作为解决办法,如果您复制表(通过bq cp,通过web ),它应该生成一个可导出的表,尽管可能缺少最后几分钟的数据。如果您想要该表的最新版本,可以使用select *和目标表运行allowLargeResults查询,然后导出该查询。
https://stackoverflow.com/questions/22796035
复制相似问题