我对node和lambda非常陌生,所以我可能犯了一些愚蠢的错误。我创建了一个node.js aws函数,它从s3事件中获取一个文件。如果文件是gzip,则解压缩,将其上载到sftp服务器,然后创建一个sig文件并将其上载到相同的sftp服务器。当一切顺利时,它会正常工作,但它似乎不能正确地触发错误。
然后使用sftp命令进行链接,因此我预计任何错误都会导致后续的错误失败。例如,如果关闭sftp服务器,sftp客户端将生成超时错误,但是lambda从未看到回调错误,只有成功。日志确实显示了到控制台的错误输出,但在.then()项的其余部分之后,它似乎使用了成功回调。这种联系是否被正确地记录为承诺?
样本日志:
...
Starting SFTP
Connected to sftp, starting sftp put for lastsub2.dat file.
{ Error: Timed out while waiting for handshake
at Timeout._onTimeout (/var/task/node_modules/ssh2/lib/client.js:687:19)
at ontimeout (timers.js:386:14)
at tryOnTimeout (timers.js:250:5)
at Timer.listOnTimeout (timers.js:214:5) level: 'client-timeout' } 'Error occured during sftp relay.'
END示例代码:
console.log('Loading function');
const aws = require('aws-sdk');
const s3 = new aws.S3({
apiVersion: '2006-03-01'
});
const zlib = require('zlib');
const fs = require("fs");
const connSettings = {
host: 'xxx',
port: '22',
username: 'xxx',
password: 'xxx'
};
exports.handler = function (event, context, callback) {
console.log('Received event:', JSON.stringify(event, null, 2));
console.log('Bucket Name: ' + event.Records[0].s3.bucket.name);
console.log('Object Key: ' + decodeURIComponent(event.Records[0].s3.object.key.replace(/\+/g, ' ')));
const bucket = event.Records[0].s3.bucket.name;
const key = decodeURIComponent(event.Records[0].s3.object.key.replace(/\+/g, ' '));
const params = {
Bucket: bucket,
Key: key,
};
s3.getObject(params, (err, data) => {
if (err) {
console.log(err);
const message = 'Error getting object ${key} from bucket ${bucket}. Make sure they exist and your bucket is in the same region as this function.';
console.log(message);
callback(message);
} else {
if (data.ContentType == 'application/x-gzip') {
console.log('CONTENT TYPE is application/x-gzip');
var dataStream = s3.getObject(params).createReadStream().pipe(zlib.Unzip());
console.log('Created unzip datastream');
console.log('Starting SFTP');
let Client = require('ssh2-sftp-client');
let sftp = new Client();
sftp.connect(connSettings)
.then(console.log('Connected to sftp, starting sftp put for ' + key.replace('.gz', '.dat') + ' file.'))
.then(() => {
console.log('Finished sftp put for ' + key.replace('.gz', '.dat') + ' file.');
return sftp.put(dataStream, key.replace('.gz', '.dat'), true, 'utf-8');
}).then(() => {
var sigFileName = key.replace('.gz', '.sig');
var sigStream = fs.createWriteStream('/tmp/' + sigFileName);
sigStream.end();
console.log('Created ' + sigFileName + ' sig file.');
var readStream = fs.createReadStream('/tmp/' + sigFileName);
console.log('Uploaded ' + sigFileName + ' sig file.');
return sftp.put(readStream, sigFileName, true, 'utf-8');
}).then(() => {
console.log('Ended sftp connection.');
return sftp.end();
})
.then(callback(null, 'Success'))
.catch ((err) => {
console.log(err, 'Error occured during sftp relay.');
callback('Error', err);
});
} else {
callback(null, 'Uploaded file not in gzip format, will not be processed.');
}
}
});
};发布于 2017-12-08 20:26:14
您所遇到的问题正在发生,因为您没有从then()中返回任何内容。结果是,每个then()都会立即执行,而无需等待任何异步sftp函数返回,因为它会立即解析为未定义的。
您没有提到您使用的是什么sftp库,但是假设它返回一个承诺,您应该能够简单地从then()返回这些承诺。
例如:
.then(() => {
console.log('Finished sftp put for ' + key.replace('.gz', '.dat') + ' file.');
// assumes stfp.put returns a promise, just return it into the chain
return sftp.put(dataStream, key.replace('.gz', '.dat'), true, 'utf-8');
})基于注释的编辑:
您应该能够从the ()s调用回调。查看编辑中的日志输出,当出现错误时,这不是您所期望的吗?它跳到了捕获点。您将获得控制台输出,“连接到sftp…”因为你当时这么称呼我。而不是:
.then(console.log('Connected to sftp, starting sftp put for ' + key.replace('.gz', '.dat') + ' file.'))可能应该是:
.then(() => console.log('Connected to sftp, starting sftp put for ' + key.replace('.gz', '.dat') + ' file.'))按照您的方式,控制台将在错误从sftp返回之前进行记录。
https://stackoverflow.com/questions/47721476
复制相似问题