Nextflow:未找到输出，尽管设置了publishDir

Question

我有以下nextflow脚本：

echo true                                                                       
                                                                                
wd = "$params.wd"                                                               
geoid = "$params.geoid"                                                         
                                                                                
                                                                                
process step1 {                                                                 
                                                                                
 publishDir = "$wd/data/"                                                       
                                                                                
 input:                                                                         
  val celFiles from "$wd/data/$geoid"                                           
                                                                                
 output:                                                                        
  file "${geoid}_datFiles.RData" into channel                                   
                                                                                
 """                                                                            
 Rscript $wd/scripts/step1.R $celFiles $wd/data/${geoid}_datFiles.RData         
                                                                                
 """                                                                            
                                                                                
}                                                                               

Rscript包含以下命令：

step1=function(WD,
               celFiles,
               output) {
 
  library(affy)

  datFiles=ReadAffy(celfile.path=paste0(WD,"/",celFiles))
  
  save(datFiles,file=output)

}

args=commandArgs(trailingOnly=TRUE)
WD=args[1]
celFiles=args[2]
output=args[3]

step1(WD,celFiles,output)

当它运行时，输出文件保存在我想要的目录中($wd/data/${geoid}_datFiles.RData)。如果geoid指向相同的目录，我希望输出(定义为“${ publishDir }_datFiles.RData”)在publishDir目录下可用。

但是，我得到以下错误：

  Missing output file(s) `GSE4290_datFiles.RData` expected by process `step1`

日志文件表明nextflow仍在工作流创建的目录中查找输出：

Process `step1` is unable to find [UnixPath]: `/Users/rebeccaeliscu/Desktop/workflow/affymetrix/nextflow/work/92/42afb131a36eb32ed780bd1bf3bc3b/GSE4290_datFiles.RData`

完整的日志文件：

Nov-12 17:55:39.611 [main] DEBUG nextflow.cli.Launcher - $> nextflow run main.nf
Nov-12 17:55:39.945 [main] INFO  nextflow.cli.CmdRun - N E X T F L O W  ~  version 20.07.1
Nov-12 17:55:39.968 [main] INFO  nextflow.cli.CmdRun - Launching `main.nf` [infallible_brahmagupta] - revision: d68e496ea0
Nov-12 17:55:40.026 [main] DEBUG nextflow.config.ConfigBuilder - Found config local: /Users/rebeccaeliscu/Desktop/workflow/affymetrix/nextflow/nextflow.config
Nov-12 17:55:40.029 [main] DEBUG nextflow.config.ConfigBuilder - Parsing config file: /Users/rebeccaeliscu/Desktop/workflow/affymetrix/nextflow/nextflow.config
Nov-12 17:55:40.140 [main] DEBUG nextflow.config.ConfigBuilder - Applying config profile: `standard`
Nov-12 17:55:41.288 [main] DEBUG nextflow.Session - Session uuid: 94f22a74-2a63-4a87-9fb3-33cf925a5a74
Nov-12 17:55:41.288 [main] DEBUG nextflow.Session - Run name: infallible_brahmagupta
Nov-12 17:55:41.289 [main] DEBUG nextflow.Session - Executor pool size: 4
Nov-12 17:55:41.326 [main] DEBUG nextflow.cli.CmdRun -
  Version: 20.07.1 build 5412
  Created: 24-07-2020 15:18 UTC (08:18 PDT)
  System: Mac OS X 10.15.7
  Runtime: Groovy 2.5.11 on Java HotSpot(TM) 64-Bit Server VM 1.8.0_111-b14
  Encoding: UTF-8 (UTF-8)
  Process: 46458@Rebeccas-MacBook-Pro-6.local.ucsf.edu [10.49.41.197]
  CPUs: 4 - Mem: 8 GB (708.4 MB) - Swap: 2 GB (927 MB)
Nov-12 17:55:41.353 [main] DEBUG nextflow.Session - Work-dir: /Users/rebeccaeliscu/Desktop/workflow/affymetrix/nextflow/work [Mac OS X]
Nov-12 17:55:41.354 [main] DEBUG nextflow.Session - Script base path does not exist or is not a directory: /Users/rebeccaeliscu/Desktop/workflow/affymetrix/nextflow/bin
Nov-12 17:55:41.594 [main] DEBUG nextflow.Session - Observer factory: TowerFactory
Nov-12 17:55:41.598 [main] DEBUG nextflow.Session - Observer factory: DefaultObserverFactory
Nov-12 17:55:41.911 [main] DEBUG nextflow.Session - Session start invoked
Nov-12 17:55:42.309 [main] DEBUG nextflow.script.ScriptRunner - > Launching execution
Nov-12 17:55:42.331 [main] DEBUG nextflow.Session - Workflow process names [dsl1]: step1
Nov-12 17:55:42.334 [main] WARN  nextflow.script.BaseScript - The use of `echo` method has been deprecated
Nov-12 17:55:42.495 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: null
Nov-12 17:55:42.496 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Nov-12 17:55:42.508 [main] DEBUG nextflow.executor.Executor - [warm up] executor > local
Nov-12 17:55:42.521 [main] DEBUG n.processor.LocalPollingMonitor - Creating local task monitor for executor 'local' > cpus=4; memory=8 GB; capacity=4; pollInterval=100ms; dumpInterval=5m

Answer 1

您的输出声明正在查找当前workDir："${geoid}_datFiles.RData"中的文件，但是您的Rscript正在写入：$wd/data/${geoid}_datFiles.RData。如果将命令更改为：

Rscript $wd/scripts/step1.R $celFiles ${geoid}_datFiles.RData

那么Nextflow应该能够找到输出文件。然后，publishDir指令会将其‘发布’到已定义的publishDir。