为什么ec2上的Python-进程会停止？

Question

我在一个t2.微EC2实例上运行了一个python脚本。

我用./myscript > /dev/null 2>&1 &启动程序，而不是检查我的脚本是否使用ps -elf \ grep python运行。问题是，经过一段相当随意的时间，程序停止了，我不能再用ps -elf | grep python看到它了。我真的不明白发生这种情况的原因(是Out of Memory，等等吗？)

我的代码变得有点丑陋，因为我尝试了各种各样的东西。基本上，它从excel中获取所有类型的密码符号(如BTC)，创建到kraken.com的websocket，收集数据并每小时将其保存到.pkl中。有没有人建议如何弄清楚为什么这几个小时甚至几天都很好，然后就停下来了？

如果我在Windows上的jupyter/anaconda上本地运行，我的程序就没有问题。

#!/usr/bin/python3

import json
from websocket import create_connection
import pandas as pd
import time
import requests
from datetime import datetime, timedelta

df = pd.read_excel('Kraken_All_pairs.xlsx')
kraken_pairs = ''
for i in df['Symbol']:
    kraken_pairs = kraken_pairs + '"' + str(i) + '/USD",'
kraken_pairs = kraken_pairs[0:-1]
kraken_pairs = '{"event":"subscribe", "subscription":{"name":"trade"}, "pair":[' + kraken_pairs + ']}'
lasttime = datetime.utcfromtimestamp(time.time()).strftime('%H')
while True:
    try:
        data_list = list()
        try:
            ws = create_connection("wss://ws.kraken.com/")
            ws.send(kraken_pairs)
        except Exception as e:
            time.sleep(1)
            break;
        while True:
            try:
                data_list.append(json.loads(ws.recv()))
            except Exception as e:
                timestamp_exception = datetime.utcfromtimestamp(time.time()).strftime('%Y-%m-%d %H:%M:%S.%f')
                try:
                    ws = create_connection("wss://ws.kraken.com/")
                    ws.send(kraken_pairs)
                except Exception as e:
                    time.sleep(1)
                    break;
            now = datetime.utcfromtimestamp(time.time()).strftime('%H')

            if lasttime != now:
                lasttime = now
                break
                
        data_list = [value for value in data_list if value != {'event': 'heartbeat'}]
        data_list = [value for value in data_list if type(value) != dict]
        Pair = [value[3] for value in data_list]
        Price = [value[1][0][0] for value in data_list]
        Date = [value[1][0][2] for value in data_list]
        df_all = pd.DataFrame(list(zip(Pair, Price, Date)), columns =['Pair', 'Price', 'Date'])
        df_all['Date'] = df_all['Date'].astype(float)
        df_all['Date'] = df_all['Date']*1000
        df_all['Date'] = pd.to_datetime(df_all['Date'], unit='ms')
        df_all['Date'] = df_all['Date'].dt.strftime("%m.%d.%Y, %H:%M:%S")
        list_all_df_pairs = []
        for value in df_all['Pair'].unique():
            list_all_df_pairs.append(df_all.loc[df_all['Pair'] == value])
        for index in range(0,len(list_all_df_pairs)):
            path = './pkl/' + str((datetime.utcfromtimestamp(time.time()) - timedelta(hours=1)).strftime('%H')) + '_' + list_all_df_pairs[index]['Pair'].iloc[0].replace('/','_') + '.pkl'
            list_all_df_pairs[index].to_pickle(path)
    except Exception as e:
        timestamp_exception = datetime.utcfromtimestamp(time.time()).strftime('%Y-%m-%d %H:%M:%S.%f')

Answer 1

如果您想知道出了什么问题，我建议您不要只将输出管道输送到/dev/null。

同跑

./myscript >> myscript.log 2>&1 &

这样你就可以调试它了。