如何在Ec2 ubuntu中使用Django-Crontab

Question

cronjob

*/30 * * * * /home/ubuntu/web-coin-crawler/venv/bin/python3 /home/ubuntu/web-coin-crawler/webcoincrawler/cron.crontab 

在两个站点上爬行的cron.py ()函数。保存到Django orm作为save()。

import json
import collections

import crawl_coinmarketcal as coinmarketcal
import crawl_coinscalendar as coinscalendar
import os

os.environ.setdefault("DJANGO_SETTINGS_MODULE", "config.settings")
import django
import datetime

django.setup()
from crawled_data.models import BlogData


def preprocessingDict(dic: dict):
    coin_dict = collections.defaultdict(dict)
    for key, value in dic.items():
        if value['symbol'] in coin_dict[value['date']]:
            coin_dict[value['date']][value['symbol']].append([key, value['title'], value['name']])
        else:
            coin_dict[value['date']][value['symbol']] = [[key, value['title'], value['name']]]
    return coin_dict


def crontab():
    result = dict()

    urls = coinmarketcal.get_urls()
    for url in urls:
        coinmarketcal.do_crawl(url, result)

    urls = coinscalendar.get_urls()
    for url in urls:
        coinscalendar.do_crawl(url, result)

    BlogData(title="COIN_DATA", content=json.dumps(preprocessingDict(result.copy()))).save()

I checked that the cron tab runs every 30 minutes.然而，没有数据存储在Django orm中。

Answer 1

我将Python文件本身更改为run，问题就解决了。cron.crontab -> cron