如何在Great_Expectations中触发空闲通知作为验证操作

Question

我在Apache Spark中有以下Great_Expectation与数据库和Apache Spark上的Synapse

ge_df.expect_column_values_to_be_between('load_id', min_value=1000, max_value=1049). 

我尝试向Great_Expectation添加一个松弛通知，如下所示：

ge_df.expect_column_values_to_be_between('load_id', min_value=1000, max_value=1049, slack_render = {"text": (test information,['MY_SLACK_WEBHOOK'])

但它失败了

谁能告诉我我可能会出错的地方？

我也尝试了以下方法，但对我来说有点太高级了：

if not validation_results["success"]:
    num_evaluated = validation_results["statistics"]["evaluated_expectations"]
    num_successful = validation_results["statistics"]["successful_expectations"]
    validation_results_text = json.dumps(
        [result.to_json_dict() for result in validation_results["results"]],
        sort_keys=True,
        indent=4,
    )
    slack_renderer = {
        "text": (
            f"⚠️ Dataset has failed expecations\n"
            f"*Successful Expectations*: `{num_successful}/{num_evaluated}`\n"
            f"*Results*: ```\n{validation_results_text}\n```"
        )
    }

    response = requests.post(
        os.environ['SLACK_WEBHOOK'],
        data=json.dumps(slack_renderer),
        headers={"Content-Type": "application/json"},
    )

输入slack_webhook时出现错误

KeyError: 'https://hooks.slack.com/services/T1L0WSW9F/B028H2KKPU3/56EZfTdU1oIprsrxxx'
Traceback (most recent call last):

  File "/home/trusted-service-user/cluster-env/env/lib/python3.6/os.py", line 669, in __getitem__
    raise KeyError(key) from None

KeyError: 'https://hooks.slack.com/services/T1L0WSW9F/B028H2KKPU3/56EZfTdU1oIprsrxxx'

我认为问题出在这里：

response = requests.post(
        os.environ['https://hooks.slack.com/services/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'],
        data=json.dumps(slack_renderer),
        headers={"Content-Type": "application/json"},
    )

非常感谢您的帮助。

Answer 1

通过将requests.post更改为

response = requests.post(
    webhook_url, data=json.dumps(slack_renderer),
    headers={'Content-Type': 'application/json'},
    )