ClearML，如何查询特定项目和度量的最佳执行模型

Question

我想下载某个ClearlML项目的性能最好的模型。在我的ClearML实验平台中，我有以下内容：

​

​

根据：https://clear.ml/docs/latest/docs/clearml_sdk/model_sdk#querying-models，我可以获得一个特定项目的模型列表：

model_list = Model.query_models(
    # Only models from `examples` project
    project_name='YOLOv5', 
    # Only models with input name
    model_name=None,
    # Only models with `demo` tag but without `TF` tag
    tags=['demo', '-TF'],
    # If `True`, only published models
    only_published=False,
    # If `True`, include archived models
    include_archived=True,
    # Maximum number of models returned
    max_results=5
)

print(model_list)

其中的指纹：

[<clearml.model.Model object at 0x7fefbaf22130>, <clearml.model.Model object at 0x7fefbaf22340>]

这样我就可以跑了

model_list[0].get_local_copy()

得到这个特定的模型。但是，如何在特定的度量(在本例中为mAP_0.5:0.95 MAX)上下载该项目的最佳性能？

Answer 1

最后我做了以下几件事：

try:
    import clearml
    from clearml import Dataset, Task, Model, OutputModel
    assert hasattr(clearml, '__version__')  # verify package import not local dir
except (ImportError, AssertionError):
    clearml = None

tasks = Task.get_tasks(project_name='YOLOv5', task_name='exp', task_filter={'status': ['completed']})

results = {}
best_task = None
for task in tasks:
    results[task.id] = task.get_last_scalar_metrics()['metrics']['mAP_0.5:0.95']['max']

best_model_task_id = max(results, key=results.get)
model_list = Task.get_task(best_model_task_id).get_models()
dest = model_list['output'][0].get_local_copy()
print('Saved model at:', dest)