我已经成功地在统一云AI平台上创建了一个端点,并向其部署了两个Model-- Model A和Model B,流量分别占流量的20%和80%。现在,在云控制台( UI)上,我可以选择编辑设置,并将流量拆分分别更改为30%和70%,并部署Model。但是,我无法理解如何使用来做到这一点。
通过这里提供的文档不足以理解我们如何做到这一点。任何帮助都将不胜感激。
发布于 2021-04-21 07:23:50
AI平台统一文档还没有关于如何使用python编辑通信量的示例。以下是这方面的代码:
注意:在运行代码之前,不要忘记更新end_point (端点ID)、project (项目ID)、model_id_1和model_id_2的值。
from google.cloud import aiplatform
from google.cloud import aiplatform_v1
def update_endpoint_traffic(
end_point: str,
project: str,
location: str = "us-central1",
api_endpoint: str = "us-central1-aiplatform.googleapis.com",
timeout: int = 7200,
):
# The AI Platform services require regional API endpoints.
client_options = {"api_endpoint": api_endpoint}
# Initialize client that will be used to create and send requests.
# This client only needs to be created once, and can be reused for multiple requests.
client = aiplatform.gapic.EndpointServiceClient(client_options=client_options)
client_model = aiplatform_v1.services.model_service.ModelServiceClient(client_options=client_options)
deployed_model_id_list = []
model_id_1 = 'xxxxxxxx' # place your model id here
model_id_2 = 'xxxxxxxx' # place your model id here
model_list = [f'projects/{project}/locations/{location}/models/{model_id_1}',f'projects/{project}/locations/{location}/models/{model_id_2}']
for model in model_list:
model_request = aiplatform_v1.types.GetModelRequest(name=model)
model_info = client_model.get_model(request=model_request)
deployed_models_info = model_info.deployed_models
deployed_model_id=model_info.deployed_models[0].deployed_model_id
deployed_model_id_list.append(deployed_model_id)
traffic_split = {deployed_model_id_list[0]: 60, deployed_model_id_list[1]:40} #update values of 60 and 40 to desired traffic split ex.(30 70)
name=f'projects/{project}/locations/{location}/endpoints/{end_point}'
endpoint = aiplatform_v1.types.Endpoint(name=name,traffic_split=traffic_split)
update_endpoint = aiplatform_v1.types.UpdateEndpointRequest(endpoint=endpoint)
client.update_endpoint(request=update_endpoint)
update_endpoint_traffic(end_point='your-endpoint-id',project='your-project-id') https://stackoverflow.com/questions/67183177
复制相似问题