Azure数据湖2 (adls2)，api用于获取存储在数据湖中的数据的总体大小。

Question

我正在寻找一种方法来获取关于数据湖中存储的所有数据的总体大小的数据(蔚蓝数据湖gen2 2- adls2)。是否有人知道如何获取有关数据湖大小(存储了多少数据)的此类信息？试图找到合适的API，但到目前为止没有找到任何东西。会感谢你的任何建议。

Answer 1

如果您想获取数据湖gen2中存储的所有数据的大小(不包括File, Table, Queue存储)，您可以在metricnames=BlobCapacity中使用这个Metrics - List REST，用最近的一个小时指定timespan，例如，现在是2019-10-14T05:48:03Z，只使用timespan=2019-10-14T04:47:03Z/2019-10-14T05:47:03Z，它在我这边工作得很好。

样本

GET https://management.azure.com/subscriptions/<subscription-id>/resourceGroups/<resource-group-name>/providers/Microsoft.Storage/storageAccounts/<storageaccount-name>/blobServices/default/providers/microsoft.insights/metrics?timespan=2019-10-14T04:47:03Z/2019-10-14T05:47:03Z&metricnames=BlobCapacity&api-version=2018-01-01

响应

 { 
   "cost":0,
   "timespan":"2019-10-14T04:47:03Z/2019-10-14T05:47:03Z",
   "interval":"PT1H",
   "value":[ 
      { 
         "id":"/subscriptions/xxxxxxx/resourceGroups/xxxxxxx/providers/Microsoft.Storage/storageAccounts/joygen2/blobServices/default/providers/Microsoft.Insights/metrics/BlobCapacity",
         "type":"Microsoft.Insights/metrics",
         "name":{ 
            "value":"BlobCapacity",
            "localizedValue":"Blob Capacity"
         },
         "displayDescription":"The amount of storage used by the storage account’s Blob service in bytes.",
         "unit":"Bytes",
         "timeseries":[ 
            { 
               "metadatavalues":[ 

               ],
               "data":[ 
                  { 
                     "timeStamp":"2019-10-14T04:47:00Z",
                     "average":44710.0
                  }
               ]
            }
         ]
      }
   ],
   "namespace":"Microsoft.Storage/storageAccounts/blobServices",
   "resourceregion":"eastus"
}

更新

如果要获取包括File, Table, Queue存储在内的所有数据的大小，只需使用UsedCapacity度量名称即可。

样本

GET https://management.azure.com/subscriptions/<subscription-id>/resourceGroups/<resource-group-name>/providers/Microsoft.Storage/storageAccounts/<storageaccount-name>/providers/microsoft.insights/metrics?timespan=2019-10-14T04:47:03Z/2019-10-14T05:47:03Z&metricnames=UsedCapacity&api-version=2018-01-01

响应

{ 
   "cost":0,
   "timespan":"2019-10-14T04:47:03Z/2019-10-14T05:47:03Z",
   "interval":"PT1H",
   "value":[ 
      { 
         "id":"/subscriptions/xxxxx/resourceGroups/xxxxx/providers/Microsoft.Storage/storageAccounts/xxxxx/providers/Microsoft.Insights/metrics/UsedCapacity",
         "type":"Microsoft.Insights/metrics",
         "name":{ 
            "value":"UsedCapacity",
            "localizedValue":"Used capacity"
         },
         "displayDescription":"Account used capacity",
         "unit":"Bytes",
         "timeseries":[ 
            { 
               "metadatavalues":[ 

               ],
               "data":[ 
                  { 
                     "timeStamp":"2019-10-14T04:47:00Z",
                     "average":2559131.0
                  }
               ]
            }
         ]
      }
   ],
   "namespace":"Microsoft.Storage/storageAccounts",
   "resourceregion":"eastus"
}