PandasDataLoadLimitToDay Class
Defines a pandas data load limit to the last day.
You can use PandasDataLoadLimitToDay to control how many parquets of days will be loaded.
Initialize pandas data load limit to the last day.
Constructor
PandasDataLoadLimitToDay(start_date, end_date, path_pattern='/year=%d/month=%d/day=%d/', limit=-1)Parameters
| Name | Description |
|---|---|
|
start_date
Required
|
The start date you'd like to query inclusively. |
|
end_date
Required
|
The end date you'd like to query inclusively. |
|
path_pattern
|
A blob path pattern. Default value: /year=%d/month=%d/day=%d/
|
|
limit
|
The limit of the max number of paths that can be returned. Default value: -1
|
Methods
| get_target_blob_paths |
Get target blob paths based on its own filters. |
get_target_blob_paths
Get target blob paths based on its own filters.
get_target_blob_paths(blob_service: BlobServiceClient, blob_container_name: str, blob_relative_path: str)Parameters
| Name | Description |
|---|---|
|
blob_service
Required
|
The block blob service. |
|
blob_container_name
Required
|
The blob container name. |
|
blob_relative_path
Required
|
The blob relative path. |
Returns
| Type | Description |
|---|---|
|
A list of target blob paths within filter range. |