DataprocMetastoreAsyncClient(*, credentials: google.auth.credentials.Credentials = None, transport: Union[str, google.cloud.metastore_v1alpha.services.dataproc_metastore.transports.base.DataprocMetastoreTransport] = 'grpc_asyncio', client_options: <module 'google.api_core.client_options' from '/workspace/python-dataproc-metastore/.nox/docfx/lib/python3.9/site-packages/google/api_core/client_options.py'> = None, client_info: google.api_core.gapic_v1.client_info.ClientInfo = <google.api_core.gapic_v1.client_info.ClientInfo object>)Configures and manages metastore services. Metastore services are fully managed, highly available, auto-scaled, auto-healing, OSS-native deployments of technical metadata management software. Each metastore service exposes a network endpoint through which metadata queries are served. Metadata queries can originate from a variety of sources, including Apache Hive, Apache Presto, and Apache Spark.
The Dataproc Metastore API defines the following resource model:
- The service works with a collection of Google Cloud projects, named: - /projects/*
- Each project has a collection of available locations, named: - /locations/*(a location must refer to a Google Cloud- region)
- Each location has a collection of services, named: - /services/*
- Dataproc Metastore services are resources with names of the form: - /projects/{project_number}/locations/{location_id}/services/{service_id}.
Properties
transport
Returns the transport used by the client instance.
| Returns | |
|---|---|
| Type | Description | 
| DataprocMetastoreTransport | The transport used by the client instance. | 
Methods
DataprocMetastoreAsyncClient
DataprocMetastoreAsyncClient(*, credentials: google.auth.credentials.Credentials = None, transport: Union[str, google.cloud.metastore_v1alpha.services.dataproc_metastore.transports.base.DataprocMetastoreTransport] = 'grpc_asyncio', client_options: <module 'google.api_core.client_options' from '/workspace/python-dataproc-metastore/.nox/docfx/lib/python3.9/site-packages/google/api_core/client_options.py'> = None, client_info: google.api_core.gapic_v1.client_info.ClientInfo = <google.api_core.gapic_v1.client_info.ClientInfo object>)Instantiates the dataproc metastore client.
| Parameters | |
|---|---|
| Name | Description | 
| credentials | Optional[google.auth.credentials.Credentials]The authorization credentials to attach to requests. These credentials identify the application to the service; if none are specified, the client will attempt to ascertain the credentials from the environment. | 
| transport | Union[str, The transport to use. If set to None, a transport is chosen automatically. | 
| client_options | ClientOptionsCustom options for the client. It won't take effect if a  | 
| Exceptions | |
|---|---|
| Type | Description | 
| google.auth.exceptions.MutualTlsChannelError | If mutual TLS transport creation failed for any reason. | 
backup_path
backup_path(project: str, location: str, service: str, backup: str)Returns a fully-qualified backup string.
common_billing_account_path
common_billing_account_path(billing_account: str)Returns a fully-qualified billing_account string.
common_folder_path
common_folder_path(folder: str)Returns a fully-qualified folder string.
common_location_path
common_location_path(project: str, location: str)Returns a fully-qualified location string.
common_organization_path
common_organization_path(organization: str)Returns a fully-qualified organization string.
common_project_path
common_project_path(project: str)Returns a fully-qualified project string.
create_backup
create_backup(request: Optional[google.cloud.metastore_v1alpha.types.metastore.CreateBackupRequest] = None, *, parent: Optional[str] = None, backup: Optional[google.cloud.metastore_v1alpha.types.metastore.Backup] = None, backup_id: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Creates a new Backup in a given project and location.
| Parameters | |
|---|---|
| Name | Description | 
| request | CreateBackupRequestThe request object. Request message for DataprocMetastore.CreateBackup. | 
| parent | Required. The relative resource name of the service in which to create a backup of the following form:  | 
| backup | BackupRequired. The backup to create. The  | 
| backup_id | Required. The ID of the backup, which is used as the final component of the backup's name. This value must be between 1 and 64 characters long, begin with a letter, end with a letter or number, and consist of alpha-numeric ASCII characters or hyphens. This corresponds to the  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.api_core.operation_async.AsyncOperation | An object representing a long-running operation. The result type for the operation will be Backup The details of a backup resource. | 
create_metadata_import
create_metadata_import(request: Optional[google.cloud.metastore_v1alpha.types.metastore.CreateMetadataImportRequest] = None, *, parent: Optional[str] = None, metadata_import: Optional[google.cloud.metastore_v1alpha.types.metastore.MetadataImport] = None, metadata_import_id: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Creates a new MetadataImport in a given project and location.
| Parameters | |
|---|---|
| Name | Description | 
| request | CreateMetadataImportRequestThe request object. Request message for DataprocMetastore.CreateMetadataImport. | 
| parent | Required. The relative resource name of the service in which to create a metastore import, in the following form:  | 
| metadata_import | MetadataImportRequired. The metadata import to create. The  | 
| metadata_import_id | Required. The ID of the metadata import, which is used as the final component of the metadata import's name. This value must be between 1 and 64 characters long, begin with a letter, end with a letter or number, and consist of alpha-numeric ASCII characters or hyphens. This corresponds to the  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.api_core.operation_async.AsyncOperation | An object representing a long-running operation. The result type for the operation will be MetadataImport A metastore resource that imports metadata. | 
create_service
create_service(request: Optional[google.cloud.metastore_v1alpha.types.metastore.CreateServiceRequest] = None, *, parent: Optional[str] = None, service: Optional[google.cloud.metastore_v1alpha.types.metastore.Service] = None, service_id: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Creates a metastore service in a project and location.
| Parameters | |
|---|---|
| Name | Description | 
| request | CreateServiceRequestThe request object. Request message for DataprocMetastore.CreateService. | 
| parent | Required. The relative resource name of the location in which to create a metastore service, in the following form:  | 
| service | ServiceRequired. The Metastore service to create. The  | 
| service_id | Required. The ID of the metastore service, which is used as the final component of the metastore service's name. This value must be between 2 and 63 characters long inclusive, begin with a letter, end with a letter or number, and consist of alpha-numeric ASCII characters or hyphens. This corresponds to the  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.api_core.operation_async.AsyncOperation | An object representing a long-running operation. The result type for the operation will be Service A managed metastore service that serves metadata queries. | 
delete_backup
delete_backup(request: Optional[google.cloud.metastore_v1alpha.types.metastore.DeleteBackupRequest] = None, *, name: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Deletes a single backup.
| Parameters | |
|---|---|
| Name | Description | 
| request | DeleteBackupRequestThe request object. Request message for DataprocMetastore.DeleteBackup. | 
| name | Required. The relative resource name of the backup to delete, in the following form:  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.api_core.operation_async.AsyncOperation | An object representing a long-running operation. The result type for the operation will be google.protobuf.empty_pb2.EmptyA generic empty message that you can re-use to avoid defining duplicated empty messages in your APIs. A typical example is to use it as the request or the response type of an API method. For instance: service Foo { rpc Bar(google.protobuf.Empty) returns (google.protobuf.Empty); } The JSON representation for Empty is empty JSON object {}. | 
delete_service
delete_service(request: Optional[google.cloud.metastore_v1alpha.types.metastore.DeleteServiceRequest] = None, *, name: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Deletes a single service.
| Parameters | |
|---|---|
| Name | Description | 
| request | DeleteServiceRequestThe request object. Request message for DataprocMetastore.DeleteService. | 
| name | Required. The relative resource name of the metastore service to delete, in the following form:  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.api_core.operation_async.AsyncOperation | An object representing a long-running operation. The result type for the operation will be google.protobuf.empty_pb2.EmptyA generic empty message that you can re-use to avoid defining duplicated empty messages in your APIs. A typical example is to use it as the request or the response type of an API method. For instance: service Foo { rpc Bar(google.protobuf.Empty) returns (google.protobuf.Empty); } The JSON representation for Empty is empty JSON object {}. | 
export_metadata
export_metadata(request: Optional[google.cloud.metastore_v1alpha.types.metastore.ExportMetadataRequest] = None, *, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Exports metadata from a service.
| Parameters | |
|---|---|
| Name | Description | 
| request | ExportMetadataRequestThe request object. Request message for DataprocMetastore.ExportMetadata. | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.api_core.operation_async.AsyncOperation | An object representing a long-running operation. The result type for the operation will be MetadataExport The details of a metadata export operation. | 
from_service_account_file
from_service_account_file(filename: str, *args, **kwargs)Creates an instance of this client using the provided credentials file.
| Parameter | |
|---|---|
| Name | Description | 
| filename | strThe path to the service account private key json file. | 
| Returns | |
|---|---|
| Type | Description | 
| DataprocMetastoreAsyncClient | The constructed client. | 
from_service_account_info
from_service_account_info(info: dict, *args, **kwargs)Creates an instance of this client using the provided credentials info.
| Parameter | |
|---|---|
| Name | Description | 
| info | dictThe service account private key info. | 
| Returns | |
|---|---|
| Type | Description | 
| DataprocMetastoreAsyncClient | The constructed client. | 
from_service_account_json
from_service_account_json(filename: str, *args, **kwargs)Creates an instance of this client using the provided credentials file.
| Parameter | |
|---|---|
| Name | Description | 
| filename | strThe path to the service account private key json file. | 
| Returns | |
|---|---|
| Type | Description | 
| DataprocMetastoreAsyncClient | The constructed client. | 
get_backup
get_backup(request: Optional[google.cloud.metastore_v1alpha.types.metastore.GetBackupRequest] = None, *, name: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Gets details of a single backup.
| Parameters | |
|---|---|
| Name | Description | 
| request | GetBackupRequestThe request object. Request message for DataprocMetastore.GetBackup. | 
| name | Required. The relative resource name of the backup to retrieve, in the following form:  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.cloud.metastore_v1alpha.types.Backup | The details of a backup resource. | 
get_metadata_import
get_metadata_import(request: Optional[google.cloud.metastore_v1alpha.types.metastore.GetMetadataImportRequest] = None, *, name: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Gets details of a single import.
| Parameters | |
|---|---|
| Name | Description | 
| request | GetMetadataImportRequestThe request object. Request message for DataprocMetastore.GetMetadataImport. | 
| name | Required. The relative resource name of the metadata import to retrieve, in the following form:  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.cloud.metastore_v1alpha.types.MetadataImport | A metastore resource that imports metadata. | 
get_service
get_service(request: Optional[google.cloud.metastore_v1alpha.types.metastore.GetServiceRequest] = None, *, name: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Gets the details of a single service.
| Parameters | |
|---|---|
| Name | Description | 
| request | GetServiceRequestThe request object. Request message for DataprocMetastore.GetService. | 
| name | Required. The relative resource name of the metastore service to retrieve, in the following form:  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.cloud.metastore_v1alpha.types.Service | A managed metastore service that serves metadata queries. | 
get_transport_class
get_transport_class()Returns an appropriate transport class.
list_backups
list_backups(request: Optional[google.cloud.metastore_v1alpha.types.metastore.ListBackupsRequest] = None, *, parent: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Lists backups in a service.
| Parameters | |
|---|---|
| Name | Description | 
| request | ListBackupsRequestThe request object. Request message for DataprocMetastore.ListBackups. | 
| parent | Required. The relative resource name of the service whose backups to list, in the following form:  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.cloud.metastore_v1alpha.services.dataproc_metastore.pagers.ListBackupsAsyncPager | Response message for DataprocMetastore.ListBackups. Iterating over this object will yield results and resolve additional pages automatically. | 
list_metadata_imports
list_metadata_imports(request: Optional[google.cloud.metastore_v1alpha.types.metastore.ListMetadataImportsRequest] = None, *, parent: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Lists imports in a service.
| Parameters | |
|---|---|
| Name | Description | 
| request | ListMetadataImportsRequestThe request object. Request message for DataprocMetastore.ListMetadataImports. | 
| parent | Required. The relative resource name of the service whose metadata imports to list, in the following form:  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.cloud.metastore_v1alpha.services.dataproc_metastore.pagers.ListMetadataImportsAsyncPager | Response message for DataprocMetastore.ListMetadataImports. Iterating over this object will yield results and resolve additional pages automatically. | 
list_services
list_services(request: Optional[google.cloud.metastore_v1alpha.types.metastore.ListServicesRequest] = None, *, parent: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Lists services in a project and location.
| Parameters | |
|---|---|
| Name | Description | 
| request | ListServicesRequestThe request object. Request message for DataprocMetastore.ListServices. | 
| parent | Required. The relative resource name of the location of metastore services to list, in the following form:  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.cloud.metastore_v1alpha.services.dataproc_metastore.pagers.ListServicesAsyncPager | Response message for DataprocMetastore.ListServices. Iterating over this object will yield results and resolve additional pages automatically. | 
metadata_import_path
metadata_import_path(
    project: str, location: str, service: str, metadata_import: str
)Returns a fully-qualified metadata_import string.
network_path
network_path(project: str, network: str)Returns a fully-qualified network string.
parse_backup_path
parse_backup_path(path: str)Parses a backup path into its component segments.
parse_common_billing_account_path
parse_common_billing_account_path(path: str)Parse a billing_account path into its component segments.
parse_common_folder_path
parse_common_folder_path(path: str)Parse a folder path into its component segments.
parse_common_location_path
parse_common_location_path(path: str)Parse a location path into its component segments.
parse_common_organization_path
parse_common_organization_path(path: str)Parse a organization path into its component segments.
parse_common_project_path
parse_common_project_path(path: str)Parse a project path into its component segments.
parse_metadata_import_path
parse_metadata_import_path(path: str)Parses a metadata_import path into its component segments.
parse_network_path
parse_network_path(path: str)Parses a network path into its component segments.
parse_service_path
parse_service_path(path: str)Parses a service path into its component segments.
restore_service
restore_service(request: Optional[google.cloud.metastore_v1alpha.types.metastore.RestoreServiceRequest] = None, *, service: Optional[str] = None, backup: Optional[str] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Restores a service from a backup.
| Parameters | |
|---|---|
| Name | Description | 
| request | RestoreServiceRequestThe request object. Request message for [DataprocMetastore.Restore][]. | 
| service | Required. The relative resource name of the metastore service to run restore, in the following form:  | 
| backup | Required. The relative resource name of the metastore service backup to restore from, in the following form:  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.api_core.operation_async.AsyncOperation | An object representing a long-running operation. The result type for the operation will be Restore The details of a metadata restore operation. | 
service_path
service_path(project: str, location: str, service: str)Returns a fully-qualified service string.
update_metadata_import
update_metadata_import(request: Optional[google.cloud.metastore_v1alpha.types.metastore.UpdateMetadataImportRequest] = None, *, metadata_import: Optional[google.cloud.metastore_v1alpha.types.metastore.MetadataImport] = None, update_mask: Optional[google.protobuf.field_mask_pb2.FieldMask] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Updates a single import. Only the description field of MetadataImport is supported to be updated.
| Parameters | |
|---|---|
| Name | Description | 
| request | UpdateMetadataImportRequestThe request object. Request message for DataprocMetastore.UpdateMetadataImport. | 
| metadata_import | MetadataImportRequired. The metadata import to update. The server only merges fields in the import if they are specified in  | 
| update_mask | Required. A field mask used to specify the fields to be overwritten in the metadata import resource by the update. Fields specified in the  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.api_core.operation_async.AsyncOperation | An object representing a long-running operation. The result type for the operation will be MetadataImport A metastore resource that imports metadata. | 
update_service
update_service(request: Optional[google.cloud.metastore_v1alpha.types.metastore.UpdateServiceRequest] = None, *, service: Optional[google.cloud.metastore_v1alpha.types.metastore.Service] = None, update_mask: Optional[google.protobuf.field_mask_pb2.FieldMask] = None, retry: google.api_core.retry.Retry = <_MethodDefault._DEFAULT_VALUE: <object object>>, timeout: Optional[float] = None, metadata: Sequence[Tuple[str, str]] = ())Updates the parameters of a single service.
| Parameters | |
|---|---|
| Name | Description | 
| request | UpdateServiceRequestThe request object. Request message for DataprocMetastore.UpdateService. | 
| service | ServiceRequired. The metastore service to update. The server only merges fields in the service if they are specified in  | 
| update_mask | Required. A field mask used to specify the fields to be overwritten in the metastore service resource by the update. Fields specified in the  | 
| retry | google.api_core.retry.RetryDesignation of what errors, if any, should be retried. | 
| timeout | floatThe timeout for this request. | 
| metadata | Sequence[Tuple[str, str]]Strings which should be sent along with the request as metadata. | 
| Returns | |
|---|---|
| Type | Description | 
| google.api_core.operation_async.AsyncOperation | An object representing a long-running operation. The result type for the operation will be Service A managed metastore service that serves metadata queries. |