Class ImportJobSpec (2.11.0) 

ImportJobSpec(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Job specification for a metadata import job.

You can run the following kinds of metadata import jobs:

  • Full sync of entries with incremental import of their aspects. Supported for custom entries.
  • Incremental import of aspects only. Supported for aspects that belong to custom entries and system entries. For custom entries, you can modify both optional aspects and required aspects. For system entries, you can modify optional aspects.

Attributes
Name Description
source_storage_uri str
Optional. The URI of a Cloud Storage bucket or folder (beginning with gs:// and ending with /) that contains the metadata import files for this job. A metadata import file defines the values to set for each of the entries and aspects in a metadata import job. For more information about how to create a metadata import file and the file requirements, see `Metadata import file
source_create_time google.protobuf.timestamp_pb2.Timestamp
Optional. The time when the process that created the metadata import files began.
scope google.cloud.dataplex_v1.types.MetadataJob.ImportJobSpec.ImportJobScope
Required. A boundary on the scope of impact that the metadata import job can have.
entry_sync_mode google.cloud.dataplex_v1.types.MetadataJob.ImportJobSpec.SyncMode
Required. The sync mode for entries.
aspect_sync_mode google.cloud.dataplex_v1.types.MetadataJob.ImportJobSpec.SyncMode
Required. The sync mode for aspects.
log_level google.cloud.dataplex_v1.types.MetadataJob.ImportJobSpec.LogLevel
Optional. The level of logs to write to Cloud Logging for this job. Debug-level logs provide highly-detailed information for troubleshooting, but their increased verbosity could incur `additional costs

Classes

ImportJobScope

ImportJobScope(mapping=None, *, ignore_unknown_fields=False, **kwargs)

A boundary on the scope of impact that the metadata import job can have.

LogLevel

LogLevel(value)

The level of logs to write to Cloud Logging for this job.

    Depending on the size of your metadata job and the number of
    logs that are generated, debug-level logging might incur
    `additional
    costs <https://cloud.google.com/stackdriver/pricing>`__.
INFO (2):
    Info-level logging. Captures logs at the
    overall job level. Includes aggregate logs about
    import items, but doesn't specify which import
    item has an error.

SyncMode

SyncMode(value)

Specifies how the entries and aspects in a metadata import job are updated. For more information, see Sync mode <https://cloud.google.com/dataplex/docs/import-metadata#sync-mode>__.

    This sync mode is supported for entries.
INCREMENTAL (2):
    Only the resources that are explicitly
    included in the metadata import file are
    modified. Use this mode to modify a subset of
    resources while leaving unreferenced resources
    unchanged.

    This sync mode is supported for aspects.
NONE (3):
    If entry sync mode is `NONE`, then aspects are modified
    according to the aspect sync mode. Other metadata that
    belongs to entries in the job's scope isn't modified.

    This sync mode is supported for entries.