Cloud Dataproc V1 API - Class Google::Cloud::Dataproc::V1::PigJob (v1.9.0)

Reference documentation and code samples for the Cloud Dataproc V1 API class Google::Cloud::Dataproc::V1::PigJob.

A Dataproc job for running Apache Pig queries on YARN.

Inherits

  • Object

Extended By

  • Google::Protobuf::MessageExts::ClassMethods

Includes

  • Google::Protobuf::MessageExts

Methods

#continue_on_failure

def continue_on_failure() -> ::Boolean
Returns
  • (::Boolean) — Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.

#continue_on_failure=

def continue_on_failure=(value) -> ::Boolean
Parameter
  • value (::Boolean) — Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
Returns
  • (::Boolean) — Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.

#jar_file_uris

def jar_file_uris() -> ::Array<::String>
Returns
  • (::Array<::String>) — Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.

#jar_file_uris=

def jar_file_uris=(value) -> ::Array<::String>
Parameter
  • value (::Array<::String>) — Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
Returns
  • (::Array<::String>) — Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.

#logging_config

def logging_config() -> ::Google::Cloud::Dataproc::V1::LoggingConfig
Returns

#logging_config=

def logging_config=(value) -> ::Google::Cloud::Dataproc::V1::LoggingConfig
Parameter
Returns

#properties

def properties() -> ::Google::Protobuf::Map{::String => ::String}
Returns
  • (::Google::Protobuf::Map{::String => ::String}) — Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API might be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.

#properties=

def properties=(value) -> ::Google::Protobuf::Map{::String => ::String}
Parameter
  • value (::Google::Protobuf::Map{::String => ::String}) — Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API might be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.
Returns
  • (::Google::Protobuf::Map{::String => ::String}) — Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API might be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.

#query_file_uri

def query_file_uri() -> ::String
Returns
  • (::String) — The HCFS URI of the script that contains the Pig queries.

    Note: The following fields are mutually exclusive: query_file_uri, query_list. If a field in that set is populated, all other fields in the set will automatically be cleared.

#query_file_uri=

def query_file_uri=(value) -> ::String
Parameter
  • value (::String) — The HCFS URI of the script that contains the Pig queries.

    Note: The following fields are mutually exclusive: query_file_uri, query_list. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::String) — The HCFS URI of the script that contains the Pig queries.

    Note: The following fields are mutually exclusive: query_file_uri, query_list. If a field in that set is populated, all other fields in the set will automatically be cleared.

#query_list

def query_list() -> ::Google::Cloud::Dataproc::V1::QueryList
Returns
  • (::Google::Cloud::Dataproc::V1::QueryList) — A list of queries.

    Note: The following fields are mutually exclusive: query_list, query_file_uri. If a field in that set is populated, all other fields in the set will automatically be cleared.

#query_list=

def query_list=(value) -> ::Google::Cloud::Dataproc::V1::QueryList
Parameter
  • value (::Google::Cloud::Dataproc::V1::QueryList) — A list of queries.

    Note: The following fields are mutually exclusive: query_list, query_file_uri. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::Dataproc::V1::QueryList) — A list of queries.

    Note: The following fields are mutually exclusive: query_list, query_file_uri. If a field in that set is populated, all other fields in the set will automatically be cleared.

#script_variables

def script_variables() -> ::Google::Protobuf::Map{::String => ::String}
Returns
  • (::Google::Protobuf::Map{::String => ::String}) — Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).

#script_variables=

def script_variables=(value) -> ::Google::Protobuf::Map{::String => ::String}
Parameter
  • value (::Google::Protobuf::Map{::String => ::String}) — Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).
Returns
  • (::Google::Protobuf::Map{::String => ::String}) — Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).