Google Cloud Dataproc v1 API - Class PySparkNotebookBatch (5.25.0) 

public sealed class PySparkNotebookBatch : IMessage<PySparkNotebookBatch>, IEquatable<PySparkNotebookBatch>, IDeepCloneable<PySparkNotebookBatch>, IBufferMessage, IMessage

Reference documentation and code samples for the Google Cloud Dataproc v1 API class PySparkNotebookBatch.

A configuration for running a PySpark Notebook batch workload.

Inheritance

object > PySparkNotebookBatch

Namespace

Google.Cloud.Dataproc.V1

Assembly

Google.Cloud.Dataproc.V1.dll

Constructors

PySparkNotebookBatch()

public PySparkNotebookBatch()

PySparkNotebookBatch(PySparkNotebookBatch)

public PySparkNotebookBatch(PySparkNotebookBatch other)
Parameter
Name Description
other PySparkNotebookBatch

Properties

ArchiveUris

public RepeatedField<string> ArchiveUris { get; }

Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

Property Value
Type Description
RepeatedFieldstring

FileUris

public RepeatedField<string> FileUris { get; }

Optional. HCFS URIs of files to be placed in the working directory of each executor

Property Value
Type Description
RepeatedFieldstring

JarFileUris

public RepeatedField<string> JarFileUris { get; }

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Property Value
Type Description
RepeatedFieldstring

NotebookFileUri

public string NotebookFileUri { get; set; }

Required. The HCFS URI of the notebook file to execute.

Property Value
Type Description
string

Params

public MapField<string, string> Params { get; }

Optional. The parameters to pass to the notebook.

Property Value
Type Description
MapFieldstringstring

PythonFileUris

public RepeatedField<string> PythonFileUris { get; }

Optional. HCFS URIs of Python files to pass to the PySpark framework.

Property Value
Type Description
RepeatedFieldstring