public sealed class Task.Types.SparkTaskConfig : IMessage<Task.Types.SparkTaskConfig>, IEquatable<Task.Types.SparkTaskConfig>, IDeepCloneable<Task.Types.SparkTaskConfig>, IBufferMessage, IMessage
Reference documentation and code samples for the Cloud Dataplex v1 API class Task.Types.SparkTaskConfig.
Optional. Cloud Storage URIs of archives to be extracted into the working
directory of each executor. Supported file types: .jar, .tar, .tar.gz,
.tgz, and .zip.
The name of the driver's main class. The jar file that contains the
class must be in the default CLASSPATH or specified in
jar_file_uris.
The execution args are passed in as a sequence of named process
arguments (--key=value).
The Cloud Storage URI of the jar file that contains the main class.
The execution args are passed in as a sequence of named process
arguments (--key=value).
The Gcloud Storage URI of the main Python file to use as the driver.
Must be a .py file. The execution args are passed in as a sequence of
named process arguments (--key=value).
A reference to a query file. This should be the Cloud Storage URI of
the query file. The execution args are used to declare a set of script
variables (set key="value";).
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-07 UTC."],[[["\u003cp\u003eThe latest version available for \u003ccode\u003eTask.Types.SparkTaskConfig\u003c/code\u003e in the \u003ccode\u003eGoogle.Cloud.Dataplex.V1\u003c/code\u003e API is 3.6.0, which is the most current release among the documented versions.\u003c/p\u003e\n"],["\u003cp\u003eThis documentation provides reference material and code samples for the \u003ccode\u003eTask.Types.SparkTaskConfig\u003c/code\u003e class in the Cloud Dataplex v1 API.\u003c/p\u003e\n"],["\u003cp\u003e\u003ccode\u003eTask.Types.SparkTaskConfig\u003c/code\u003e allows for user-specified configurations for running a Spark task, including specifying archive and file URIs, a main class or jar, and various script options.\u003c/p\u003e\n"],["\u003cp\u003eThe class \u003ccode\u003eTask.Types.SparkTaskConfig\u003c/code\u003e implements multiple interfaces, such as \u003ccode\u003eIMessage\u003c/code\u003e, \u003ccode\u003eIEquatable\u003c/code\u003e, \u003ccode\u003eIDeepCloneable\u003c/code\u003e, and \u003ccode\u003eIBufferMessage\u003c/code\u003e.\u003c/p\u003e\n"],["\u003cp\u003eThe class allows the user to specify the infrastructure for execution via the \u003ccode\u003eInfrastructureSpec\u003c/code\u003e property, and a list of prior version of this class is readily available.\u003c/p\u003e\n"]]],[],null,["# Cloud Dataplex v1 API - Class Task.Types.SparkTaskConfig (3.9.0)\n\nVersion latestkeyboard_arrow_down\n\n- [3.9.0 (latest)](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [3.8.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/3.8.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [3.7.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/3.7.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [3.6.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/3.6.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [3.5.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/3.5.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [3.4.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/3.4.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [3.3.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/3.3.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [3.2.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/3.2.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [3.1.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/3.1.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [3.0.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/3.0.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.15.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.15.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.14.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.14.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.13.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.13.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.12.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.12.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.11.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.11.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.10.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.10.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.9.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.9.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.8.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.8.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.7.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.7.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.6.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.6.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.5.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.5.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.4.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.4.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.3.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.3.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.2.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.2.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.1.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.1.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [2.0.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/2.0.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig)\n- [1.0.0](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/1.0.0/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig) \n\n public sealed class Task.Types.SparkTaskConfig : IMessage\u003cTask.Types.SparkTaskConfig\u003e, IEquatable\u003cTask.Types.SparkTaskConfig\u003e, IDeepCloneable\u003cTask.Types.SparkTaskConfig\u003e, IBufferMessage, IMessage\n\nReference documentation and code samples for the Cloud Dataplex v1 API class Task.Types.SparkTaskConfig.\n\nUser-specified config for running a Spark task. \n\nInheritance\n-----------\n\n[object](https://learn.microsoft.com/dotnet/api/system.object) \\\u003e Task.Types.SparkTaskConfig \n\nImplements\n----------\n\n[IMessage](https://cloud.google.com/dotnet/docs/reference/Google.Protobuf/latest/Google.Protobuf.IMessage-1.html)[Task](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task)[Types](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task.Types)[SparkTaskConfig](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig), [IEquatable](https://learn.microsoft.com/dotnet/api/system.iequatable-1)[Task](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task)[Types](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task.Types)[SparkTaskConfig](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig), [IDeepCloneable](https://cloud.google.com/dotnet/docs/reference/Google.Protobuf/latest/Google.Protobuf.IDeepCloneable-1.html)[Task](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task)[Types](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task.Types)[SparkTaskConfig](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1.Task.Types.SparkTaskConfig), [IBufferMessage](https://cloud.google.com/dotnet/docs/reference/Google.Protobuf/latest/Google.Protobuf.IBufferMessage.html), [IMessage](https://cloud.google.com/dotnet/docs/reference/Google.Protobuf/latest/Google.Protobuf.IMessage.html) \n\nInherited Members\n-----------------\n\n[object.GetHashCode()](https://learn.microsoft.com/dotnet/api/system.object.gethashcode) \n[object.GetType()](https://learn.microsoft.com/dotnet/api/system.object.gettype) \n[object.ToString()](https://learn.microsoft.com/dotnet/api/system.object.tostring)\n\nNamespace\n---------\n\n[Google.Cloud.Dataplex.V1](/dotnet/docs/reference/Google.Cloud.Dataplex.V1/latest/Google.Cloud.Dataplex.V1)\n\nAssembly\n--------\n\nGoogle.Cloud.Dataplex.V1.dll\n\nConstructors\n------------\n\n### SparkTaskConfig()\n\n public SparkTaskConfig()\n\n### SparkTaskConfig(SparkTaskConfig)\n\n public SparkTaskConfig(Task.Types.SparkTaskConfig other)\n\nProperties\n----------\n\n### ArchiveUris\n\n public RepeatedField\u003cstring\u003e ArchiveUris { get; }\n\nOptional. Cloud Storage URIs of archives to be extracted into the working\ndirectory of each executor. Supported file types: .jar, .tar, .tar.gz,\n.tgz, and .zip.\n\n### DriverCase\n\n public Task.Types.SparkTaskConfig.DriverOneofCase DriverCase { get; }\n\n### FileUris\n\n public RepeatedField\u003cstring\u003e FileUris { get; }\n\nOptional. Cloud Storage URIs of files to be placed in the working\ndirectory of each executor.\n\n### HasMainClass\n\n public bool HasMainClass { get; }\n\nGets whether the \"main_class\" field is set\n\n### HasMainJarFileUri\n\n public bool HasMainJarFileUri { get; }\n\nGets whether the \"main_jar_file_uri\" field is set\n\n### HasPythonScriptFile\n\n public bool HasPythonScriptFile { get; }\n\nGets whether the \"python_script_file\" field is set\n\n### HasSqlScript\n\n public bool HasSqlScript { get; }\n\nGets whether the \"sql_script\" field is set\n\n### HasSqlScriptFile\n\n public bool HasSqlScriptFile { get; }\n\nGets whether the \"sql_script_file\" field is set\n\n### InfrastructureSpec\n\n public Task.Types.InfrastructureSpec InfrastructureSpec { get; set; }\n\nOptional. Infrastructure specification for the execution.\n\n### MainClass\n\n public string MainClass { get; set; }\n\nThe name of the driver's main class. The jar file that contains the\nclass must be in the default CLASSPATH or specified in\n`jar_file_uris`.\nThe execution args are passed in as a sequence of named process\narguments (`--key=value`).\n\n### MainJarFileUri\n\n public string MainJarFileUri { get; set; }\n\nThe Cloud Storage URI of the jar file that contains the main class.\nThe execution args are passed in as a sequence of named process\narguments (`--key=value`).\n\n### PythonScriptFile\n\n public string PythonScriptFile { get; set; }\n\nThe Gcloud Storage URI of the main Python file to use as the driver.\nMust be a .py file. The execution args are passed in as a sequence of\nnamed process arguments (`--key=value`).\n\n### SqlScript\n\n public string SqlScript { get; set; }\n\nThe query text.\nThe execution args are used to declare a set of script variables\n(`set key=\"value\";`).\n\n### SqlScriptFile\n\n public string SqlScriptFile { get; set; }\n\nA reference to a query file. This should be the Cloud Storage URI of\nthe query file. The execution args are used to declare a set of script\nvariables (`set key=\"value\";`)."]]
