Optional. HCFS URIs of archives to be extracted in the working directory of
Hadoop drivers and tasks. Supported file types:
.jar, .tar, .tar.gz, .tgz, or .zip.
Optional. The arguments to pass to the driver. Do not
include arguments, such as -libjars or -Dfoo=bar, that can be set as
job properties, since a collision might occur that causes an incorrect job
submission.
Optional. HCFS (Hadoop Compatible Filesystem) URIs of files to be copied
to the working directory of Hadoop drivers and distributed tasks. Useful
for naively parallel tasks.
The HCFS URI of the jar file containing the main class.
Examples:
'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar'
'hdfs:/tmp/test-samples/custom-wordcount.jar'
'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'
public MapField<string, string> Properties { get; }
Optional. A mapping of property names to values, used to configure Hadoop.
Properties that conflict with values set by the Dataproc API might be
overwritten. Can include properties set in /etc/hadoop/conf/*-site and
classes in user code.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-07 UTC."],[[["\u003cp\u003eThis document provides reference documentation for the \u003ccode\u003eHadoopJob\u003c/code\u003e class within the Google Cloud Dataproc v1 API, covering versions from 3.1.0 to the latest 5.17.0.\u003c/p\u003e\n"],["\u003cp\u003eThe \u003ccode\u003eHadoopJob\u003c/code\u003e class is designed for running Apache Hadoop MapReduce jobs on Apache Hadoop YARN within the Google Cloud Dataproc environment.\u003c/p\u003e\n"],["\u003cp\u003eKey features of the \u003ccode\u003eHadoopJob\u003c/code\u003e class include optional configuration settings, such as specifying archive URIs, file URIs, Jar file URIs, and custom properties, used to configure the Hadoop environment.\u003c/p\u003e\n"],["\u003cp\u003eThe class provides options for specifying the main driver class or the HCFS URI of a jar file containing the driver, with members that include \u003ccode\u003eMainClass\u003c/code\u003e and \u003ccode\u003eMainJarFileUri\u003c/code\u003e properties.\u003c/p\u003e\n"],["\u003cp\u003e\u003ccode\u003eHadoopJob\u003c/code\u003e implements several interfaces, including \u003ccode\u003eIMessage\u003c/code\u003e, \u003ccode\u003eIEquatable\u003c/code\u003e, \u003ccode\u003eIDeepCloneable\u003c/code\u003e, and \u003ccode\u003eIBufferMessage\u003c/code\u003e, and inherits members from the base \u003ccode\u003eobject\u003c/code\u003e class, providing functionalities like getting hash codes and type information.\u003c/p\u003e\n"]]],[],null,["# Google Cloud Dataproc v1 API - Class HadoopJob (5.20.0)\n\nVersion latestkeyboard_arrow_down\n\n- [5.20.0 (latest)](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/latest/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.19.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.19.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.18.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.18.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.17.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.17.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.16.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.16.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.15.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.15.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.14.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.14.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.13.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.13.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.12.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.12.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.11.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.11.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.10.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.10.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.9.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.9.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.8.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.8.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.7.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.7.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.6.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.6.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.5.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.5.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.4.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.4.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.3.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.3.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.2.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.2.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.1.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.1.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [5.0.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/5.0.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [4.0.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/4.0.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [3.4.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/3.4.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [3.3.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/3.3.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [3.2.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/3.2.0/Google.Cloud.Dataproc.V1.HadoopJob)\n- [3.1.0](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/3.1.0/Google.Cloud.Dataproc.V1.HadoopJob) \n\n public sealed class HadoopJob : IMessage\u003cHadoopJob\u003e, IEquatable\u003cHadoopJob\u003e, IDeepCloneable\u003cHadoopJob\u003e, IBufferMessage, IMessage\n\nReference documentation and code samples for the Google Cloud Dataproc v1 API class HadoopJob.\n\nA Dataproc job for running\n[Apache Hadoop\nMapReduce](https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html)\njobs on [Apache Hadoop\nYARN](https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-site/YARN.html). \n\nInheritance\n-----------\n\n[object](https://learn.microsoft.com/dotnet/api/system.object) \\\u003e HadoopJob \n\nImplements\n----------\n\n[IMessage](https://cloud.google.com/dotnet/docs/reference/Google.Protobuf/latest/Google.Protobuf.IMessage-1.html)[HadoopJob](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/latest/Google.Cloud.Dataproc.V1.HadoopJob), [IEquatable](https://learn.microsoft.com/dotnet/api/system.iequatable-1)[HadoopJob](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/latest/Google.Cloud.Dataproc.V1.HadoopJob), [IDeepCloneable](https://cloud.google.com/dotnet/docs/reference/Google.Protobuf/latest/Google.Protobuf.IDeepCloneable-1.html)[HadoopJob](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/latest/Google.Cloud.Dataproc.V1.HadoopJob), [IBufferMessage](https://cloud.google.com/dotnet/docs/reference/Google.Protobuf/latest/Google.Protobuf.IBufferMessage.html), [IMessage](https://cloud.google.com/dotnet/docs/reference/Google.Protobuf/latest/Google.Protobuf.IMessage.html) \n\nInherited Members\n-----------------\n\n[object.GetHashCode()](https://learn.microsoft.com/dotnet/api/system.object.gethashcode) \n[object.GetType()](https://learn.microsoft.com/dotnet/api/system.object.gettype) \n[object.ToString()](https://learn.microsoft.com/dotnet/api/system.object.tostring)\n\nNamespace\n---------\n\n[Google.Cloud.Dataproc.V1](/dotnet/docs/reference/Google.Cloud.Dataproc.V1/latest/Google.Cloud.Dataproc.V1)\n\nAssembly\n--------\n\nGoogle.Cloud.Dataproc.V1.dll\n\nConstructors\n------------\n\n### HadoopJob()\n\n public HadoopJob()\n\n### HadoopJob(HadoopJob)\n\n public HadoopJob(HadoopJob other)\n\nProperties\n----------\n\n### ArchiveUris\n\n public RepeatedField\u003cstring\u003e ArchiveUris { get; }\n\nOptional. HCFS URIs of archives to be extracted in the working directory of\nHadoop drivers and tasks. Supported file types:\n.jar, .tar, .tar.gz, .tgz, or .zip.\n\n### Args\n\n public RepeatedField\u003cstring\u003e Args { get; }\n\nOptional. The arguments to pass to the driver. Do not\ninclude arguments, such as `-libjars` or `-Dfoo=bar`, that can be set as\njob properties, since a collision might occur that causes an incorrect job\nsubmission.\n\n### DriverCase\n\n public HadoopJob.DriverOneofCase DriverCase { get; }\n\n### FileUris\n\n public RepeatedField\u003cstring\u003e FileUris { get; }\n\nOptional. HCFS (Hadoop Compatible Filesystem) URIs of files to be copied\nto the working directory of Hadoop drivers and distributed tasks. Useful\nfor naively parallel tasks.\n\n### HasMainClass\n\n public bool HasMainClass { get; }\n\nGets whether the \"main_class\" field is set\n\n### HasMainJarFileUri\n\n public bool HasMainJarFileUri { get; }\n\nGets whether the \"main_jar_file_uri\" field is set\n\n### JarFileUris\n\n public RepeatedField\u003cstring\u003e JarFileUris { get; }\n\nOptional. Jar file URIs to add to the CLASSPATHs of the\nHadoop driver and tasks.\n\n### LoggingConfig\n\n public LoggingConfig LoggingConfig { get; set; }\n\nOptional. The runtime log config for job execution.\n\n### MainClass\n\n public string MainClass { get; set; }\n\nThe name of the driver's main class. The jar file containing the class\nmust be in the default CLASSPATH or specified in `jar_file_uris`.\n\n### MainJarFileUri\n\n public string MainJarFileUri { get; set; }\n\nThe HCFS URI of the jar file containing the main class.\nExamples:\n'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar'\n'hdfs:/tmp/test-samples/custom-wordcount.jar'\n'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'\n\n### Properties\n\n public MapField\u003cstring, string\u003e Properties { get; }\n\nOptional. A mapping of property names to values, used to configure Hadoop.\nProperties that conflict with values set by the Dataproc API might be\noverwritten. Can include properties set in `/etc/hadoop/conf/*-site` and\nclasses in user code."]]
