Submitting Jobs and Applications to the Cluster

You can submit MapReduce v1 jobs and YARN applications (MapReduce v2 and other applications that run on YARN) to the same cluster. A job or an application can be submitted to the cluster in the following ways:

  • The hadoop jar command submits a MapReduce v1 job or MapReduce v2 application.
  • The yarn jar command submits an application.
  • An external application submits a MapReduce v1 job or an application.
  • An ecosystem component generates and submits an application or a MapReduce v1 job.
  • The hadoop job command submits a MapReduce v1 job or MapReduce v2 application.
  • The mapred job command submits a MapReduce v2 application.

When you submit a MapReduce v1 job or MapReduce v2 application to the cluster, it is important to be aware of the MapReduce mode that will be used.

When you submit a non-MapReduce job or application to the cluster, such a Spark application, the application is automatically processed using yarn mode (ResourceManager, NodeManager, and MapReduce ApplicationMaster).

Note: The method to submit Hadoop commands from a Windows or Mac client is different, For details, see Setting Up the Client.