Running Terasort with DMExpress 7.13.4

The 7.13.4 release of the DMEXpress custom sorting algorithm writes temporary sorting data to the directory specified by the Hadoop property mapred.local.dir.

To run Terasort with the 7.13.4 release of DMExpress, use the following command:

# hadoop jar /opt/mapr/hadoop/hadoop-0.20.2/hadoop-0.20.2-dev-examples.jar terasort -Dmapreduce.job.map.output.collector.class=com.syncsort.dmexpress.hadoop.DMXMapOutputCollector -Dmapreduce.job.reduce.shuffle.consumer.plugin.class=com.syncsort.dmexpress.hadoop.DMXShuffleConsumerPlugin -Ddmx.home.dir=/usr/dmexpress -Ddmx.key.length=10 -D dmx.reduce.memory=3072 -D dmx.map.memory=1536 -libjars dmxhadoop_mrv1_mapr.jar -Dmapred.local.dir=/mapr/dmx/scratchSpace -Ddmx.mapr.nfs.mount=/mapr/perf /tsort_in/in /tsort_out/out