Hadoop CLI MiniCluster

CLI MiniCluster

Use the climonicluster, users can simply start and stop a single-node hadoop cluster witha single command, and without the need to set any environment variables ormanage configuration files. The cli monicluster starts both a mapreduce and hdfclusters. This is useful cases where users want to quickly experiment with areal hadoop cluyster or test non-java programs that rely on significant hadoopfunctionality.

From inside theroot directory of the extracted tarball, you can tsrat the cli miniclusterusing the following command:

$ bin/hadoop jarhadoop-test-*.jar minicluster -jtport JT_PORT -nnport NN_PORT

In the example command above,JT_PORT and NN_PORT should be replaced by the user's choice of these portnumbers. If not specified, random free ports will be used.

$ bin/hadoop jarhadoop-test-*.jar minicluster -jtport JT_PORT -nnport NN_PORT

Unknown program'minicluster' chosen.

Valid program namesare:

DFSCIOTest: Distributed i/o benchmark oflibhdfs.

DistributedFSCheck: Distributed checkup ofthe file system consistency.

MRReliabilityTest: A program that tests thereliability of the MR framework by injecting faults/failures

TestDFSIO: Distributed i/o benchmark.

dfsthroughput: measure hdfs throughput

filebench: BenchmarkSequenceFile(Input|Output)Format (block,record compressed and uncompressed),Text(Input|Output)Format (compressed and uncompressed)

loadgen: Generic map/reduce load generator

mapredtest: A map/reduce test check.

mrbench: A map/reduce benchmark that cancreate many small jobs

nnbench: A benchmark that stresses thenamenode.

testarrayfile: A test for flat files ofbinary key/value pairs.

testbigmapoutput: A map/reduce program thatworks on a very big non-splittable file and does identity map/reduce

testfilesystem: A test for FileSystemread/write.

testipc: A test for ipc.

testmapredsort: A map/reduce program thatvalidates the map-reduce framework's sort.

testrpc: A test for rpc.

testsequencefile: A test for flat files ofbinary key value pairs.

testsequencefileinputformat: A test forsequence file input format.

testsetfile: A test for flat files of binarykey/value pairs.

testtextinputformat: A test for text inputformat.

threadedmapbench: A map/reduce benchmark thatcompares the performance of maps with multiple spills over maps with 1 spill