diff --git a/hadoop-tools/hadoop-sls/README b/hadoop-tools/hadoop-sls/README index 86b554ebb9..3d7912e084 100644 --- a/hadoop-tools/hadoop-sls/README +++ b/hadoop-tools/hadoop-sls/README @@ -8,5 +8,25 @@ SLS runs a regular RM without RPC endpoints and uses a NodeManager and Application Manager simulators to send and receive events simulating cluster and application load behavior. -The size of the cluster and the application load is scripted in a configuration -file. +==== Quick Start ==== + +Let $HADOOP_ROOT represent the Hadoop install directory. If you build Hadoop +yourself, $HADOOP_ROOT is hadoop-dist/target/hadoop-$VERSION. The simulator +is located at $HADOOP_ROOT/share/hadoop/tools/sls. The folder sls contains +four directories: bin (running scripts), html (web portal to view progress), +sample-conf (some example configurations), and sample-data (an example rumen +trace). + +STEP 1: Copy all configuration files (under sample-conf) to $HADOOP_ROOT/etc/hadoop. +STEP 2: Go to the $HADOOP_ROOT/share/hadoop/tools/sls directory, and run the simulator +using the sample rumen trace (under sample-data). + +bin/slsrun.sh —-input-rumen=sample-data/2jobs2min-rumen-jh.json —-output-dir=sample-output + +The simulator will start to run, and you can track the running progress +using its web portal (http://$HOST:10001/simulate, where $HOST is the place +where you run the simulator.). All collected scheduler metrics are stored +under the output-dir during running. This trace takes about 3 mins to finish. + +For more detailed setup, you can check out the document +(http://issues.apache.org/jira/secure/attachment/12604817/YARN-1021.pdf) diff --git a/hadoop-tools/hadoop-sls/src/site/apt/SchedulerLoadSimulator.apt.vm b/hadoop-tools/hadoop-sls/src/site/apt/SchedulerLoadSimulator.apt.vm index 399a1f5e8f..a8b408c7e8 100644 --- a/hadoop-tools/hadoop-sls/src/site/apt/SchedulerLoadSimulator.apt.vm +++ b/hadoop-tools/hadoop-sls/src/site/apt/SchedulerLoadSimulator.apt.vm @@ -225,7 +225,8 @@ Yarn Scheduler Load Simulator (SLS) input traces. The script to start the simulator is <<>>. +----+ -$ $HADOOP_ROOT/share/hadoop/tools/sls/bin/slsrun.sh +$ cd $HADOOP_ROOT/share/hadoop/tools/sls +$ bin/slsrun.sh --input-rumen|--input-sls= --output-dir= [--nodes=] [--track-jobs=] [--print-simulation] @@ -258,7 +259,7 @@ $ $HADOOP_ROOT/share/hadoop/tools/sls/bin/slsrun.sh convert rumen traces to sls traces. +----+ -$ $HADOOP_ROOT/share/hadoop/tools/sls/bin/rumen2sls.sh +$ bin/rumen2sls.sh --rumen-file= --output-dir= [--output-prefix=] diff --git a/hadoop-yarn-project/CHANGES.txt b/hadoop-yarn-project/CHANGES.txt index 2d62d0d21b..8a668933cf 100644 --- a/hadoop-yarn-project/CHANGES.txt +++ b/hadoop-yarn-project/CHANGES.txt @@ -237,6 +237,8 @@ Release 2.7.0 - UNRELEASED YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda) + YARN-1393. SLS: Add how-to-use instructions. (Wei Yan via kasha) + OPTIMIZATIONS BUG FIXES