4d4dde5112
Signed-off-by: Akira Ajisaka <aajisaka@apache.org> |
||
---|---|---|
.. | ||
dev-support | ||
src | ||
pom.xml | ||
README |
Yarn Scheduler Load Simulator (SLS) SLS is a stress and performance harness for the Yarn Resource Manager Scheduler that exercises the scheduler implementation simulating the cluster size and the applications load without having to have a cluster nor applications. SLS runs a regular RM without RPC endpoints and uses a NodeManager and Application Manager simulators to send and receive events simulating cluster and application load behavior. ==== Quick Start ==== Let $HADOOP_ROOT represent the Hadoop install directory. If you build Hadoop yourself, $HADOOP_ROOT is hadoop-dist/target/hadoop-$VERSION. The simulator is located at $HADOOP_ROOT/share/hadoop/tools/sls. The folder sls contains four directories: bin (running scripts), html (web portal to view progress), sample-conf (some example configurations), and sample-data (an example rumen trace). STEP 1: Copy all configuration files (under sample-conf) to $HADOOP_ROOT/etc/hadoop. STEP 2: Go to the $HADOOP_ROOT/share/hadoop/tools/sls directory, and run the simulator using the sample rumen trace (under sample-data). bin/slsrun.sh —-input-rumen=sample-data/2jobs2min-rumen-jh.json —-output-dir=sample-output The simulator will start to run, and you can track the running progress using its web portal (http://$HOST:10001/simulate, where $HOST is the place where you run the simulator.). All collected scheduler metrics are stored under the output-dir during running. This trace takes about 3 mins to finish. For more detailed setup, you can check out the document (http://issues.apache.org/jira/secure/attachment/12604817/YARN-1021.pdf)