Compose files for local performance tests
This directory contains docker-compose definition for an ozone cluster where all the metrics are saved to a prometheus instance.
Prometheus follows a pull based approach where the metrics are published on a HTTP endpoint.
Our current approach:
-
A Java agent activates a prometheus metrics endpoint in every JVM instance (use
init.shto download the agent) -
The Java agent publishes all the jmx parameters in prometheus format AND register the endpoint address to the consul.
-
Prometheus polls all the endpoints which are registered to consul.
How to use
First of all download the required Java agent with running ./init.sh
After that you can start the cluster with docker-compose:
docker-compose up -d
After a while the cluster will be started. You can check the ozone web ui-s:
https://localhost:9874 https://localhost:9876
You can also scale up the datanodes:
docker-compose scale datanode=3
Freon (Ozone test generator tool) is not part of docker-compose by default,
you can activate it using compose-all.sh instead of docker-compose:
compose-all.sh up -d
Now Freon is running. Let's try to check the metrics from the local Prometheus:
Example queries:
Hadoop_OzoneManager_NumKeyCommits
rate(Hadoop_OzoneManager_NumKeyCommits[10m])
rate(Hadoop_Ozone_BYTES_WRITTEN[10m])