
Oozie bundle monitoring: tapping into hadoop counters
This is the first post about GraphiteMRCounterExecutor use cases: we start by utilizing already available hadoop counters that deliver very valueable graphs.
This is the first post about GraphiteMRCounterExecutor use cases: we start by utilizing already available hadoop counters that deliver very valueable graphs.
A step-by-step guide on how to install oozie-graphite’s GraphiteMRCounterExecutor. This blog entry is a step-by-step guide for the GraphiteMRCounterExecutor module installation.
The internal Oozie instrumentation increments counters for various coordinator related actions. Graphing a subset of these counters by utilizing oozie-graphite gives you a good visualisation of your coordinator actions waiting for data to become available and if these dependencies were finally fulfilled or if they did timeout eventually.
The internal Oozie instrumentation keeps track of average execution times for each action type.
A step-by-step guide on how to install oozie-graphite’s GraphiteInstrumentationService. This blog entry is a step-by-step guide for the GraphiteInstrumentationService module installation.
We’ve open sourced some very useful glue for Oozie monitoring with graphite on github.