Posts

how to collect cloudera manager usage data with google analytics

The Cloudera Manager is already capable of tracking usage data via Google Analytics, but that data is beeing send to a cloudera account. This blog post is about configuring the cloudera manager and changing the tracking id so that these usage metrics are being send to your own account.

Setup Google Analytics

Log into your Google Analytics account and create a new tracking id (looks like UA-XXXXXXX-X).

Enable the tracking of usage data

Log into your Cloudera Manager instance and browse to “Administration” -> “Settings”

add_google_analytics_cloudera_manager_01

and make sure that “Allow Usage Data Collection” is enabled:

add_google_analytics_cloudera_manager_02

replace the tracking id

Now you need to edit a file on your Cloudera Manager server

cd /usr/share/cmf/webapp/static/ext/google-analytics/
nano scmx.js

And replace the existing google apps tracking id (UA-XXXXXXX-X) with your own id and save the file.

add_google_analytics_cloudera_manager_03

You change will be immediately active (no need to restart anything).

Be aware that this change will be overwritten when you update your Cloudera Manager instance so you need to reapply that change after every upgrade.

oozie-graphite available for CDH5

Our open source project oozie-graphite is now available for CDH5.
Read more

Oozie bundle monitoring: tapping into hadoop counters

This is the first post about GraphiteMRCounterExecutor use cases: we start by utilizing already available hadoop counters that deliver very valueable graphs.
Read more

Oozie monitoring : coordinator action timeouts

The internal Oozie instrumentation increments counters for various coordinator related actions. Graphing a subset of these counters by utilizing oozie-graphite gives you a good visualisation of your coordinator actions waiting for data to become available and if these dependencies were finally fulfilled or if they did timeout eventually.
Read more

Oozie monitoring: graphing action performance

The internal Oozie instrumentation keeps track of average execution times for each action type. Graphing a subset of these metrics by utilizing oozie-graphite gives you a good visualisation of your coordinator action performance, especially if you are running custom oozie actions.
Read more

Open sourcing oozie-graphite

We’ve open sourced some very useful glue for Oozie monitoring with graphite on github.
Read more