how to use dynamic allocation in a oozie spark action on CDH5
using spark’s dynamic allocation feature in a oozie spark action can be a tricky.
spark oozie action jobs not showing up on spark history server
If you execute spark jobs within an oozie workflow using a action node on a Cloudera CDH5 cluster, your job may not show up on your spark history server. Even if you configured all these things using the cloudera manager, your history server may only lists jobs started on the commandline using spark-submit.
Patching Oozie in a parcel-based CDH 5.8.0 Installation
This blogpost will guide you to the process of cloning, patching, building and deploying a custom version of the oozie workflow engine based on the cdh 5.8.0 source code that is available on github.
how to access a remote ha-enabled hdfs in a (oozie) distcp action
how to inject the configuration of a remote ha-hdfs in a distcp call without modifing the local cluster configuration.
Passing many parameters from Java action to Oozie workflow
oozie’s ‘capture-output’ is a powerful method the pass dynamic configuration properties from action to action, but you may hit the maximum size limit quite fast.
Using Accumulos RangePartioner in a m/r job (and Oozie workflow)
How to use Accumulos RangePartioner to increase your mr-job ingest rate (and the neccessary pieces to include it into an oozie worflow)