Workflows in Apache Hadoop
2014-10-03
How to orchestrate your Hadoop Jobs? Possible solutions are:
- Apache Oziee included in the top Hadoop distributions
- Azkaban from LinkedIn
- Luigi from Spotify
- Apache Airflow from AirBnb
See for instance a comparison among luigi, airflow and pinball at http://bytepawn.com/luigi-airflow-pinball.html