Apache > Hadoop > Core
 

Hadoop On Demand

Introduction

Hadoop On Demand (HOD) is a system for provisioning virtual Hadoop clusters over a large physical cluster. It uses the Torque resource manager to do node allocation. On the allocated nodes, it can start Hadoop Map/Reduce and HDFS daemons. It automatically generates the appropriate configuration files (hadoop-site.xml) for the Hadoop daemons and client. HOD also has the capability to distribute Hadoop to the nodes in the virtual cluster that it allocates. In short, HOD makes it easy for administrators and users to quickly setup and use Hadoop. It is also a very useful tool for Hadoop developers and testers who need to share a physical cluster for testing their own Hadoop versions.

Documentation

Please go through the following to know more about using HOD

  • HOD Admin Guide : This guide provides an overview of the HOD architecture, Torque resource manager, and various support tools and utilities, and shows you how to install, configure, and run HOD.
  • Hod Configuration Guide : This guide discusses HOD configuration sections and shows you how to work with the most important and commonly used configuration options.
  • Hod User Guide : This guide shows you how to get started using HOD, reviews various HOD features and command line options, and provides detailed troubleshooting help.