Hadoop is an open source Java‐based programming framework that supports the processing of large data sets in a distributed computing environment. To process and store the data, It utilizes inexpensive, industry‐standard servers. The key features of Hadoop are Cost effective system, Scalability, Parallel processing of distributed data, Data locality optimization, Automatic failover management and supports large clusters of nodes.

Hadoop admin is responsible for capacity planning and estimating the requirements for decreasing or increasing the capacity of the hadoop cluster. Hadoop admin is also responsible for deciding the size of the hadoop cluster based on the data to be stored in HDFS. The Hadoop frameworks comprised of two main core components i.e. HDFS and MapReduce framework.