Hadoop is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without understanding the underlying details of distributed systems, fully leveraging the power of clusters for high-speed computation and storage. Hadoop implements a distributed file system called HDFS (Hadoop Distributed File System). HDFS features high fault tolerance and is designed to be deployed on low-cost hardware. Furthermore, it provides high throughput access to application data, making it suitable for applications with very large data sets. HDFS relaxes POSIX requirements to allow streaming access to file system data.
The following diagram illustrates Hadoop’s architecture:
