HDFS: The Backbone of Big Data - A Review of High Availability, Scalability, and Performance Using Quorum Journal Manager and Dynamic Federated Metadata Management

Working in tandem, the Hadoop Distributed File System (HDFS) plays a crucial role in managing large-scale data across distributed clusters. The basic structure of HDFS comprises the NameNode, which manages the file system namespace and client interactions, and the Data Nodes, which handle storage and data arrangement duties. Although HDFS faces constraints, particularly regarding scaling the NameN…