Apache Hadoop is free open Source software for massive distributed computation and Big Data storage. It can store PetaBytes of data and process it very fast. It does it using a cluster of many commodity servers (nodes) where each data node stores a portion of the data and is used as a compute node to process its local data. Hadoop eco systems use Map Reduce model to be able to compute huge amounts of data at great speed. The Map does the filtering and sorting in local nodes and reduces the summary operation on all nodes output .
Hadoop storage layer is based on HDFS – Hadoop Distributed file system. Where Hadoop splits files into large blocks and distributes them between the cluster data nodes.
HDFS storage have following advantages:
The Hadoop ecosystem can be extended with sub modules , software packages that can be installed on top or alone side Hadoop , such as Apache Hive , Apache HBase , Apache Spark , Impala and so On .
Hadoop comes today in 2 main distributions which can be free or licensed:
Hortonworks and Cloudera have been merged in 2019.
Hadoop is a great solution for on premise Big Data warehouses or data lakes where data is stored in batches and fast analytics on huge data is required + the licence is free.
MySQL Galera Cluster Introduction MySQL Galera cluster is the common solution for MySQL high availability and bring