Modern Big Data Processing with Hadoop

Apache Hive

Hive is a data processing tool in Hadoop. As we have learned in the previous chapter, data ingestion tools load data and generate HDFS files in Hadoop; we need to query that data based on our business requirements. We can access the data using MapReduce programming. But data access with MapReduce is extremely slow. To access a few lines of HDFS files, we have to write separate mapper, reducer, and driver code. So, in order to avoid this complexity, Apache introduced Hive. Hive supports an SQL-like interface that helps access the same lines of HDFS files using SQL commands. Hive was initially developed by Facebook but was later taken over by Apache.