Input Data & How Hadoop reads the Data
scores.data in folder:/Users/arulk/projects
|
1 2 3 4 5 6 |
Science, 80, 75, 89, 90 Maths, 90, 87, 78, 92 English, 78, 88, 65, 99 |
Mapper Input
The Hadoop “org.apache.hadoop.mapreduce.lib.input.KeyValueTextInputFormat”…
This extends the Part 1 tutorial 1. Hadoop MapReduce Basic Tutorial. The key difference of this tutorial is using a “TextInputFormat” instead of “KeyValueTextInputFormat“.
TextInputFormat reads
The key as line offset number starting from 0 and the values as “Science, 80, 75, 89, 90” from the Scores.data…
This tutorial extends 1. HBase Tutorial Getting Started & 1. Hadoop MapReduce Basic Tutorial to read an HBase table with data from the mapper and write the max marks for each subject to another HBase table from the reducer..
Input Data Marks secured by 4 students
|
1 2 3 4 5 |
Science, 80, 75, 89, 90 Maths, 90, 87, 78, 92 English, 78, 88, 65, 99 |
Step 1: Let’s store this Data in HBase database as described in tutorial 1.…