Step 1: Download the latest version of “Apache Hadoop common” from http://apache.claz.org/hadoop using wget, curl or a browser. This tutorial uses “http://apache.claz.org/hadoop/core/hadoop-2.7.1/”.
Step 2: You can set Hadoop environment variables by appending the following commands to ~/.bashrc file.
|
1 2 3 4 5 6 7 8 9 10 11 12 13 |
export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1. |
This extends Hadoop MapReduce Basic Tutorial and Apache Hadoop HDFS Tutorial. This could have have been done on the command-line as shown below after running “start-dfs.sh” to start the name and data nodes.
|
1 2 3 |
hadoop fs -copyFromLocal localfile.txt / |
The focus of this tutorial is to do the same via Java and Hadoop APIs.…
Step 1: Create a simple maven project named “simple-hadoop”.
|
1 2 3 |
mvn archetype:generate -B -DgroupId=com.mytutorial -DartifactId=simple-hadoop |
Step 2: Import the “simple-hadoop” maven project into eclipse or IDE of your choice.…
This extends Create or append a file to HDFS – Hadoop API tutorial to write an AVRO file to HDFS. Step 1: Include the AVRO library files in the pom.xml…
Login Register 100+ Free Java interview FAQs 100+ Free Big Data interview FAQs
The following tutorial extends Create or append a file to HDFS – Hadoop API tutorial, and Create or append an AVRO file to HDFS – Hadoop & AVRO API tutorial….
Login Register 100+ Free Java interview FAQs 100+ Free Big Data interview FAQs