This extends 1. HBase Tutorial Getting Started. You can learn HBase basics at HBase interview Questions & Answers.
Step 1: Unlike relational databases, the NoSQL databases are semi-structured, hence you can add new columns on the fly. In HBase, you can define the table name and the column family first and then new columns for a column family can be added programmatically on the fly.
…
Prerequisite: Extends Databricks – Spark ML Random Forrest Classifier. Q. What is K-Means algorithm? A. K-Means is an unsupervised algorithm, hence it does only have “features“, … Read more ›...
This extends Docker Tutorial: BigData on Cloudera quickstart via Docker. Step 1: Run the container on a command line.
|
1 2 3 |
~/projects/docker-hadoop]$ docker run --hostname=quickstart.cloudera \ --privileged=true -t -i -v /Users/arulkumarankumaraswamipillai/projects/docker-hadoop:/src \ --publish-all=true -p 8888:8888 -p 80:80 -p 7180:7180 cloudera/quickstart /usr/bin/docker-quickstart |
Step 2: Java is already installed as part of the “cloudera/quickstart” docker image.
|
1 2 3 4 5 |
[root@quickstart /]# java -version java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode) |
update-alternatives If you have multiple versions or installations of Java, … Read more ›...
In Maven, there are build and the reporting plugins. Build plugins will be executed during the build, and they should be configured in the “build” element.
What is a “Plugin Architecture”?
In this architecture, a core application defines an interface,
…
Prerequisite: Extends 16: Databricks – Spark ML Multiclass Logistic Regression & Pipeline. Problem statement: Predict the iris flower species based on its sepal & petal length & width. Independent Variables (aka features): sepal length in cm, … Read more ›...
Extends 20: Docker Tutorial: Apache Spark-submit in Java – on Cloudera quickstart, and Docker Tutorial: BigData on Cloudera quickstart via Docker. Step 1: Run the container on a command line.
|
1 2 3 |
~/projects/docker-hadoop]$ docker run --hostname=quickstart.cloudera \ --privileged=true -t -i -v /Users/arulkumarankumaraswamipillai/projects/docker-hadoop:/src \ --publish-all=true -p 8888:8888 -p 80:80 -p 7180:7180 cloudera/quickstart /usr/bin/docker-quickstart |
Install Java 8 Step 2: Install Java 8. … Read more ›...
Extends 20: Docker Tutorial: Apache Spark-submit in Java – on Cloudera quickstart, and Docker Tutorial: BigData on Cloudera quickstart via Docker. Step 1: Run the container on a command line.
|
1 2 3 |
~/projects/docker-hadoop]$ docker run --hostname=quickstart.cloudera \ --privileged=true -t -i -v /Users/arulkumarankumaraswamipillai/projects/docker-hadoop:/src \ --publish-all=true -p 8888:8888 -p 80:80 -p 7180:7180 cloudera/quickstart /usr/bin/docker-quickstart |
Python version Step 2: The cloudera/quickstart comes with Python 2.6. … Read more ›...
Prerequisite: Extends 03: Databricks – Spark SCD Type 1. Note: databricks-connect let’s you connect your favourite IDE to your Databricks cluster. This allows you to lint, test, and package the code that you want to run on Databricks as explained in Enhance Your Databricks Workflow. … Read more ›...
Prerequisite: Docker is installed on your Windows or Mac, and you have a basic understanding of Docker. Docker tutorials step by step | Hadoop, Hive, Impala & Spark on Cloudera quickstart on Docker tutorials
Step 1: Pull the modified image “gdancik/cloudera”
…
Prerequisite: Databricks – Spark SCD Type 1. Delta Lake bring features like ACID Transactions, Scalable metadata, time travel, etc to a Data Lake. Databricks notebook has delta-spark package preinstalled. … Read more ›...
This extends Docker Tutorial: BigData on Cloudera quickstart via Docker. Step 1: Run the container on a command line.
|
1 2 3 4 |
~/projects/docker-hadoop]$ docker run --hostname=quickstart.cloudera \ --privileged=true -t -i -v /Users/arulkumarankumaraswamipillai/projects/docker-hadoop:/src \ --publish-all=true -p 8888:8888 -p 80:80 -p 7180:7180 \ cloudera/quickstart /usr/bin/docker-quickstart |
hbase cli We are going to focus on “shell” command to create a table, column-families, and columns, … Read more ›...
This tutorial extends Getting started with Databricks. Currently spark does not support recursion like you can use in SQL via “Common Table Expression“.
Step 1: Login to Databricks notebook:
https://community.cloud.databricks.com/login.html.
Step 2: Create a CLUSTER and it will take a few minutes to come up.
…
This extends Docker Tutorial: BigData on Cloudera quickstart via Docker. Step 1: Run the container on a command line.
|
1 2 3 4 |
~/projects/docker-hadoop]$ docker run --hostname=quickstart.cloudera \ --privileged=true -t -i -v /Users/arulkumarankumaraswamipillai/projects/docker-hadoop:/src \ --publish-all=true -p 8888:8888 -p 80:80 -p 7180:7180 \ cloudera/quickstart /usr/bin/docker-quickstart |
Install maven Step 2: Download maven from “http://mirror.ventraip.net.au/apache/maven/maven-3/3.6.1/binaries/apache-maven-3.6.1-bin.tar.gz”
|
1 2 |
[root@quickstart /]# sudo curl -L -O http://mirror.ventraip.net.au/apache/maven/maven-3/3.6.1/binaries/apache-maven-3.6.1-bin.tar.gz |
|
1 2 3 4 5 |
[root@quickstart /]# cp apache-maven-3.6.1-bin.tar.gz /opt [root@quickstart /]# cd /opt [root@quickstart /]# sudo tar xvfz apache-maven-3.6.1-bin.tar.gz [root@quickstart /]# sudo rm -f apache-maven-3.6.1-bin.tar.gz |
Step 3: Add it to your profile so that you can run the “mvn” … Read more ›...
I have a good news, I got job offer. I like to share with you from my bottom of my heart feeling thankful to you.