Blog Archives
1 … 6 7 8 9 10 11 12 13 14 … 30

04: Convert XML file To an Avro File with Apache Spark – writing & reading

This extends Convert XML file To an Avro File – writing & reading. Step 1: The pom.xml file should include the Apache Spark & Avro libraries as shown below.

Step 2: The report.xml file under “src/main/resources/data”. … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: Create new or append to an existing AVRO file tutorial

This extends Create or append a file to HDFS – Hadoop API tutorial to write an AVRO file to HDFS. Step 1: Include the AVRO library files in the pom.xml file.

Step 2: The AVRO files are schema based. … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: Databricks – Spark SCD Type 2

Prerequisite: Extends 03: Databricks – Spark SCD Type 1. What is SCD Type 2 SCD stands for Slowly Changing Dimension, and it was explained in 10 Data warehouse interview Q&As. … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: Docker Tutorial – mount a host directory in a Docker container

mount a host directory into a Docker container so that the folders & files in the host will show up in the Docker container after building the dockerfile. There are a couple ways you can do this. Option 1: ADD In this approach, any changes made to this directory on...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: Drools with rules in an excel spreadsheet – Data validation

This tutorial uses Drools as a validation engine to validate an input csv file. The rules are maintained externally in an excel spreadsheet. Step 1: Create a new Maven project

“-B” means interactive mode is false. Import it into eclipse or IDE of your choice as a maven project....

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: Install AWS CLI to intercat with AWS services like S3

Install Python & pip Step 1: Check if python is already installed. Ubuntu ships with both Python 3 and Python 2 pre-installed.

if already installed, make sure that the versions are up-to-date, as it needs to be either 3.3+ or 2.7+.

If not, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: Interfaces – How will you write a program in Golang using interfaces?

Q01. Why use interfaces in Golang?
A01. The key benefit of using interfaces in Go is that they allow for very flexible, extendable and decoupled code. This lead to cleaner & more flexible code. In Go, an interface is a collection of method signatures that define a set of behaviours that a type must implement to be considered “implementing”

…

Read more ›



04: JasperReport generating a PDF file

This is an extension to the JasperReport step by step tutorial (Part-1) to demonstrate how to generate a a PDF file from the Main.java. To generate a PDF file you  need the iText.jar as a dependency. Here are the Maven dependency files required.

Next, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: JAXB tutorial with XSD & binding.xjb

Step 1: Create a “simple-jaxb” project using Maven

Step 2: Import the project into eclipse with File –> Import –> Existing Maven Projects and choose your folder you just created with pom.xml file “simple-jaxb”. Step 3: select “src/main/resources” … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: Kubernetes concepts like kubectl, contexts, kubeconfig & namespaces

This extends Install Kubernetes (i.e. minikube) on Mac.

Step 1: Start the Docker.app on Mac, and then start the minikube cluster from a terminal.

This creates a local Kubernetes cluster. You can confirm if the Minikube cluster is running with:

Kubectl vs Kubernetes Cluster

A Kubernetes cluster can be created on a cloud like AWS,

…

Read more ›



04: Learn how to connect to HBase from Spark using Java API

These Hadoop tutorials assume that you have installed Cloudera QuickStart, which has the Hadoop eco system like HDFS, Spark, Hive, HBase, YARN, etc. What is HBase? Apache HBase is a NoSQL database used for random and real-time read/write access to your Big Data. It is built on top of the...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: Running a Simple Spark Job in local & cluster modes

Step 1: Create a simple maven Spark project using “-B” for non-interactive mode.

Step 2: Import the maven project “simple-spark” into eclipse. Step 3: The pom.xml file should have the relevant dependency jars as shown below.

Step 4: Write the simple Spark job “SimpleSparkJob.java” … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


04: Spark on Zeppelin – DataFrame joins in Scala

This tutorial extends the series: Spark on Apache Zeppelin Tutorials.

1. Create “Orders” DataFrame

2. Create “Customers” DataFrame

You can perform a number of joins between DataFrames. Default is the inner join. Joins can be of: inner,

…

Read more ›



1 … 6 7 8 9 10 11 12 13 14 … 30

300+ Java Interview Questions - FAQs

Tutorials on Java & Big Data