Tutorials Archives | Page 7 of 30 | 800+ Java & Big Data Interview Q&As

Blog Archives

« 1 … 3 4 5 6 7 8 9 10 11 … 30 »

02a: Learn Spark writing to Avro using Avro IDL

What is Avro IDL? Avro IDL (i.e. Interface Description Language) is a high-level language to write Avro schemata. You can generate Java, C++, and Python objects from the Avro IDL files. These files generally have the “.avdl” extension. Step 1: Write the “order.avdl” … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

02a: ⏯ JDBC with MySQL, Datasource, Connection Pool, and Prepared Statements Video Tutorial

Related Links 1. JDBC with MySQL, Datasource, and connection pool Tutorial. 2. JDBC with MySQL and PreparedStatements Tutorial. Extends ⏯ MySQL database beginner video tutorial ▶ JDBC with MySQL Beginner Video Tutorial JDBC Interview Q&As 1. … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

02a. ⏯ Getting started with Java packages, projects, classpath & jar files video tutorial

02b. ⏯ Java project with third-party libraries & unit testing without an IDE

03: Akka tutorial “ask” request – response pattern in Java

This tutorial extends the previous tutorial Simple Akka tutorial in Java step by step to apply the Ask pattern. Tell is a “Fire-and-Forget” pattern, and whereas an “ask” sends a message with a Future for the response. Request-Response pattern in Akka with “Ask”… Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

03: Akka tutorial “ask” request – response pattern Scala way

This tutorial extends Simple Akka Tutorial in Scala step by step for the Java developers and Akka tutorial “ask” request – response pattern in Java. Request-Response pattern in Akka with “Ask” Step 1: The “Producer.java” using the “ask” pattern to send a mesage and then receive response via a Future...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

03: Apache Kafka Connector Tutorial

This extends the Getting started with Apache Kafka on Mac tutorial. Kafka works with different kinds of data sources like file, JDBC, JMS, etc. What is the purpose of a Kafka connector?… Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

03: Apache Kafka example with toxiproxy & Producer timeout handling

This extends Apache Kafka example with Java Producer & Consumer Tutorial – Part 2. This covers Apache Kafka example with toxiproxy & producer timeout. The producer code needs to be robust to handle any network issues like timeouts & latency issues. In this tutorial a tool named toxiproxy is used to simulate network issues.

…

03: Apache Spark cluster – Docker compose tutorial with Java, Maven & spark-shell

This extends 01: Docker tutorial with Java & Maven. Step 1: Create a Docker network where all 3 containers – Spark master (i.e. Stand-alone cluster manager), Spark worker, and Spark driver will be deployed to.

docker network create docker_test_infra || true

1 2	docker network create docker_test_infra \|\| true

Step 2: The image docker file “ … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

03: Convert XML file To an Avro File – writing & reading

This extends the Convert XML file To Sequence File With Hadoop libaries. Avro files are schema driven & support schema evolution, which means you can add new columns & modify existing columns. Step 1: The pom.xml file should include the Apache Spark libraries as shown below. … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

03: Create or append a file to HDFS – Hadoop API tutorial

Step 1: Create a simple maven project named “simple-hadoop“.


mvn archetype:generate -B -DgroupId=com.mytutorial -DartifactId=simple-hadoop

mvn archetype:generate -B -DgroupId=com.mytutorial -DartifactId=simple-hadoop

Step 2: Import the “simple-hadoop” maven project into eclipse or IDE of your choice. Step 3: Modify the pom.xml file include 1) relevant Hadoop libraries 2) The shade plugin to create a single jar (i.e. … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

03: Databricks – Spark SCD Type 1

Prerequisite: Extends Databricks getting started – Spark, Shell, SQL.

What is SCD Type 1

SCD stands for Slowly Changing Dimension, and it was explained in 10 Data warehouse interview Q&As.

…

03: Docker Tutorial – Java & Maven with a jar file

This extends the 01: Docker Tutorial – compile & run Helloworld.java. Maven pom.xml

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
  <modelVersion>4.0.0</modelVersion>
  <groupId>com.myapp</groupId>
  <artifactId>helloworld</artifactId>
  <version>1.0</version>
 
  <build>
    <plugins>
      <plugin>
        <!-- Build an executable JAR -->
        <groupId>org.apache.maven.plugins</groupId>
        <artifactId>maven-jar-plugin</artifactId>
        <version>3.1.0</version>
        <configuration>
          <archive>
            <manifest>
              <addClasspath>true</addClasspath>
              <classpathPrefix>lib/</classpathPrefix>
              <mainClass>com.myapp.Helloworld</mainClass>
            </manifest>
          </archive>
        </configuration>
      </plugin>
    </plugins>
  </build>
</project>

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"

xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">

<groupId>com.myapp</groupId>

<artifactId>helloworld</artifactId>

<build>

<groupId>org.apache.maven.plugins</groupId>

<artifactId>maven-jar-plugin</artifactId>

<mainClass>com.myapp.Helloworld</mainClass>

</manifest>

</archive>

</configuration>

</plugin>

</plugins>

</build>

</project>

The run.sh file

#!/bin/bash

mvn clean package
chmod -R +x target/helloworld-1.0.jar
java -jar target/helloworld-1.0.jar

#!/bin/bash

mvn clean package

chmod -R +x target/helloworld-1.0.jar

java -jar target/helloworld-1.0.jar

Create src/main/java folder Maven requires .java files to be in the folder src/main/java folder. So create the folder and move com/myapp/* under that as shown in the above diagram. … Read more...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

« 1 … 3 4 5 6 7 8 9 10 11 … 30 »

Blog Archives

02a: Learn Spark writing to Avro using Avro IDL

02a: ⏯ JDBC with MySQL, Datasource, Connection Pool, and Prepared Statements Video Tutorial

02a. ⏯ Getting started with Java packages, projects, classpath & jar files video tutorial

02b. ⏯ Java project with third-party libraries & unit testing without an IDE

03: Akka tutorial “ask” request – response pattern in Java

03: Akka tutorial “ask” request – response pattern Scala way

03: Apache Kafka Connector Tutorial

03: Apache Kafka example with toxiproxy & Producer timeout handling

03: Apache Spark cluster – Docker compose tutorial with Java, Maven & spark-shell

03: Convert XML file To an Avro File – writing & reading

03: Create or append a file to HDFS – Hadoop API tutorial

03: Databricks – Spark SCD Type 1

03: Docker Tutorial – Java & Maven with a jar file

300+ Java Interview Questions - FAQs

10+ Companion Techs Interview Q&As

300+ Big Data Interview Questions - FAQs

16+ Java Tech Key Areas Interview Q&As

Your Career Tips to go places

Tutorials on Java & Big Data

300+ Java Interview Questions Answered

Disclaimer