Quick Prep Big Data Interview Archives | Page 12 of 23 | 800+ Java & Big Data Interview Q&As

Blog Archives

« 1 … 8 9 10 11 12 13 14 15 16 … 23 »

12 Amazon Redshift interview Q&As

Q1. What is Amazon Redshift? A1. Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. You can start with just a few hundred gigabytes of data and scale to a petabyte or more. This enables you to use your data to acquire new insights for your...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

12 Kerberos interview Q&As

Q1. What is kerberos? A1. Kerberos is a network authentication protocol designed to provide strong authentication for client/server applications by means of secret-key cryptography. Kerberos ensures the highest level of security to network resources. Q2. What are the 3 key components of Kerberos? … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

12: 50+ SQL scenarios based interview Q&As on N^th value with variations

This extends 50+ SQL scenarios based interview Q&As on Nth value with some variations to practice. Problem statement & considerations Find the 5th highest salary for each department. If the number of highest value for a particular department is less than 5, then display the lowest salary for that department....

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

12: Coding Scala Way – Actors with Akka “Ask Pattern” – Part 2

Actors with Akka “Ask Pattern” is for getting a reply or a response to a message that was sent by a sender. Use ? or ask method. We saw earlier how to send or tell a message to an actor. The Akka Actor Asking for a reply or response The...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

12: PySpark working with SQL syntax Interview Q&As with tutorials

Q37: Can you use SQL in PySpark? A37: Yes, Spark supports both Dataframe APIs and also allows you to integrate SQL queries to work with structured data. The pyspark.sql is a module in PySpark that can be used to perform SQL like operations on the data stored in memory via...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

12: Python enumerate vs zip interview Q&As and tutorial

Use of enumerate & zip are pythonic way of coding. Very common in Python job interviews & code reviews by your seniors or peers. enumerate to iterate over a list with an index The enumerate() function can be used to iterate over indices and items of a list. … Read...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

12: Q78 – Q80 Recursion in Scala Q&As explained with diagrams

Q. Do functional languages handle recursion better than non-functional ones?

A. Yes because they have to. A pure function is a function with no side effects and no state. Not having side effects means you can’t have loop counters as they mutate state,

…

12: Q92 – Q97 Hadoop file formats and how to choose

Q92. What are the criteria for choosing storage file formats in Hadoop? A92. Choosing the wrong file formats can significantly increase the query times and storage spaces. Choosing a format that does not support flexible schema evolution may cost massive re-processing just to add a new field. … Read more...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

13 Apache Sqoop interview Q&As

Q1. What is Apache sqoop? A1. Sqoop is a command-line tool to transfer data between Hadoop and RDBMS (i.e. Relational Database Management Systems). It is used to import data from relational databases such as MySQL, Oracle, Teradata, etc to Hadoop HDFS, and export structured data from Hadoop file system to...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

13: 50+ SQL scenarios based interview Q&As on self-join

Let’s try solving a problem statement given below by creating sample data & then an SQL query on db-fiddle using MySQL v8 database. You can also look at a hierarchical (i.e. tree structure) employees example using a self-join at 50+ SQL scenarios based interview Q&As on joins, CDC and recursive...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

13: Coding Scala Way – 2 Actors with Akka – part 3

This extends Actors with Akka – part 1. This “Akka with actors” shows how messages passed among actors in the system. This is known as the reactor pattern based on the event-driven architecture. Orderplacement.scala with Actors


import akka.actor._;

case class OrderMessage(orderId: String)
case class InvoiceMessage(orderId: String, invoiceId: String)

class OrderingSystem(dispatcher: ActorRef) extends Actor {
  var orderCount = 0;

  def receive = {
    case InvoiceMessage(ordeId, invoiceId) =>
      println("<- Receved invoice " + invoiceId + " for the order " + ordeId)
    case OrderMessage =>
      println("== Placing order")
      orderCount += 1
      dispatcher ! OrderMessage("ORDER-" + orderCount)
  }
}

class DispatchSystem extends Actor {
  var invoiceCount = 0;

  def receive = {
    case OrderMessage(ordeId) =>
      println("-> Receved order " + ordeId)
      println("==> Dispatching the order " + ordeId)
      Thread.sleep(3000)
      invoiceCount += 1
      sender ! InvoiceMessage(ordeId, "INV-" + invoiceCount)
    case _ =>
  }
}

object OrderPlacementSystem extends App {

  val system = ActorSystem("OrderPlacement")
  val dispatcher = system.actorOf(Props[DispatchSystem], name = "dispatcher")
  val ordering = system.actorOf(Props(new OrderingSystem(dispatcher)), name = "order-placer")

  (1 to 5).map(x => ordering ! OrderMessage) //place 5 orders
}

import akka.actor._;

case class OrderMessage(orderId: String)

case class InvoiceMessage(orderId: String, invoiceId: String)

class OrderingSystem(dispatcher: ActorRef) extends Actor {

var orderCount = 0;

def receive = {

case InvoiceMessage(ordeId, invoiceId) =>

println("<- Receved invoice " + invoiceId + " for the order " + ordeId)

case OrderMessage =>

println("== Placing order")

orderCount += 1

dispatcher ! OrderMessage("ORDER-" + orderCount)

}

class DispatchSystem extends Actor {

var invoiceCount = 0;

def receive = {

case OrderMessage(ordeId) =>

println("-> Receved order " + ordeId)

println("==> Dispatching the order " + ordeId)

Thread.sleep(3000)

invoiceCount += 1

sender ! InvoiceMessage(ordeId, "INV-" + invoiceCount)

case _ =>

}

object OrderPlacementSystem extends App {

val system = ActorSystem("OrderPlacement")

val dispatcher = system.actorOf(Props[DispatchSystem], name = "dispatcher")

val ordering = system.actorOf(Props(new OrderingSystem(dispatcher)), name = "order-placer")

(1 to 5).map(x => ordering ! OrderMessage) //place 5 orders

}

Output:


== Placing order
== Placing order
== Placing order
-> Receved order ORDER-1
==> Dispatching the order ORDER-1
== Placing order
== Placing order
-> Receved order ORDER-2
==> Dispatching the order ORDER-2
<- Receved invoice INV-1 for the order ORDER-1
-> Receved order ORDER-3
<- Receved invoice INV-2 for the order ORDER-2
==> Dispatching the order ORDER-3
-> Receved order ORDER-4
<- Receved invoice INV-3 for the order ORDER-3
==> Dispatching the order ORDER-4
-> Receved order ORDER-5
==> Dispatching the order ORDER-5
<- Receved invoice INV-4 for the order ORDER-4
<- Receved invoice INV-5 for the order ORDER-5

== Placing order

-> Receved order ORDER-1

==> Dispatching the order ORDER-1

== Placing order

-> Receved order ORDER-2

==> Dispatching the order ORDER-2

<- Receved invoice INV-1 for the order ORDER-1

-> Receved order ORDER-3

<- Receved invoice INV-2 for the order ORDER-2

==> Dispatching the order ORDER-3

-> Receved order ORDER-4

<- Receved invoice INV-3 for the order ORDER-3

==> Dispatching the order ORDER-4

-> Receved order ORDER-5

==> Dispatching the order ORDER-5

<- Receved invoice INV-4 for the order ORDER-4

<- Receved invoice INV-5 for the order ORDER-5

The system keeps running until you stop the JVM process. …...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

13: PySpark with Apache Kafka Interview Q&As with tutorials – part 1

Q40: What is Spark streaming? What are the benefits of using Apache Kafka with PySpark? A40: Spark streaming is used for real time data processing, which allows you to process from various data sources like Apache Kafka, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

13: Python working with files tutorial

Create a file to read from

$ vi person.txt

1	$ vi person.txt

John, 19, student
Peter, 25, engineer
Sam, 45, manager
Sally, 36, lawyer

John, 19, student

Peter, 25, engineer

Sam, 45, manager

Sally, 36, lawyer

Read from a file ‘r’ is for open file in read mode.

$ python3
>>> f = open('person.txt', 'r')
>>> type(f)
<type 'file'>
>>> print(f.read())
John, 19, student
Peter, 25, engineer
Sam, 45, manager
Sally, 36, lawyer

>>> f.close()
>>>

$ python3

>>> f = open('person.txt', 'r')

>>> type(f)

>>> print(f.read())

John, 19, student

Peter, 25, engineer

Sam, 45, manager

Sally, 36, lawyer

>>> f.close()

>>>

handle exception & close file close( ) the file in the finally block, which will be executed even if an exception is thrown. … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

« 1 … 8 9 10 11 12 13 14 15 16 … 23 »

Blog Archives

12 Amazon Redshift interview Q&As

12 Kerberos interview Q&As

12: 50+ SQL scenarios based interview Q&As on N^th value with variations

12: Coding Scala Way – Actors with Akka “Ask Pattern” – Part 2

12: PySpark working with SQL syntax Interview Q&As with tutorials

12: Python enumerate vs zip interview Q&As and tutorial

12: Q78 – Q80 Recursion in Scala Q&As explained with diagrams

12: Q92 – Q97 Hadoop file formats and how to choose

13 Apache Sqoop interview Q&As

13: 50+ SQL scenarios based interview Q&As on self-join

13: Coding Scala Way – 2 Actors with Akka – part 3

13: PySpark with Apache Kafka Interview Q&As with tutorials – part 1

13: Python working with files tutorial

300+ Java Interview Questions - FAQs

10+ Companion Techs Interview Q&As

300+ Big Data Interview Questions - FAQs

16+ Java Tech Key Areas Interview Q&As

Your Career Tips to go places

Tutorials on Java & Big Data

300+ Java Interview Questions Answered

Disclaimer