Quick Prep Big Data Interview Archives | Page 9 of 23 | 800+ Java & Big Data Interview Q&As

Blog Archives

« 1 … 5 6 7 8 9 10 11 12 13 … 23 »

08: Q19 – Q26 Scala Data Structures basics interview questions & answers

Q19. What is the use of Tuples in Scala? A19. A Tuple is an immutable collection that can hold objects of different types. In other words, it groups together logical collections of items without using a class. There are 22 Tuple class in Scala from Tuple1, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

08: Q49 – Q58 Scala Implicits Interview Q&As

Q49A. What are implicits in Scals? A49A. Implicits in Scala has two related features. 1) Implicit Parameters 2) Implicit Conversions. In both cases the Scala compiler implicitly provides extra information to prevent compile errors. 1. Implicit Parameters The code without implicits:


object ImplicitParameters extends App {
  
  def sum(x: Int)(y: Int) = x + y
  
  println(sum(10)(5)) // ok
  println(sum(10))   //compile-error: missing argument
}

object ImplicitParameters extends App {

def sum(x: Int)(y: Int) = x + y

println(sum(10)(5)) // ok

println(sum(10)) //compile-error: missing argument

}

The code with implicit parameters: Implicit parameters are...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

08: Q71 – Q75 ETL/ELT on BigData Interview Q&As

Q71. Can ETL in traditional data management (E.g. RDBMs) be migrated to EDH (i.e. Enterprise Data Hub) powered by Hadoop eco system? A71. Yes, it can be migrated, but it is not a direct & straight forward migration as there is a mismatch in underpinning concepts & … Read more...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

09: 50+ SQL scenarios based interview Q&As on GROUP_CONCAT() & STRING_AGG()

This post covers an SQL scenario, and how to solve it with NON ANSI 92 aggregate functions. Refer to your database documentation for the additional aggregate functions. In this post let’s look at how to implode or concatenate multiple row column values into a single column. Problem statement &… Read...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

09: Coding Scala Way – Fibonacci Series

Example #22: Fibonacci series in Scala This extends determine the nth fibonacci number using Scala. In this let’s print the Fibonacci series of length n.


import scala.annotation.tailrec

object Fibonacci extends App {
  
   val zero = BigInt(0)
  
   def fibTail(n: Long): BigInt = {
     
    if (n <= 1) return 1 

    @tailrec
    def fibRecursion(a: BigInt, b: BigInt, n: BigInt): BigInt = {
      
      n match  {
        case `zero` => b  //wrap with "`" to match against a variable
        case _ => fibRecursion(b, a + b, n - 1)
      }    
    }
    
    fibRecursion(1, 1, n - 2)  
  }
   
  def fibSeries(n: Long) = (1L to n).map (n => fibTail(n)) 
  
  fibSeries(12).foreach {x => print(x + ", ") }
  
}

import scala.annotation.tailrec

object Fibonacci extends App {

val zero = BigInt(0)

def fibTail(n: Long): BigInt = {

if (n <= 1) return 1

@tailrec

def fibRecursion(a: BigInt, b: BigInt, n: BigInt): BigInt = {

n match {

case `zero` => b //wrap with "`" to match against a variable

case _ => fibRecursion(b, a + b, n - 1)

}

fibRecursion(1, 1, n - 2)

}

def fibSeries(n: Long) = (1L to n).map (n => fibTail(n))

fibSeries(12).foreach {x => print(x + ", ") }

}

Output:


1, 1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144,

1, 1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144,

Q1 Is the above approach to “print the Fibonacci series of length n” … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

09: Databricks interview questions & answers on optimization – Liquid Clustering & Photon accelerator

Here are more performance optimization techniques in Databaricks. Q01. What is Delta Lake liquid clustering? A01. Delta Lake liquid clustering replaces table partitioning and ZORDER to simplify data layout decisions and optimize query performance. Liquid clustering provides flexibility to redefine clustering keys without rewriting existing data, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

09: PySpark GroupBy & explode functions Interview Q&As with tutorials

Given the below file employee_by_prog_lanuguage.csv in a folder named /tmp.


emp_id, emp_name, prog_lang
1, John, Java
2, Peter, Scala
2, Peter, Python
2, Peter, Spark
1, John, JEE
6, Elliot, Unix

emp_id, emp_name, prog_lang

1, John, Java

2, Peter, Scala

2, Peter, Python

2, Peter, Spark

1, John, JEE

6, Elliot, Unix

Q24: Given the above file, how will display all prog_lang as a list against each emp_name? Each emp_name should be on a single row. A24: The functions in pyspark.sql.functions module collect_list(..) to the rescue with the groupBy function in...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

09: Python working with String tutorial

Strings in Python can be defined using either single or double quotations as they are functionally equivalent. In addition, it is possible to define multi-line strings using a triple-quote syntax: find() method finds the first occurrence of the specified value. … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

09: Q59 – Q65 Higher Order Functions in Scala Interview Q&As

Q59. What is a higher order function, and what is the purpose of higher order functions? A59. Higher-order functions are functions that take functions as parameters. This gives you opportunities to condense and simplify code. The most used methods in the entire Collection API like map, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

09: Q76– Q88 Apache Hive partitioning, bucketing, map join, skewed data, vectorization & denormalization interview Q&As

This extends Apache Hive basics interview questions & answers. Q76. What are the 3 key considerations in processing data in HDFS compared to traditional RDBMS or EDW (i.e. Enterprise Data Warehouse)? AQ76. 1) partitioning, 2) bucketing, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

10 Apache Hive scenarios interview Q&As on backup, repair, partition, drop, etc

Q01: How do you back up an external with Data? A01 You can use CTAS (i.e. CREATE TABLE AS SELECT ) statement as shown below.


hive> CREATE TABLE mydb.my_table_20211117
AS SELECT * FROM mydb.my_table;

hive> CREATE TABLE mydb.my_table_20211117

AS SELECT * FROM mydb.my_table;

Q02: What if the table you are backing up is partitioned? … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

10 Distributed storage & computing systems interview Q&As – Big Data

A distributed system consists of multiple software components that are on multiple computers (aka nodes), but run as a single system. These components can be stateful, stateless, or serverless, and these components can be created in different languages running on hybrid environments, using open-source technologies, open standards, and interoperability.

Q01.

…

10 ERD (Entity-Relationship Diagrams) Interview Q&As

Q01. Can you describe a business domain of a Telecom company offering multiple services to its customers? A01. A Telecom company will have entities such as Customer, Account, Subscriptions & Products representing a business domain. 1) Each customer entity has a name, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs

Already a member? Log in here

« 1 … 5 6 7 8 9 10 11 12 13 … 23 »

Blog Archives

08: Q19 – Q26 Scala Data Structures basics interview questions & answers

08: Q49 – Q58 Scala Implicits Interview Q&As

08: Q71 – Q75 ETL/ELT on BigData Interview Q&As

09: 50+ SQL scenarios based interview Q&As on GROUP_CONCAT() & STRING_AGG()

09: Coding Scala Way – Fibonacci Series

09: Databricks interview questions & answers on optimization – Liquid Clustering & Photon accelerator

09: PySpark GroupBy & explode functions Interview Q&As with tutorials

09: Python working with String tutorial

09: Q59 – Q65 Higher Order Functions in Scala Interview Q&As

09: Q76– Q88 Apache Hive partitioning, bucketing, map join, skewed data, vectorization & denormalization interview Q&As

10 Apache Hive scenarios interview Q&As on backup, repair, partition, drop, etc

10 Distributed storage & computing systems interview Q&As – Big Data

10 ERD (Entity-Relationship Diagrams) Interview Q&As

300+ Java Interview Questions - FAQs

10+ Companion Techs Interview Q&As

300+ Big Data Interview Questions - FAQs

16+ Java Tech Key Areas Interview Q&As

Your Career Tips to go places

Tutorials on Java & Big Data

300+ Java Interview Questions Answered

Disclaimer