Q37. Where do use Apache Flume in the BigData world? A37. Apache Flume is used to ingest big data into HDFS. BigData is generally ingested from 1) Sporadic bulk loading processes, such as database and mainframe offloads and batched data dumps from legacy systems. … Read more ›...
Q37. What is a Data Lake? A37. A data lake is a storage repository that holds a vast amount of structured, semi-structured, and unstructured raw data in its native format (aka pristine condition). The data structure and requirements are not defined until the data is needed. … Read more ›...
Q01. What is stored procedure in Snowflake? A01. Snowflake stored procedure lets you perform database operations by executing multiple SQL statements by automating repetitive tasks like cleaning up data by deleting records older than a specified date. … Read more ›...
Q1. Given the below Person.scala file with Person.calss, what will be the output?
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
package com.sbthello //a class - you create instance of a class, which become objects class Person(name: String, age: Int, salary: BigDecimal) { println("This is printed when the object is created " + this) def calcBonus(bonus: BigDecimal) : BigDecimal = salary + bonus def getNameLength():Int = name.length() } object Test extends App { val person1 = new Person("John", 25, BigDecimal(250.00)) } |
A1. It prints the below text as when a Scala class is instantiated the statements in the body are executed after the object is constructed via the constructor defined in the class signature itself as “Person(name: String,
…
This extends 15+ SQL scenarios based interview Q&As on N items per group – part 5 This SQL scenarios based interview questions & answers focus on N items per group. These examples were done on MySQL v8.0 at www.db-fiddle.com. … Read more ›...
Q01. What is an Azure Resource Manager (i.e. ARM)? A01. ARM is the native platform for infrastructure as code (IaC) in Azure. It enables you to centralise the management, deployment, and security of Azure resources. … Read more ›...
Example #14: Reduce operations Given a list of functions as shown below, how will you go about applying all the functions in the list to each input number and sum the result of each function?
|
1 2 3 4 5 6 7 8 9 10 11 12 |
object TestFunctions extends App { //list of functions val sumFive: Int => Int = x => x + 5 val multiplyTwo: Int => Int = x => x * 2 val sum2: Int => Int = x => x + 2 //input numbers val listOfNumbers = List(1, 2, 3, 4) } |
For example, applying all 3 functions to first number in the list “1” …...
Q01. How can you connect to Databricks for SQL? A01. SQL connectivity is very useful to access data from Databricks lakehouse from your code, JMeter for performance testing and from the command line (e.g. dbsqlcli) or SQL GUI clients like DBeaver for interactive querying. … Read more ›...
These Hadoop tutorials assume that you have installed Cloudera QuickStart, which has the Hadoop eco system like HDFS, Spark, Hive, HBase, YARN, etc. This example extends Learn Hive to write to and read from AVRO & Parquet files by examples to access Hive metastore via Spark SQL. … Read more...
Q1. What is an Object introspection? A1. It is the ability to determine type & properties of objects at runtime. Everything in Python is an object. Every object in Python may have attributes and methods. Python dir(..) function The dir(..) function returns a sorted list of attributes and methods belonging...
This extends Pyspark with schema & a simple join of two data frames example. Q13: What is SCD Type 1, and how will you implement it in pyspark? A13: SCD stands for Slowly Changing Dimension, … Read more ›...
Q51. Is HBase a relational database? A51. HBase is not a relational database. It is a NoSQL database. Hbase is a column-oriented (aka columnar) database management system, which runs on top of HDFS (Hadoop Distribute File System). Q52. … Read more ›...
Q33. What is a “Future” object in Scala? Is it an immutable object? A33. A Future is a holder object that holds a value (i.e. success scenario) or an exception (i.e. failure) which may become available at some point. Future represents the result of an asynchronous computation. … Read more...
I have a good news, I got job offer. I like to share with you from my bottom of my heart feeling thankful to you.