Step 1: Signup to Databricks community edition – https://databricks.com/try-databricks. Fill in the details and you can leave your mobile number blank. Select “
…
Blog Archives
01: Databricks getting started – Spark, Shell, SQL
02: Databricks – Spark schemas, casting & PySpark API
Prerequisite: Extends Databricks getting started – Spark, Shell, SQL.
Q: What is a Dataframe?
A: A DataFrame is a data abstraction or a domain-specific language (DSL) for working with structured and semi-structured data,
…
03: Databricks – Spark SCD Type 1
Prerequisite: Extends Databricks getting started – Spark, Shell, SQL.
What is SCD Type 1
SCD stands for Slowly Changing Dimension,
…
04: Databricks – Spark SCD Type 2
Prerequisite: Extends 03: Databricks – Spark SCD Type 1. What is SCD Type 2 SCD stands for Slowly Changing Dimension, … Read more ›...
04a: Databricks – Spark SCD Type 1 with Merge
Prerequisite: Extends 03: Databricks – Spark SCD Type 1. What is SCD Type 1 SCD stands for Slowly Changing Dimension, … Read more ›...
05: Databricks – Spark UDFs
Prerequisite: Extends Databricks getting started – Spark, Shell, SQL.
What is a UDF?
User-Defined Functions (aka UDF) is a feature of Spark SQL to define new Column-based functions that extend the vocabulary of Spark SQL’s DSL for transforming Datasets.
…
06: Databricks – Spark Window functions
Prerequisite: Extends Databricks getting started – Spark, Shell, SQL. What is a window function? Q. What are the different types of functions in Spark SQL? … Read more ›...
07: Databricks – groupBy, collect_list & explode
Prerequisite: Extends Databricks – Spark Window functions. Step 1: Create a new Python notebook, and attach it to a cluster. … Read more ›...
08: Databricks – Spark problem 1
Prerequisite: Extends Databricks – Spark Window functions. Problem: Convert the below table to Where each column is counted for its occurrence. … Read more ›...
Contact us: java-interview@hotmail.com
Latest posts by Arulkumaran Kumaraswamipillai (see all)
- 1000+ Java & Big Data interview questions categorised - June 24, 2022
- 00: 13 Data Warehouse interview Q&As – Fact Vs Dimension, CDC, SCD, etc – part 2 - April 28, 2022
- 11D: Scala existential type interview Q&As - March 20, 2022
Responsive WordPress Theme powered by CyberChimps
Top
