This extends Spark interview Q&As with coding examples in Scala – part 1 with the key optimisation concepts.
Partition Pruning
Q13. What do you understand by the concept Partition Pruning?
A13. Spark & Hive table partitioning by year,
…
800+ Java & Big Data Interview Q&As
130+ job offers to choose from as a self-taught Java & Big Data contractor for 22+ years. It pays to prepare.
Blog Archives
Spark interview Q&As with coding examples in Scala – part 02: partition pruning & column projection
Spark interview Q&As with coding examples in Scala – part 03: Partitioning, pruning & predicate push down
This extends Spark interview Q&As with coding examples in Scala – part 2 with more coding examples on Databricks Note book. Prerequisite: Create a free account as per Databricks getting started. Login to community.cloud.databricks.com, and click on “ … Read more ›...
This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only.
Register
80+ Free Java FAQs
80+ Free Big Data FAQs
Already a member? Log in here
Spark interview Q&As with coding examples in Scala – part 04: Memory considerations, lazy computation & cacheing
This extends Spark interview Q&As with coding examples in Scala – part 3 with more coding examples on Databricks Note book. Prerequisite: Create a free account as per Databricks getting started. Login to community.cloud.databricks.com, and click on “ … Read more ›...
This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only.
Register
80+ Free Java FAQs
80+ Free Big Data FAQs
Already a member? Log in here
Spark interview Q&As with coding examples in Scala – part 05: Transformations, actions, pipelining & shuffling
This extends Spark interview Q&As with coding examples in Scala – part 4 with more coding examples on Databricks Note book.
Prerequisite: Create a free account as per Databricks getting started. Login to community.cloud.databricks.com, and click on “
…
Spark interview Q&As with coding examples in Scala – part 06: groupBy, collect_list & explode
This extends Spark interview Q&As with coding examples in Scala – part 5 with more coding examples on Databricks Note book. Prerequisite: Create a free account as per Databricks getting started. Login to community.cloud.databricks.com, and click on “ … Read more ›...
This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only.
Register
80+ Free Java FAQs
80+ Free Big Data FAQs
Already a member? Log in here
Spark interview Q&As with coding examples in Scala – part 07: map, flatMap, mapPartitions & mapValues
This extends Spark interview Q&As with coding examples in Scala – part 6 with more coding examples on Databricks Note book. Prerequisite: Create a free account as per Databricks getting started. Login to community.cloud.databricks.com, and click on “ … Read more ›...
This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only.
Register
80+ Free Java FAQs
80+ Free Big Data FAQs
Already a member? Log in here
Spark interview Q&As with coding examples in Scala – part 08: pivot, unpivot, agg & selectExpr
This extends Spark interview Q&As with coding examples in Scala – part 7 with more coding examples on Databricks Note book. Prerequisite: Create a free account as per Databricks getting started. Login to community.cloud.databricks.com, and click on “ … Read more ›...
This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only.
Register
80+ Free Java FAQs
80+ Free Big Data FAQs
Already a member? Log in here
Spark interview Q&As with coding examples in Scala – part 09: sql.functions
This extends Spark interview Q&As with coding examples in Scala – part 8 with more coding examples on Databricks Note book. Prerequisite: Create a free account as per Databricks getting started. Login to community.cloud.databricks.com, and click on “ … Read more ›...
This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only.
Register
80+ Free Java FAQs
80+ Free Big Data FAQs
Already a member? Log in here
Spark interview Q&As with coding examples in Scala – part 10: adding new columns
This covers one of the most popular Spark interview questions of adding new columns to Spark Dataframes. Most non-trivial Spark jobs will have additional columns added to an existing Dataframe. These columns can be derived from existing columns in a Dataframe.
Q01. What are the different ways in which you can add new columns to a Dataframe?
…
Spark interview Q&As with coding examples in Scala – part 11: add column values conditionally, lit & typedlit
This extends Spark interview Q&As with coding examples in Scala – part 10: adding new columns. Q01. How will you add a new column with a fixed value? A01. Using the lit(..) & typedlit(..) functions in “org.apache.spark.sql.functions” … Read more ›...
This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only.
Register
80+ Free Java FAQs
80+ Free Big Data FAQs
Already a member? Log in here
Spark join strategies & performance tuning interview questions and answers
Join operations are frequently used in big data analytics to merge two data sets, represented as tables, DataSets or DataFrames via on a matching key. Being aware of these join strategies is important as they can significantly impact the performance and efficiency of your Spark applications. Q1. … Read more...
This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only.
Register
80+ Free Java FAQs
80+ Free Big Data FAQs
Already a member? Log in here
Spark understanding DAG for tuning performance interview questions and answers
This extends 15 Apache Spark best practices & performance tuning interview FAQs to delve into DAGs, Stages, Tasks, Partitions and Shuffling in Spark. If you can’t read Spark Event Timelines & DAGs, you will be running blind as to how efficient your code is. … Read more ›...
This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only.
Register
80+ Free Java FAQs
80+ Free Big Data FAQs
Already a member? Log in here
SQL procedures vs functions with postgresql (i.e. plpgsql) examples
Q01 What is the difference between SQL stored Procedures & Functions?
A01 Stored procedure does not have a RETURNS clause, but you can use the OUT or INOUT parameter. Stored procedures are transactional whereas functions are not.
…
300+ Java Interview Questions - FAQs
10+ Companion Techs Interview Q&As
300+ Big Data Interview Questions - FAQs
16+ Java Tech Key Areas Interview Q&As
Your Career Tips to go places
Tutorials on Java & Big Data
300+ Java Interview Questions Answered
“
I have a good news, I got job offer. I like to share with you from my bottom of my heart feeling thankful to you.
Jithendra
via LinkedIn
Disclaimer
The contents in this Java-Success are copyrighted and from EmpoweringTech pty ltd. The EmpoweringTech pty ltd has the right to correct or enhance the current content without any prior notice. These are general advice only, and one needs to take his/her own circumstances into consideration. The EmpoweringTech pty ltd will not be held liable for any damages caused or alleged to be caused either directly or indirectly by these materials and resources. Any trademarked names or labels used in this blog remain the property of their respective trademark owners. Links to external sites do not imply endorsement of the linked-to sites. Privacy Policy
Responsive WordPress Theme
powered by
CyberChimps
Top
Scroll Up