Blog Archives
1 … 4 5 6 7 8 9 10 11 12 … 16

11c: 50+ Apache Spark best practices & optimisation interview FAQs – Part 3 Partitions & buckets

This extends 40+ Apache Spark best practices & optimisation interview FAQs – Part-2 Spark UI. #31 Bucketing is another data optimisation technique that groups data with the same bucket value across a fixed number of “buckets”. Bucketing improves performance in wide transformations and joins by minimising or avoiding data “shuffles”....

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


11d: 50+ Apache Spark best practices & optimisation interview FAQs – Part 4 Small Files problem

Q38: What is the difference between repartition & Coalesce? A38: Repartition equally distributes the data across machines, hence requires reshuffling, hence slower than coalesce, but can improve the overall performance of the job as it can prevent data skewing by equally distributing the data across the executors. … Read more...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


11e: 50+ Apache Spark best practices & optimisation interview FAQs – Part 5 Cache Vs Persist Vs Checkpoint

This extends 50+ Apache Spark best practices & optimisation interview FAQs – Part 4 Small Files problem Q44 What do you understand by the terms caching, persisting & checkpointing with respect to Apache Spark? … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


11f: 50+ Apache Spark best practices & optimisation interview FAQs – Part 6 Serialization & UDFs

This extends 11e: 50+ Apache Spark best practices & optimisation interview FAQs – Part 5 Cache Vs Persist Vs Checkpoint. Q46 Why is serialization important in Spark? A46 Serialization and deserialization are important concepts in Apache Spark. … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


12 Apache Spark getting started interview questions and answers

Q01. Where is Apache Spark used in the Hadoop eco system? A01. Spark is essentially a data processing framework that is faster & more flexible than “Map Reduce”. The Spark itself has grown into an eco system with Spark SQL, Spark streaming, Spark UI, GraphX, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


12 Amazon Redshift interview Q&As

Q1. What is Amazon Redshift? A1. Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. You can start with just a few hundred gigabytes of data and scale to a petabyte or more. This enables you to use your data to acquire new insights for your...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


12 Kerberos interview Q&As

Q1. What is kerberos? A1. Kerberos is a network authentication protocol designed to provide strong authentication for client/server applications by means of secret-key cryptography. Kerberos ensures the highest level of security to network resources. Q2. What are the 3 key components of Kerberos? … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


12: 50+ SQL scenarios based interview Q&As on Nth value with variations

This extends 50+ SQL scenarios based interview Q&As on Nth value with some variations to practice. Problem statement & considerations Find the 5th highest salary for each department. If the number of highest value for a particular department is less than 5, then display the lowest salary for that department....

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


12: PySpark working with SQL syntax Interview Q&As with tutorials

Q37: Can you use SQL in PySpark? A37: Yes, Spark supports both Dataframe APIs and also allows you to integrate SQL queries to work with structured data. The pyspark.sql is a module in PySpark that can be used to perform SQL like operations on the data stored in memory via...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


12: Q92 – Q97 Hadoop file formats and how to choose

Q92. What are the criteria for choosing storage file formats in Hadoop? A92. Choosing the wrong file formats can significantly increase the query times and storage spaces. Choosing a format that does not support flexible schema evolution may cost massive re-processing just to add a new field. … Read more...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


13 Apache Sqoop interview Q&As

Q1. What is Apache sqoop? A1. Sqoop is a command-line tool to transfer data between Hadoop and RDBMS (i.e. Relational Database Management Systems). It is used to import data from relational databases such as MySQL, Oracle, Teradata, etc to Hadoop HDFS, and export structured data from Hadoop file system to...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


13: 50+ SQL scenarios based interview Q&As on self-join

Let’s try solving a problem statement given below by creating sample data & then an SQL query on db-fiddle using MySQL v8 database. You can also look at a hierarchical (i.e. tree structure) employees example using a self-join at 50+ SQL scenarios based interview Q&As on joins, CDC and recursive...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


13: PySpark with Apache Kafka Interview Q&As with tutorials – part 1

Q40: What is Spark streaming? What are the benefits of using Apache Kafka with PySpark? A40: Spark streaming is used for real time data processing, which allows you to process from various data sources like Apache Kafka, … Read more ›...

This content is for 30-Day-Full-Access, 100-Day-Full-Access, 200-Day-Full-Access, and 365-Day-Full-Access members only. Register 80+ Free Java FAQs 80+ Free Big Data FAQs
Already a member? Log in here


1 … 4 5 6 7 8 9 10 11 12 … 16

300+ Java Interview Questions - FAQs

Tutorials on Java & Big Data