Key Area - Debug Spark Archives

Blog Archives

15+ Apache Spark best practices, memory mgmt & performance tuning interview FAQs – Part-1

There are so many different ways to solve the big data problems at hand in Spark, but some approaches can impact on performance, and lead to performance and memory issues. Here …

15+ Apache Spark best practices, memory mgmt & performance tuning interview FAQs – Part-2

This extends 15+ Apache Spark best practices, memory mgmt & performance tuning interview FAQs – Part-1. #7 Use Spark UI: Running Spark jobs without inspecting the Spark UI is a definite …

Debugging Spark applications written in Java locally by connecting to HDFS, Hive and HBase

This extends Remotely debugging Spark submit Jobs in Java. Running Spark in local mode When you run Spark in local mode, both the Driver and Executor will be running in the …

Finding your way around YARN and Spark on Cloudera

What is Apache Hadoop YARN? Apache Hadoop YARN (Yet Another Resource Negotiator) is the prerequisite for Enterprise Hadoop for dynamic allocation oc the cluster resources. For example, when you run a …

Remotely debugging Spark submit Jobs in Java

This extends Remote debugging in Java with Java Debug Wire Protocol (JDWP) to debug Spark jobs written in Java. We need to debug both the “Driver” and the “…

Spark understanding DAG for tuning performance interview Q&As

This extends 15 Apache Spark best practices & performance tuning interview FAQs to delve into DAGs, Stages, Tasks, Partitions and Shuffling in Spark. If you can’t read Spark Event Timelines & …

Don't be overwhelemed by the number of Q&As. No one knows everything, and a job interview is not a technical contest to see who gets the most number of questions right as quality of the answers, attitude, communication skills, confidence, lateral thinking, etc play a major part. It pays to know & prepare on the FAQs, Key Areas & job spec topics. 12 things to know about job interviews. This is not only a job interview companion, but also a handy career companion for a quick reference & brush-up on a topic or category to proactively fast-track your career.

The contents in this Java-Success are copyrighted and from EmpoweringTech pty ltd. The EmpoweringTech pty ltd has the right to correct or enhance the current content without any prior notice. These are general advice only, and one needs to take his/her own circumstances into consideration. The EmpoweringTech pty ltd will not be held liable for any damages caused or alleged to be caused either directly or indirectly by these materials and resources. Any trademarked names or labels used in this blog remain the property of their respective trademark owners. Links to external sites do not imply endorsement of the linked-to sites. Privacy Policy

Responsive WordPress Theme powered by CyberChimps

Top