Apache Kafka with Java getting started tutorial demonstrates how quickly you can get started with Kafka using Docker. This extends Apache Kafka example with Java – getting started tutorial – Part 1.
Step 1: As discussed in part-1, stand-up the Kafka,
…
Q1. What is IAM? A1. IAM stands for Identity & Access Management. AWS Identity and Access Management (IAM) is a web service that helps you securely control access to AWS resources. You use IAM to control who is authenticated (i.e. … Read more ›...
This extends Azure interview Q&As on Region, VNet, Subnets, AZs, Availability Set, etc. Q12. What is an Azure Virtual Network Peering? A12. Virtual network peering enables you to seamlessly connect two or more VNets in Azure. … Read more ›...
Q1. What are the common JavaScript errors or bad practices that you have noticed? A1. 1) Not having proper namespaces and not using AMD (i.e. Asynchronous Model Definition) API to modularize the Java code for improved maintainability. … Read more ›...
This extends Networking basics interview Q&As on ip address, subnet mask, DNS & gateway. Q1. What is a network protocol? Can you give a few examples? A1. Network protocols are a set of rules outlining how connected devices communicate across a network to exchange information easily and safely. … Read...
Data Engineers & analysts must know the analytic functions applied over a window of rows is a powerful tool to analyse the data. This post compliments “Apache Spark window functions” by focusing on MySQL server. You can also apply this on Big Data SQL engines like Hive &
…
This extends SQL window function for analytical queries interview questions – Part 1 Analytic function construct
|
1 2 3 4 5 6 |
analytic_function_name([argument_list]) OVER ( [PARTITION BY partition_expression,…] [ORDER BY sort_expression, … [ASC|DESC]]) |
The analytic function names can be RANK(), DENSE_RANK(), ROW_NUMBER(), MIN(column), MAX(column), SUM(column), COUNT(), AVG(column), FIRST_VALUE(column), LAST_VALUE(column), NTH_VALUE(column, n), LEAD(return_value ,offset [,default]), LAG(return_value ,offset [,default]), NTILE(n), … Read more ›...
This extends SQL analytic functions interview questions – Part 2 and SQL analytic functions interview questions – Part 1. The below example was created in IMPALA SQL engine with Common Table Expression (i.e CTE).
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
WITH WORK_ORDER AS ( SELECT 101 as order_id, TO_DATE('2020-01-01') as ORDER_DATE, TO_DATE('2020-01-15') as COMPLETED_DATE UNION ALL SELECT 102 as order_id, TO_DATE('2020-06-01') as ORDER_DATE, TO_DATE('2020-06-08') as COMPLETED_DATE UNION ALL SELECT 103 as order_id, TO_DATE('2020-08-15') as ORDER_DATE, TO_DATE('2020-09-12') as COMPLETED_DATE UNION ALL SELECT 104 as order_id, TO_DATE('2020-09-13') as ORDER_DATE, TO_DATE('2020-09-18') as COMPLETED_DATE UNION ALL SELECT 105 as order_id, TO_DATE('2020-11-11') as ORDER_DATE, TO_DATE('2020-12-07') as COMPLETED_DATE UNION ALL SELECT 106 as order_id, TO_DATE('2021-02-13') as ORDER_DATE, TO_DATE('2021-02-28') as COMPLETED_DATE UNION ALL SELECT 107 as order_id, TO_DATE('2021-05-01') as ORDER_DATE, TO_DATE('2021-05-16') as COMPLETED_DATE ) SELECT order_id, DATEDIFF(COMPLETED_DATE, ORDER_DATE) AS COMPLETION_DAYS FROM WORK_ORDER ORDER BY order_id ; |
Output:
|
1 2 3 4 5 6 7 8 9 10 |
order_id completion_days ------------------------------ 101 14 102 7 103 28 104 5 105 26 106 15 107 15 |
CUME_DIST() analytic function The CUME_DIST( ) analytic function stands for cumulative distribution, …...
Many production systems run on Linux systems, especially the Cloud infrastructure (i.e. AWS & GCP). Even Android uses the Linux kernel under the hood. So, it really pays to have a good knowledge of Linux.
Q1. How do you check for open ports in Linux?
A1.
…
This extends 50+ SQL scenarios based interview Q&As on joins, CDC and recursive CTE. Q01 In What order the SELECT SQL statements are executed? A01 Here is the the order in which the SQL statements are evaluated. 1) FROM (including JOIN, … Read more ›...
This extends Apache Kafka example with Java Producer & Consumer Tutorial – Part 2. This covers Apache Kafka example with toxiproxy & producer timeout. The producer code needs to be robust to handle any network issues like timeouts & latency issues. In this tutorial a tool named toxiproxy is used to simulate network issues.
…
Q01. What is a Kubernetes object? A01. One of the key concepts in Kubernetes is the “desired state,” which refers to the configurations of the applications that you want to deploy and run. A desired state includes things like how many instances of applications should be running, … Read more...
This post extends the 01: Networking basics interview Q&As on ip address, subnet mask, DNS & gateway with some of the key networking concepts that we face as software engineers & architects. VPN Q1. What is a VPN? A1. … Read more ›...
I have a good news, I got job offer. I like to share with you from my bottom of my heart feeling thankful to you.