Data-Analysis-SQL.md

Knowledge Sharing - Data Engineering skilling - Data Analysis with SQL

Table of Content (ToC)

• Overview
• Specific SQL topics
• Spark
  • Leveling up in PySpark - Interview questions and answers
  • Joins with Spark
  • Replace case clause with pattern tables

Created by gh-md-toc

Overview

This Readme collects specifically material about Data Analysis with SQL.

Specific SQL topics

Spark

Leveling up in PySpark - Interview questions and answers

• Title: Leveling up in PySpark - Intermediate practice set
• Date: Aug. 2025
• Author: Md Sohail Tanveer (Md Sohail Tanveer on LinkedIn)
• Post on LinkedIn: https://www.linkedin.com/posts/mdsohailtanveer_pyspark-intermediate-level-practice-set-activity-7359456410570539009-J40s/
  • LinkedIn media - PDF
• Git repository with the code (Jupyter notebooks): https://github.com/Sohailtanveer1/Pyspark_Practice_Sets

Joins with Spark

• References:
  • Spark SQL - Join: https://spark.apache.org/docs/3.5.4/api/python/reference/pyspark.sql/api/pyspark.sql.DataFrame.join.html
• Article: Exploring the Different Join Types in Spark SQL: A Step-by-Step Guide
  • Date: Feb. 2023
  • Author: Ahmed Uz Zaman (Ahmed Uz Zaman on LinkedIn, Ahmed Uz Zaman on Medium)
  • Link on Medium: https://medium.com/plumbersofdatascience/exploring-the-different-join-types-in-spark-sql-a-step-by-step-guide-49342ffe9578

Replace case clause with pattern tables

• Data Engineering helpers - Skilling - Data Analysis with SQL - Redame
  • Data Engineering helpers - Skilling - Data Analysis with SQL - Jupyter notebook adapted to PySpark
  • Data Engineering helpers - Skilling - Data Analysis with SQL - Original Jupyter notebook with DuckDB
• Date: Aug. 2025
• Author: Matt Martin (Matt Martin on LinkedIn, Matt Martin's Substack blog)
• Article on Substack: https://performancede.substack.com/p/handling-fuzzy-matching-of-transactions
• Original Git repository with the code (Jupyter notebook)