STAR & Agile — workbook's non-code value
What: STAR is the story framework interviewers score you on — Situation (context), Task (your responsibility), Action (what you did), Result (measurable outcome) — while Agile is the operating rhythm that story happened inside. Why it matters: L2 and manager rounds weigh STAR and Agile 30–50%; PySpark gets you shortlisted, but a STAR answer with numbers (45 min → 8 min, cost −30%) is what gets you hired. How to remember: For every project have one STAR ready: failing pipeline → you repartitioned/salted/cached → runtime halved with data-backed proof.
3 AM alerts, SLA breach
stability & SLA
caching — what you did
numbers or it didn't happen
Agile — 2-week sprints
Agile is iterative delivery: instead of building the whole bicycle in secret (Waterfall), you ship handle → seat → tyres every sprint and get feedback early — the same way a pipeline delivers bronze → silver → gold layers iteratively rather than waiting for perfect gold.
handle=5, tyres=3→ Scrum — daily 3-4 min
yesterday / today / blockers→ Review — demo to customer
feedback & cost approval→ Retro — improve
well / didn't / next↺
Build entire bicycle → show once → rework is expensive
Ship handle → seat → tyres → feedback each sprint → cheap correction
python 5 min (1 coding) | sql 10 min (2 coding) | pyspark 3-4 min theory + 3-4 min coding | aws 5 min theory | project 5 min.Coding Patterns — most asked from workbook
What: Coding patterns are the reusable templates interviewers actually test — phone validation (len==10 and isdigit and startswith 6/7/8/9), word counting with dict.get, anagram grouping via sorted keys, and palindrome/reverse checks — not trick puzzles. Why it matters: Every ETL interview follows the same arc: pre-validation (row/col/dtype/duplicate counts), transform, post-validation (row sum/null checks) — nailing these four patterns lets you answer any "write a function" prompt in under 2 minutes. How to remember: Think "validate → transform → validate again" and keep one snippet per pattern in muscle memory, as shown in the pipeline badge below.
rows · cols · dtype · wrong · duplicates→ Fix
strip · cast · filter→ Post-check
row count · sum · nulls
is_valid_phone(s)len==10, isdigit, s[0] in '6789'
countofoccurencedict.get(c,0)+1
group_anagramssorted(w) as key
'mom'== 'mom'[::-1]reverse check
def is_valid_phone(s): return len(s)==10 and s.isdigit() and s[0] in '6789'
print(is_valid_phone('6363402404')) # True
print(is_valid_phone('1234567890')) # False
def countofoccurence_words(text):
d={}
for w in text.split(): d[w]=d.get(w,0)+1
return d
print(countofoccurence_words('hi my name is praveen and i m from banglore and i m very hungry'))
# {'hi':1,'my':1,'name':1,'is':1,'praveen':1,'and':2,'i':2,'m':2,...}
def group_anagrams(words):
from collections import defaultdict
g=defaultdict(list)
for w in words: g[''.join(sorted(w))].append(w)
return dict(g)
print(group_anagrams(['bat','tab','cat','act','tac']))
# {'abt':['bat','tab'], 'act':['cat','act','tac']}
print('praveen'[::-1]) # hsirk
print('mom'=='mom'[::-1]) # True
# ETL checklist
# pre: row_count, col_count, dtype, wrong_data, duplicates
# fix: strip, cast, filter
# post: row_count, sum checks, null checksTrue
False
{'hi': 1, 'my': 1, 'name': 1, 'is': 1, 'praveen': 1, 'and': 2, 'i': 2, 'm': 2, 'from': 1, 'banglore': 1, 'very': 1, 'hungry': 1}
{'abt': ['bat', 'tab'], 'act': ['cat', 'act', 'tac']}
hsirk
TrueWhere are PySpark / SQL / AWS?
What: This Python guide is one of four dedicated tracks — Python, PySpark, SQL, and AWS — each with its own guide and chapters. Why it matters: You do not need to hunt for missing chapters; each track is complete and separate. How to remember: Think of the hub as four equal pillars — Python (this guide), PySpark, SQL, and AWS — each with its own chapters, status, and link, as shown in the table below.
| Track | Location | Status |
|---|---|---|
| 🐍 Python Basics | python-guide/ | ✅ Available |
| ⚡ PySpark | pyspark-guide/ | ✅ Already separate (9 chapters) |
| 📘 SQL | sql-guide/ | ✅ Already separate (12 chapters) |
| ☁️ AWS | aws-guide/ | ✅ Already separate (8 chapters) |
Nothing was overwritten in the process — PySpark, SQL, and AWS each retain their own dedicated guides with full chapters, so you can continue to use those tracks independently while this Python guide fills the foundational gap for PySpark preparation.