Processing

Event Time vs Processing Time

Understand the two notions of time in Flink streaming pipelines and why event time, not processing time, is required for correct and reproducible results.

Flink vs Spark Streaming

A technical comparison of Flink's true streaming model against Spark Structured Streaming's micro-batch engine.

Building a Text-Processing Script

Move from ad-hoc one-liners to a maintainable multi-command sed script file, using labels, the hold space, and -f to solve a real data-cleaning task.

Multiline Processing

Learn how sed handles multiple lines at once using the pattern space, the hold space, and the D, P, N, H, and G commands to perform edits that span line bounda…

AWK and CSV Processing

Understand why splitting CSV on commas is unsafe, and learn how gawk's FPAT variable and built-in --csv mode correctly parse quoted fields, embedded commas, an…

AWK vs Python for Text Processing

A practical comparison of AWK and Python for text and log processing, showing where each tool shines and how to decide between a one-liner and a script.

Multi-File Processing in AWK

Process many input files at once using AWK's NR, FNR, and FILENAME variables, detect file boundaries, and correlate data across files with the classic NR==FNR…

List Processing Built-ins

Master Prolog's standard list library predicates, member/2, append/3, length/2, reverse/2, nth0/3, maplist/2-4, and findall/3, for common list tasks without ha…

Prolog and Natural Language Processing

Explore how Prolog's Definite Clause Grammars and unification make it a powerful tool for parsing and generating natural language.

Building a Signal Processing Script in MATLAB

A step-by-step walkthrough of building a real MATLAB signal-processing pipeline: generating a signal, filtering it, and verifying the result in the frequency d…

Indexed File Processing (VSAM)

Understand how COBOL uses indexed files, typically backed by VSAM KSDS on mainframes, to perform fast random and sequential access by key.

Sequential File Processing

Learn how COBOL reads, writes, and updates records in a sequential file, the oldest and most common file organization in mainframe batch systems.

Stream Processing Concepts

Core concepts behind stream processing: event time versus processing time, windowing strategies, watermarks, and time-bounded joins.

GDPR Compliance Cheat Sheet

Outlines core GDPR principles, data subject rights, lawful bases for processing, and breach notification requirements for engineering teams.