Observability

Feb 24, 2026

Interlock: A STAMP-Based Safety Framework for Data Pipelines

How I built a STAMP-based safety framework in Go with declarative sensors, failure classification, and centralized observability for data pipeline reliability on AWS

data engineering go aws safety dynamodb step functions terraform eventbridge observability

Dec 23, 2025

Building Production-Ready Spark Pipelines with Configuration-Driven Architecture

How spark-pipeline-framework reached 1.0 with Spark Connect support, streaming, and enterprise features

spark scala data engineering open source observability spark connect streaming