data

Practical resources about data for software engineers.

87 results

Understanding Data Processing in Software Engineering

Every application eventually deals with data — parsing user input, serializing objects for APIs, validating form submissions, or transforming records between formats. Getting data handling right is what separates fragile scripts from production-grade systems.

This collection covers practical recipes and patterns for working with JSON, CSV, XML, YAML, and custom formats. You will find copy-paste solutions for common tasks like flattening nested objects, sanitizing user input, generating slugs, and formatting dates across Python, Java, and JavaScript.

advanced

Recursive CTEs for Hierarchical Data Queries

How to query hierarchical data with recursive Common Table Expressions in SQL, covering tree...

beginner

Truncate Text

How to truncate text with ellipsis and word boundaries in Python, Java, and JavaScript.

beginner

URL Encoding

How to encode and decode URLs, query parameters, and path segments safely across Python,...

beginner

URL Encoding and Decoding

Master URL encoding in JavaScript and other languages with encodeURI, encodeURIComponent, plus-safe...

beginner

UUID Generation

How to generate universally unique identifiers (UUIDs) for database keys, session tokens, and...

beginner

UUID Generation: v4, v7, and ULID Comparison

Compare UUID v4, v7, ULID, and nanoid for generating unique identifiers with different tradeoffs in...

intermediate

Validate JSON Schema

How to validate JSON data against schemas in Python, Java, and JavaScript.

intermediate

Implement ACID Transactions in PostgreSQL

How to use PostgreSQL transactions to ensure Atomicity, Consistency, Isolation, and Durability for...

intermediate

Elasticsearch Aggregations for Analytics and Search

How to use Elasticsearch aggregations to build faceted search, analytics dashboards, and real-time...

beginner

Build Responsive Email Templates with MJML

Create cross-client responsive email templates using MJML markup, live Handlebars variables, and...

intermediate

RAG Hybrid Search Pattern

Combine keyword (BM25) and semantic (vector) search to improve retrieval accuracy in RAG pipelines....

advanced

Batch-to-Streaming Bridge

How to bridge batch and streaming pipelines with a data lake. Covers Lambda architecture, Kafka...

advanced

CDC Pattern: Stream Database Changes to Downstream

How to stream database changes to downstream consumers with CDC. Covers log-based CDC, Debezium,...

advanced

Data Lineage Tracking: Track Origin End-to-End

How to track data origin and transformations end-to-end. Covers column-level lineage, OpenLineage,...

intermediate

ETL Extract-Transform-Load

How to build ETL pipelines with extract, transform, and load stages. Covers staging tables,...

intermediate

Idempotent Load: Re-run Data Loads Safely Without Duplicates

How to re-run data loads safely without duplicates. Covers deduplication keys, MERGE upserts, load...

advanced

Schema Registry Evolution

How to manage schema versions for streaming pipelines with a schema registry. Covers Avro, backward...

advanced

Data Migration Runbook: Checklist

Use this data migration runbook template to plan safe migrations. Includes pre-migration checks,...

advanced

Complete Guide to Kafka Stream Processing

Build real-time event streaming pipelines with Kafka. Covers producers, consumers, Kafka Streams,...

kafka stream-processing event-streaming schema-registry
intermediate

Data Lake vs Data Warehouse — Architecture Guide

A practical guide to Data Lake architecture: structured vs unstructured storage, lakehouse...

No results found.