Tag: data
Browse 65 practical software engineering resources tagged with "data". Discover code recipes, design patterns, documentation templates, and in-depth guides to help you build, deploy, and maintain production-ready solutions involving data. Each resource is written for engineers who ship real systems, with copy-paste examples and practical trade-offs.
Data Engineering and Management
Data is at the heart of most modern applications. Working with data effectively requires understanding storage, processing, modeling, transformation, quality, and governance across the lifecycle.
The resources below cover databases, ETL, data pipelines, validation, serialization, cleaning, and analysis. Each recipe connects data operations to practical engineering outcomes.
Every resource includes clear explanations, copy-paste code, and practical warnings. Use them to make informed decisions, avoid production pitfalls, and speed up your delivery. If you are just getting started, read the beginner-friendly articles first; if you are experienced, jump straight to the advanced patterns and architecture guides. New resources are added regularly, so bookmark this page and check back for the latest patterns.
Build a Real-Time Leaderboard with Redis Sorted Sets
Use Redis sorted sets to implement real-time leaderboards with rank tracking, score updates, and...
Batch Processing Patterns
Design reliable batch processing pipelines for large datasets with retry logic, idempotency, and...
Validate and Sanitize User Input Data
How to validate, sanitize, and constrain user input data at the application boundary using schemas,...
Date Formatting
How to parse, format, and manipulate dates across timezones using Python, JavaScript, and Java.
Deep Clone in JavaScript: structuredClone vs lodash vs JSON
Compare deep clone methods in JavaScript, Python and Java. Create independent copies of objects and...
Deep Clone Objects in JavaScript: Beyond JSON.parse
Compare deep clone strategies including JSON.parse, structuredClone, manual recursion, and library...
Diff JSON Objects
How to compare two JSON objects and find differences in Python, Java, and JavaScript.
Flatten and Unflatten Nested Objects
How to convert nested objects to flat key-value pairs and back again, with dot-notation, bracket...
Generate URL Slugs
How to generate clean, URL-friendly slugs from strings in multiple programming languages.
Money and Currency Handling
How to represent, parse, format, and calculate monetary values accurately across currencies.
Parse JSON
How to parse JSON strings into native data structures across multiple programming languages.
Parse and Write TOML Files: Python, Java & JS Examples
How to parse and write TOML configuration files in Python, Java, and JavaScript.
Schedule and Monitor DAGs with Apache Airflow
Define, schedule, and monitor Airflow DAGs with operators, sensors, XCom, task dependencies, and...
Validate DataFrame Schemas with Pandera
How to validate pandas and Polars DataFrame schemas with Pandera, covering column types,...
Transform Data in the Warehouse with dbt
How to use dbt for SQL-based data transformations with models, tests, materializations, macros, and...
Read and Write Excel Files with Python
How to read, write, and format Excel spreadsheets using openpyxl and pandas in Python.
Generate QR Codes with Python
Create QR codes for URLs, text, and contact cards using the qrcode library in Python.
Build an ETL Pipeline with pandas and Parquet
How to build an extract-transform-load pipeline using pandas for data processing and Parquet for...