Tag: backpressure
Browse 8 practical software engineering resources tagged with "backpressure". Discover code recipes, design patterns, documentation templates, and in-depth guides to help you build, deploy, and maintain production-ready solutions involving backpressure. Each resource is written for engineers who ship real systems, with copy-paste examples and practical trade-offs.
Backpressure and Flow Control
Backpressure is a mechanism that lets a slow consumer signal to a fast producer to slow down. Without it, systems can overflow queues, run out of memory, or drop data.
The resources below cover reactive streams, bounded queues, load shedding, and throttling. Each guide shows how to keep data flows stable under varying load.
Every resource includes clear explanations, copy-paste code, and practical warnings. Use them to make informed decisions, avoid production pitfalls, and speed up your delivery. If you are just getting started, read the beginner-friendly articles first; if you are experienced, jump straight to the advanced patterns and architecture guides. New resources are added regularly, so bookmark this page and check back for the latest patterns.
Stream Process Large Files in Node.js Without Memory Issues
Process GB-sized files in Node.js using streams. Covers readline, transform streams, pipeline,...
Async Generator Pattern
Stream data lazily with async generators. Yield values one at a time as they become available,...
Message Queue Load Leveling Pattern
Smooth traffic spikes by placing a queue between a producer and a consumer. The producer writes...
Queue-Based Load Leveling Pattern
Introduce a queue between task producers and consumers to smooth out traffic spikes, decouple...
Reactive Streams Pattern
Process asynchronous data streams with backpressure. Subscribers request N items at a time,...
Serverless Throttling Pattern
Handle backpressure in serverless by using SQS, token buckets, and concurrency limits to protect...
Shed Load Pattern
Drop requests proactively under extreme load to protect the system. Reject excess traffic before it...
Complete Guide to Python Asyncio in Production
Run Python asyncio in production with confidence. Covers event loops, task management, debugging,...