file handling
Practical resources about file handling for software engineers.
31 results
Working with Files and Streams
File operations are deceptively simple until you face large datasets, concurrent writes, or cross-platform path differences. Production code needs to handle streaming, compression, encoding, and cleanup gracefully.
This section provides recipes for reading large files efficiently, watching directories for changes, compressing archives, rotating logs, and parsing configuration files. Solutions cover Python, Java, Node.js, and Bash for maximum flexibility.
Bash Scripting for DevOps Automation and System Tasks
How to write reliable Bash scripts for automating deployments, system monitoring, log rotation, and routine maintenance tasks
AWS CLI Automation with Bash
Automate AWS resource provisioning, tagging, and cleanup using Bash scripts wrapped around the AWS CLI.
Backup Rotation Script
Automate file backups with retention policies using a Bash script that rotates daily, weekly, and monthly snapshots.
Configure Firewall Rules with iptables
Set up basic firewall rules using iptables in Bash to filter traffic, block ports, and protect Linux servers.
Log Rotation and Compression
Rotate and compress application logs with Bash to prevent disk exhaustion and simplify log retention.
Bash Loop Over Files
How to safely loop over files and directories in Bash, handling spaces, globs, and large file lists with correct patterns.
Monitor Disk Usage
Alert when disk space crosses thresholds using a Bash script that checks mount points and notifies operators.
Bash Parallel Execution
How to run shell commands in parallel with xargs, GNU parallel, and Bash background jobs while controlling concurrency and collecting results.
Parallel Job Execution with Bash
Run shell commands and scripts in parallel safely using xargs, parallel, or background jobs with concurrency control.
SSH Key Management
Generate, rotate, and distribute SSH keys securely with Bash scripts for team and server access.
Bash Text Processing
How to build capable text processing pipelines with grep, sed, awk, cut, sort, uniq, and tr for log analysis and data transformation.
Compress and Decompress Files
How to handle ZIP, GZIP, and TAR archives programmatically.
Compress and Decompress Files with Gzip and Brotli
How to reduce file sizes for APIs, static assets, and log files using Gzip, Brotli, and zlib with streaming compression, content negotiation, and what works.
File Upload Validation
How to handle file uploads securely with size, type, and content validation.
Generate PDFs
How to generate PDF documents programmatically from HTML, templates, or raw data.
Generate Temporary Files
How to create temporary files and directories safely with automatic cleanup across Python, Node.js, Java, and Bash.
Import Data from CSV/Excel
How to parse and import data from CSV and Excel files with validation.
JavaScript Drag and Drop File Upload with HTML5 API
Implement native HTML5 drag and drop file upload in JavaScript
Node.js File Upload Validation: Type, Size, and Content
Validate file uploads in Node.js with multer for type, size, and content
Stream Process Large Files in Node.js Without Memory Issues
Process GB-sized files in Node.js using streams. Covers readline, transform streams, pipeline, backpressure, and chunk processing.
Batch Resize Images with Python
How to bulk resize and optimize images using Pillow and Python for web delivery.
Safely Extract Zip Files with Python
How to extract and validate zip archives securely using Python zipfile and shutil.
Read and Write Files
How to read from and write to files safely across multiple programming languages.
Rotate Log Files
How to implement log rotation by size, date, and count to prevent disk exhaustion across Python, Node.js, Java, and Linux systems.
Process Large Files with Streams
How to read, transform, and write large files efficiently using streams without loading entire files into memory in Python, Node.js, and Java.
Write Large Files
How to write large files efficiently using buffered and streaming output.
No results found.