Microservices Architecture — When to Use and When Not To

Introduction

Microservices architecture structures an application as a collection of loosely coupled services, each owned by a small team and deployed independently. It solves organizational and technical scaling problems, but introduces major operational complexity. This guide helps you decide when the trade-off is worth it.

What Are Microservices?

A microservice is a self-contained unit of functionality that:

• Owns its data — each service has its own database, no shared schema
• Is independently deployable — a change to one service does not require redeploying others
• Communicates over the network — via HTTP/gRPC or asynchronous messaging
• Is owned by a small team — typically 5-15 engineers per service

When to Use Microservices

Signal	Why Microservices Help
Multiple teams > 20 engineers	Reduces coordination overhead; teams deploy independently
Different parts scale differently	Scale only the hot service, not the entire monolith
Different technology requirements	One service needs GPU, another needs high I/O — use the right tool
Need for independent release cadence	Mobile API ships daily, billing service ships monthly
Fault isolation required	A bug in search should not take down payments

When NOT to Use Microservices

Signal	Better Alternative
< 10 engineers	Monolith with modular code boundaries
Unproven product / MVP	Monolith — iterate faster, split later
Low traffic / simple domain	Monolith — simpler to operate
No DevOps/SRE culture	Monolith — microservices require mature operational practices
Tight latency requirements (< 10ms)	Monolith — network hops add latency

The Monolith-First Rule

Start with a well-modularized monolith. Extract services only when a clear boundary is painful to maintain.

Martin Fowler and Sam Newman both advocate starting with a monolith and decomposing only when the pain is real. Premature decomposition creates distributed monoliths — the worst of both worlds.

Decomposition Strategies

1. Decompose by Business Capability

Service	Business Capability
User Service	Account management, authentication
Catalog Service	Product listings, search, inventory
Order Service	Checkout, order history, fulfillment
Payment Service	Charging cards, refunds, invoicing
Notification Service	Emails, SMS, push notifications

Why it works: boundaries align with how the business thinks and evolves.

2. Decompose by Subdomain (DDD)

Use Domain-Driven Design bounded contexts:

┌─────────────────────────────────────┐
│          E-Commerce Domain          │
├──────────────┬──────────────┬───────┤
│   Catalog    │   Checkout   │ Loyalty│
│   Context    │   Context    │Context│
│              │              │       │
│ - Products   │ - Orders     │ - Points│
│ - Categories │ - Payments   │ - Tiers │
│ - Search     │ - Shipping   │ - Rewards│
└──────────────┴──────────────┴───────┘

3. Strangler Fig Pattern

Gradually replace monolith functionality with new services:

Phase 1: [Monolith] → all traffic
Phase 2: [Monolith] + [User Service] → traffic split via API Gateway
Phase 3: [Monolith fragments] + [User] + [Catalog] + [Orders]
Phase 4: All services extracted, monolith retired

Communication Patterns

Synchronous (REST/gRPC)

Best for: real-time queries, simple request/response

# Catalog service queries User service synchronously
user = requests.get(f"https://user-service/users/{user_id}", timeout=0.5)

Trade-off: Creates temporal coupling. If User service is down, Catalog service degrades.

Asynchronous (Event-driven)

Best for: background work, high throughput, decoupling

# Order placed event → published to message bus
from kafka import KafkaProducer

producer = KafkaProducer(bootstrap_servers='kafka:9092')
producer.send('orders', json.dumps({"order_id": order.id, "user_id": user_id}))

# Payment service listens and processes independently

Trade-off: Eventual consistency. Debugging is harder because execution is not linear.

Data Ownership and Consistency

Database Per Service

┌──────────┐    ┌──────────┐    ┌──────────┐
│  User    │    │  Order   │    │ Payment  │
│ Service  │    │ Service  │    │ Service  │
├──────────┤    ├──────────┤    ├──────────┤
│ Users DB │    │ Orders DB│    │Payment DB│
└──────────┘    └──────────┘    └──────────┘

Never share a database between services. It creates hidden coupling.

Handling Cross-Service Data Needs

When a service needs data owned by another:

• API Composition: query both services and join in the client
• CQRS + Read Models: denormalize data via events into a local read-optimized store
• Saga Pattern: coordinate distributed transactions using compensating transactions

Common Patterns

Pattern	Problem It Solves
API Gateway	Single entry point, routing, auth, rate limiting
Service Discovery	Find service instances without hardcoding IPs
Circuit Breaker	Fail fast when downstream services are unhealthy
Bulkhead	Isolate thread pools to prevent cascading failure
Saga	Manage distributed transactions across services
CQRS	Separate read and write models for performance

Operational Challenges

Challenge	Mitigation
Distributed debugging	Distributed tracing (OpenTelemetry, Jaeger)
Deployment complexity	CI/CD pipelines per service, GitOps, feature flags
Configuration drift	Infrastructure as Code (Terraform, Pulumi)
Observability	Centralized logging (ELK/Loki), metrics (Prometheus), dashboards (Grafana)
Local development	Docker Compose, Tilt, or cloud dev environments

What Works

• Own the full lifecycle — teams build, run, and support their services (you build it, you run it)
• Design for failure — assume any dependency can fail; use retries with backoff, circuit breakers, and graceful degradation
• Automate everything — if a deployment or rollback requires a runbook, automate it
• Standardize observability — every service must emit logs, metrics, and traces in a consistent format
• Limit service dependencies — avoid deep dependency chains; prefer fan-out over deep trees

Common Mistakes

• Creating too many services too early — 5 services for 3 engineers is overkill
• Sharing databases between services — this is a distributed monolith. See database design.
• Ignoring network latency — every sync call is a potential timeout or retry storm
• Underestimating operational cost — microservices need mature DevOps practices
• Building a custom RPC framework — use proven standards (gRPC, HTTP/REST, or message brokers)

Frequently Asked Questions

Should every startup start with microservices?

No. Start with a monolith. Extract services when a module becomes painful to deploy, scale, or reason about independently. Premature decomposition is a common cause of engineering slowdown.

How big should a microservice be?

Small enough to be rewritten in 2-4 weeks. If a service requires 6+ engineers and months to refactor, it is probably multiple services in disguise. The “micro” refers to team size and scope, not lines of code.

What is the biggest risk of microservices?

Distributed complexity. Debugging, testing, and reasoning about a system that spans dozens of services is considerably harder than a monolith. Without strong observability and automation, the architecture will slow you down rather than speed you up.

Advanced Topics

Detailed Scenario: Decomposing an E-commerce Monolith

System: E-commerce monolith (Rails, 500k lines, 40 devs)
Problem: Weekly deploy frequency, 5-day lead time, teams blocked
Goal: 5 services extracted in 12 months

Domain analysis (DDD):
  Bounded contexts identified:
    1. Users (authentication, profiles, addresses)
    2. Catalog (products, categories, search)
    3. Orders (checkout, history, status)
    4. Payments (cards, refunds, invoicing)
    5. Notifications (email, SMS, push)
    6. Inventory (stock, reservations, restocking)

Extraction matrix (prioritize by low risk + high value):
  | Service | Risk | Value | Effort | Priority |
  |---------|------|-------|--------|---------|
  | Notifications | Low | Medium | 4 wk | 1 (extract first) |
  | Inventory | Low | High | 6 wk | 2 |
  | Catalog | Medium | High | 8 wk | 3 |
  | Payments | High | High | 12 wk | 4 (parallel run) |
  | Orders | High | Critical | 16 wk | 5 (last) |

Shared infrastructure needed:
  - API Gateway: Kong or AWS API Gateway
    $ docker run -d --name kong -p 8000:8000 kong:latest
    $ curl -X POST http://localhost:8001/services \
        -d name=notification-service \
        -d url=http://notification-service:3000

  - Service Discovery: Consul or Kubernetes DNS
  - Distributed tracing: Jaeger or AWS X-Ray
  - Centralized logging: ELK stack
  - Metrics: Prometheus + Grafana
  - Messaging: RabbitMQ or Kafka for async events

Data strategy per service:
  | Service | Database | Justification |
  |---------|----------|---------------|
  | Users | PostgreSQL | Relational, ACID needed |
  | Catalog | MongoDB | Products with variable attributes |
  | Orders | PostgreSQL | Transactional, strong consistency |
  | Payments | PostgreSQL | Transactional, audit trail |
  | Notifications | DynamoDB | Key-value, high write volume |
  | Inventory | PostgreSQL | Transactional, reservations |

Inter-service communication:
  Synchronous (REST/gRPC):
    Orders -> Payments: charge at checkout
    Catalog -> Inventory: verify stock

  Asynchronous (events):
    Orders -> Notifications: "OrderPlaced" event
    Payments -> Orders: "PaymentConfirmed" event
    Inventory -> Catalog: "StockUpdated" event

  Circuit breaker config (Resilience4j):
    CircuitBreaker:
      failureRateThreshold: 50%
      waitDurationInOpenState: 30s
      slidingWindowSize: 10

Metrics after 12 months:
  | Metric | Monolith | 5 services |
  |--------|----------|------------|
  | Deploy frequency | Weekly | Daily (per service) |
  | Lead time | 5 days | 4 hours |
  | Deploy failure rate | 8% | 1.5% |
  | MTTR | 2 hours | 15 minutes |
  | New dev onboarding | 3 weeks | 1 week |

How do I handle testing in microservices?

Use a multi-level strategy: unit tests within each service, contract tests between services (Pact), integration tests with real dependencies (Testcontainers), and E2E tests for critical flows. Contract tests are the most important in microservices: they verify that consumer and provider agree on the contract. Without contract tests, a change in one service breaks consumers you do not know about.

How do I handle configuration in microservices?

Externalize all configuration. Use environment variables for values that change per environment (dev, staging, prod). Use a centralized configuration service (Spring Cloud Config, AWS AppConfig, Consul KV) for values that change at runtime. Never hardcode service URLs, credentials, or feature flags. Secrets must live in a manager (AWS Secrets Manager, HashiCorp Vault), not in files.