Topic archive
Kafka
Kafka architecture, consumer strategies, and event driven design.
-
Troubleshooting Kafka Producer Idempotence Failures and Their Impact on Message Duplication
A detailed guide to identifying, troubleshooting, and preventing Kafka producer idempotence failures that cause message duplication.

-
Optimizing Kafka Producer Retry Backoff Strategies to Prevent Message Duplicates and Improve Throughput
Explore effective Kafka producer retry backoff strategies that balance throughput and duplicate prevention, leveraging idempotent producers and exponential backoff.

-
Detecting and Mitigating Kafka Consumer Rebalance Storms in Large-Scale Deployments
Explore strategies to identify and reduce Kafka consumer rebalance storms to maintain performance and stability in large-scale environments.

-
Diagnosing and Recovering from Kafka ISR (In-Sync Replica) Shrinks in Production
A comprehensive guide to diagnosing and recovering from Kafka ISR shrinks, ensuring data consistency and cluster stability in production environments.

-
Handling Kafka Log Compaction Delays and Their Impact on Event-Driven Applications
Learn how Kafka log compaction delays affect event-driven applications and discover strategies to tune configurations, monitor metrics, and design resilient consumers.

-
Kafka Consumer Lag: What the Number Measures, Why Your Client Metric Disagrees, and What Actually Moves It
Consumer lag measured three ways on Kafka 4.3.1 (CLI, Admin API, client metric), a 480 ms latency penalty from a popular fetch.min.bytes setting, and two ‘safety’ branches in a common poll loop that never execute.

-
Exactly-Once in Kafka Streams: One Crash, Two Guarantees, and Where the Transaction Stops
The same crash-and-restart run under exactly_once_v2 and at_least_once on Kafka 4.3.1: 100 correct outputs versus 159 with double counts, what a read_uncommitted consumer sees during the aborted transaction, and a side effect that ran 160 times for 100 inputs either way.

