Topic archive
Kafka
Kafka architecture, consumer strategies, and event driven design.
-
Implementing Kafka Consumer Request-Reply Pattern for Synchronous Microservices Communication
Explore implementing Kafka’s request-reply pattern to enable synchronous communication in microservices using correlation IDs and topic design.
-
Building and Scaling Kafka Stream Processing with State Stores and RocksDB in Production
Explore building stateful Kafka Streams apps with RocksDB for persistence, scalability, and fault tolerance in real-time processing.
-
Kafka AdminClient for Topic Configuration: incrementalAlterConfigs, What Happened to alterConfigs, and What the Errors Actually Look Like
Topic configs changed from Java against Kafka 4.3.1: every incrementalAlterConfigs op type with the observed result, proof that the removed alterConfigs API wiped unnamed overrides, and the real exception for each failure, including an ACL denial reproduced without SASL.
-
Practical Guide to Kafka Log Compaction for Event Sourcing Architectures
This guide explains Kafka log compaction for event sourcing, including setup, key design, producer/consumer examples, verification, performance tuning, failure modes, and best practices.
-
Implementing Kafka Consumer Backpressure and Flow Control for Stable Streaming
Explore techniques to manage Kafka consumer load using backpressure and flow control for resilient, scalable streaming applications.
-
Kafka Broker Maintenance Without Downtime: A Rolling Restart Runbook for KRaft Clusters
A recorded rolling restart of a 3-broker Kafka 4.0.0 KRaft cluster with a live acks=all producer: what to check between brokers, what the ISR and controller do, and why the usual grep-based health check cannot fail.
-
Implementing Kafka Transactional Outbox Pattern for Reliable Event Publishing
Explore implementing the Kafka transactional outbox pattern for reliable, exactly-once event publishing and strong data consistency in distributed architectures.
-
Step-by-Step Guide to Kafka MirrorMaker 2 for Cross-Data Center Replication
A comprehensive guide to deploying and optimizing Kafka MirrorMaker 2 for seamless cross-data center data replication.
