Explain Kafka partitions and delivery semantics

Quick Overview

This question evaluates understanding of distributed messaging and stream-processing concepts—specifically Kafka internals such as partitions, replication, consumer groups, and delivery semantics—and the candidate's competency in reasoning about ordering, scalability, fault tolerance, and transactional guarantees.

Explain Kafka partitions and delivery semantics

Company: Bloomberg

Role: Software Engineer

Category: System Design

Difficulty: hard

Interview Round: Technical Screen

Explain how Apache Kafka partitions, replication, and consumer groups work. How do these affect ordering, scalability, and fault tolerance? Compare at-most-once, at-least-once, and exactly-once delivery, and describe how you would implement idempotent, exactly-once processing end to end.

Overview: This question evaluates understanding of distributed messaging and stream-processing concepts—specifically Kafka internals such as partitions, replication, consumer groups, and delivery semantics—and the candidate's competency in reasoning about ordering, scalability, fault tolerance, and transactional guarantees.

|Home/System Design/Bloomberg
Bloomberg logo
Bloomberg
Sep 6, 2025
hardSoftware EngineerTechnical ScreenSystem Design
12
0

Kafka partitions, replication, consumer groups, and delivery guarantees

Context

You are designing and evaluating a Kafka-based data pipeline and need to reason about ordering, scalability, and fault tolerance, as well as how to achieve strong delivery guarantees.

Tasks

  1. Explain Kafka partitions, replication, and consumer groups:
    • What each is, how it works, and how they interact.
  2. Describe how these mechanisms affect:
    • Ordering
    • Scalability
    • Fault tolerance
  3. Compare delivery guarantees:
    • At-most-once
    • At-least-once
    • Exactly-once
  4. Describe how to implement idempotent, exactly-once processing end-to-end:
    • Within Kafka (topic to topic)
    • When writing to external stores (e.g., databases)
    • Include the key configs, algorithms, and failure handling

Submit Your Answer to Earn 20XP

Sign in to leave a comment

Loading comments...