Design device telemetry pipeline for real-time and batch

Q: Design device telemetry pipeline for real-time and batch

This question evaluates a candidate's competency in distributed systems architecture, data engineering, and operational trade-offs involved in designing telemetry pipelines that support both near-real-time and batch analytics.

Q: How do I approach System Design interview questions?

System Design questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master system design interviews.

Question

Design a distributed system that ingests telemetry from millions of devices and supports both:

Real-time analytics (near-real-time dashboards/alerts)
Batch analytics (historical queries, aggregates, offline jobs)

Cover:

Data ingestion (protocols, auth, buffering)
Storage choices for hot vs cold data
Stream processing vs batch processing
Schema/partitioning strategy
Scalability, reliability, and cost considerations
A minimal set of APIs/queries you want to support

Design device telemetry pipeline for real-time and batch

Quick Overview

Solution

Comments (0)