Software Engineer Analytics & Experimentation Interview Questions
Practice the exact questions companies are asking right now.
Design a profiling plan for kernels
Rigorous Profiling and Experimentation Plan for a Kernel Simulator You are given only a kernel simulator that reports cycle counts and microarchitectu...
Define and measure project metrics
Design and Measurement: Metrics, Instrumentation, and Experiment Plan Context (added for clarity) You are shipping "Freshness Boost," a change to the ...
Design A/B testing platform
Design an A/B Testing Platform (Architecture + Experiment Science) Context You are designing an A/B testing platform for a large-scale consumer web/mo...
Define and measure article trending
Design “Trending” for Articles: Definition, Measurement, and Evaluation Context You are building a "Trending" ranking for an articles surface (e.g., h...
Identify research to improve business
Analytics & Experimentation Strategy to Improve Business Outcomes Context Assume you are a software engineer interviewing for a role focused on analyt...
Design an e-commerce analytics warehouse
Design an Analytics Warehouse for an E‑commerce Platform Context An e‑commerce platform exposes the following user-facing services: - Item search - It...
Model and measure trading transaction costs
Modeling and Incorporating Transaction Costs in an Event-Driven Trading Strategy Context You are designing an event-driven trading strategy that react...
Explain project assumptions and validation methods
Assumptions, Validation, and End-to-End Process for an Analytics/Experimentation Project Context: You are describing a recent analytics/experimentatio...
Define developer-centric usability metrics
Usability and Product Metrics Beyond Latency and Accuracy Context: In a technical screen focused on analytics and experimentation, propose how you wou...
Design and backtest a trading strategy
Minute-Level Mean-Reversion Strategy: Design, Backtest, Validation, and Significance Context You are given minute-level OHLCV data (open, high, low, c...
Design an experiment assignment service
Design an Online Experimentation (A/B Testing) Assignment Service You are asked to design a highly available online experiment assignment service. The...
Define and integrate room ranking factors
Design a Room-Ranking System for Meeting Requests Context You are building a service that assigns conference rooms to meeting requests across multiple...
Define success metrics and monitoring
Design success metrics, evaluation, and monitoring for an audio detection system Context You are defining the measurement, evaluation, and rollout pla...
Simulate return-weighted rebalancing strategy
Problem: Momentum-weighted daily log-return statistics You have N assets with end-of-day prices over T trading days. Let prices[i][t] be the closing p...
Brainstorm a business problem approach
Analytics & Experimentation Brainstorm (Scenario Provided) Context You are evaluating a feature proposal for a large consumer e-commerce site: add a "...