Software Engineer Analytics & Experimentation Interview Questions

Practice 16 real Analytics & Experimentation interview questions for Software Engineer roles. From companies including Optiver, Anthropic, Graham Capital, Amazon, Microsoft.

16 Questions 13 Companies03.01.2026
Showing 16 results
Role
Anthropic logo
Anthropic
Hard
Software Engineer Locked

How do you design an A/B experiment?

This question evaluates competency in online experiment design, including hypothesis framing, metric selection and guardrails, unit of randomization a...

Analytics & Experimentation
20
0
246 people solved
Mar 1, 2026
Optiver logo
Optiver
Hard
Software Engineer

Design and backtest a trading strategy

Minute-Level Mean-Reversion Strategy: Design, Backtest, Validation, and Significance Context You are given minute-level OHLCV data (open, high, low, c...

Analytics & Experimentation
19
0
360 people solved
Aug 13, 2025
TikTok logo
TikTok
Hard
Software Engineer

Define and measure project metrics

Design and Measurement: Metrics, Instrumentation, and Experiment Plan Context (added for clarity) You are shipping "Freshness Boost," a change to the ...

Analytics & Experimentation
4
0
50 people solved
Sep 6, 2025
Figma logo
Figma
Hard
Software Engineer

Define and measure article trending

Design “Trending” for Articles: Definition, Measurement, and Evaluation Context You are building a "Trending" ranking for an articles surface (e.g., h...

Analytics & Experimentation
26
0
183 people solved
Sep 6, 2025
Anthropic logo
Anthropic
Hard
Software Engineer

Design a profiling plan for kernels

Rigorous Profiling and Experimentation Plan for a Kernel Simulator You are given only a kernel simulator that reports cycle counts and microarchitectu...

Analytics & Experimentation
21
0
166 people solved
Sep 6, 2025
Google logo
Google
Hard
Software Engineer

Design A/B testing platform

Design an A/B Testing Platform (Architecture + Experiment Science) Context You are designing an A/B testing platform for a large-scale consumer web/mo...

Analytics & Experimentation
7
0
82 people solved
Sep 6, 2025
Axon logo
Axon
Hard
Software Engineer

Design an e-commerce analytics warehouse

Design an Analytics Warehouse for an E‑commerce Platform Context An e‑commerce platform exposes the following user-facing services: - Item search - It...

Analytics & Experimentation
8
0
84 people solved
Sep 6, 2025
Roblox logo
Roblox
Hard
Software Engineer

Define success metrics and monitoring

Define success metrics and monitoring Design success metrics, evaluation, and monitoring for an audio detection system Context You are defining the me...

Analytics & Experimentation
3
0
45 people solved
Jul 31, 2025
Microsoft logo
Microsoft
Medium
Software Engineer

Identify research to improve business

Analytics & Experimentation Strategy to Improve Business Outcomes Context Assume you are a software engineer interviewing for a role focused on analyt...

Analytics & Experimentation
4
0
48 people solved
Sep 6, 2025
Visa logo
Visa
Hard
Software Engineer

Design an experiment assignment service

Design an Online Experimentation (A/B Testing) Assignment Service You are asked to design a highly available online experiment assignment service. The...

Analytics & Experimentation
8
0
69 people solved
Aug 11, 2025
Graham Capital logo
Graham Capital
Medium
Software Engineer

Explain project assumptions and validation methods

Assumptions, Validation, and End-to-End Process for an Analytics/Experimentation Project Context: You are describing a recent analytics/experimentatio...

Analytics & Experimentation
3
0
58 people solved
Sep 6, 2025
NVIDIA logo
NVIDIA
Medium
Software Engineer

Define developer-centric usability metrics

Usability and Product Metrics Beyond Latency and Accuracy Context: In a technical screen focused on analytics and experimentation, propose how you wou...

Analytics & Experimentation
7
0
50 people solved
Sep 6, 2025
Optiver logo
Optiver
Medium
Software Engineer

Simulate return-weighted rebalancing strategy

Simulate return-weighted rebalancing strategy Problem: Momentum-weighted daily log-return statistics You have N assets with end-of-day prices over T t...

Analytics & Experimentation
7
0
119 people solved
Jul 16, 2025
Graham Capital logo
Graham Capital
Hard
Software Engineer

Model and measure trading transaction costs

Modeling and Incorporating Transaction Costs in an Event-Driven Trading Strategy Context You are designing an event-driven trading strategy that react...

Analytics & Experimentation
2
0
38 people solved
Sep 6, 2025
Uber logo
Uber
Medium
Software Engineer

Define and integrate room ranking factors

Define and integrate room ranking factors Design a Room-Ranking System for Meeting Requests Context You are building a service that assigns conference...

Analytics & Experimentation
3
0
60 people solved
Aug 1, 2025
Amazon logo
Amazon
Medium
Software Engineer

Brainstorm a business problem approach

Brainstorm a business problem approach Analytics & Experimentation Brainstorm (Scenario Provided) Context You are evaluating a feature proposal for a ...

Analytics & Experimentation
4
0
42 people solved
Jul 15, 2025

Explore more Software Engineer Analytics & Experimentation interview questions

Real questions from candidate reports, grouped by company, topic and role.

Other categories for Software Engineer
Analytics & Experimentation questions for other roles
Browse all