Shop Visibility And Commerce Analytics
Asked of: Data Scientist
Last updated

What's being tested
Tests the ability to run cohort analysis and time-series aggregation to quantify shop visibility, apply dedup/ranking logic, and design stable visibility/intent metrics. Also probes experiment-aware modeling and uplift modeling for causal buyer-engagement decisions.
Patterns & templates
-
Window functions for deduping and last-event logic —
`ROW_NUMBER()`OVER (PARTITION BY shop ORDER BY ts DESC); tie-break with deterministic id. -
Time-based grouping using
`DATE_TRUNC('day', ts AT TIME ZONE ...)`or`ts::date`; always specify timezone and bucket boundaries. -
Conditional aggregation idiom:
`SUM(CASE WHEN event='view' THEN 1 ELSE 0 END)`or`COUNT(DISTINCT CASE WHEN ... END)`; use`FILTER`when available. -
Cohort assignment: compute
`first_seen_date`per shop, then join a calendar of relative days to measure retention/decay across cohorts. -
Ranking & percentiles:
`DENSE_RANK()`or`NTILE()`over visibility metric; report distribution buckets to stabilize noisy tails. -
Uplift modeling templates: T-learner / S-learner or meta-learners; evaluate with Qini/ uplift-AUC and policy risk, avoid post-treatment features.
-
pandasperformant idioms:`df.groupby(['shop','date']).agg(...)`,`resample('D')`; push heavy aggregations back to`SQL`/`BigQuery`for >10M rows.
Common pitfalls
Pitfall: Using impressions as denominator then comparing to views without matching exposure leads to biased visibility ratios.
Pitfall: Double-counting events across overlapping time-windows or failing to dedupe session-level events inflates metrics.
Pitfall: Training an uplift model using post-treatment features or leaking future exposure produces overly optimistic policy estimates.
Practice these
The practice cards below cover the canonical variants — solve all of them and time yourself.
Practice questions
- Write SQL to analyze shop visibilityMeta · Data Scientist · Onsite · medium
- Write SQL for shop visibility and activity metricMeta · Data Scientist · Onsite · medium
- Write SQL to compute shop visibility shareMeta · Data Scientist · Onsite · medium
- Compute shop visibility and intent metrics in SQLMeta · Data Scientist · Technical Screen · medium
- Calculate Daily Visibility Score for Each ShopMeta · Data Scientist · Onsite · medium
- Calculate Shop Visibility Ranking in Search ResultsMeta · Data Scientist · Onsite · medium
- Design Experiment to Measure Shopping Feature ImpactMeta · Data Scientist · Onsite · hard
- Evaluate the Success of Instagram CheckoutMeta · Data Scientist · Onsite · medium
- Determine Old vs. New Users' Shop Visibility ChangesMeta · Data Scientist · Onsite · medium
- Analyze New Shops' Activity Compared to Existing OnesMeta · Data Scientist · Onsite · medium
- Build Predictive Model for Buyer Engagement UpliftMeta · Data Scientist · Technical Screen · medium
Related concepts
- Shop Ads And Social Commerce Analytics
- Shop Ads And Shopping MeasurementAnalytics & Experimentation
- Revenue, Marketplace, And Monetization Analytics
- Marketplace Metric FrameworksAnalytics & Experimentation
- Ads, Revenue, And Marketplace Analytics
- Ads Ranking And Monetization AnalyticsAnalytics & Experimentation