Linking a Shopify App's Support Team to Retention and Growth, Plus a Turnaround Plan
Company: Shopify
Role: Product Manager
Category: Analytics & Experimentation
Difficulty: medium
Interview Round: Other
You are the product manager for an app that merchants install from the Shopify App Store, and the app already has a customer care team. Leadership wants to know whether that team is genuinely helping the business grow, and what should happen if it is not.
### Clarifying Questions
- Which kind of growth matters most here: new installs, keeping paying merchants, or moving merchants to higher plans?
- Can support conversations be joined to each store's install, billing and uninstall records?
- Does the team only answer incoming contacts, or does it also run setup help and cancellation conversations?
- Is there data from before the team existed that could serve as a baseline?
### Part 1 — Measure the team's contribution
How would you determine whether the customer care team is contributing to the app's growth? Define what contribution means for this app, the metrics you would track, and how you would separate the team's effect from everything else that moves growth.
```hint Follow the merchant after the contact
Reply times describe how the team works, not whether growth changes. Ask which merchant behaviors drive this app's revenue, and how you could compare merchants whose support experience differed while everything else stayed similar.
```
#### What This Part Should Cover
- A definition of growth for a subscription app on the Shopify App Store and the specific levers care can move
- A metric chain from service quality to merchant behavior to revenue
- A method that estimates the team's causal effect rather than a raw comparison of merchants who did and did not contact support
### Part 2 — Respond if it is not contributing
Suppose the evidence shows the team is not contributing to growth. What steps would you take?
```hint Find the cause before changing the team
A disappointing number has more than one possible explanation, and not all of them involve the team itself. Work out which explanation fits before you choose a fix.
```
#### What This Part Should Cover
- A diagnosis that separates team execution, avoidable demand created by the product, and measurement gaps
- Fixes matched to each cause, with owners
- How you would confirm the fixes worked, and what you would do if they did not
### What a Strong Answer Covers
- Consistency between the metrics chosen in Part 1 and the fixes proposed in Part 2
- Outcomes specific to a Shopify app, such as setup completion, uninstalls, plan upgrades and App Store ratings
- The team's value weighed against its cost to serve
- Explicit decision thresholds for keeping, changing or restructuring the team
### Follow-up Questions
- Merchants who contact support uninstall more often than merchants who never do. Does that mean support hurts retention?
- How would you run an experiment when withholding support from any merchant is not acceptable?
- Leadership wants a single number for the team on the company dashboard. Which would you choose, and what could it hide?
Overview: A two-part Shopify product manager question on judging whether a Shopify app's customer care team actually drives business growth, and what to do if it does not. It tests metric design, causal measurement that goes beyond simple comparisons, and diagnosing whether weak results come from the team, the product or the data.