Measuring Whether an Employer LMS Integration Pays Off for Coursera

Coursera sells companies access to its catalog so they can train their employees. Many large employers run training through a corporate learning management system (LMS), the internal tool where employees find assigned training and where HR and learning teams track who completed what. As a product manager at Coursera, how would you evaluate the impact of integrating Coursera with these corporate LMSs? Explain who the integration affects, what impact you expect, which metrics you would use, and how you would show that the integration caused any change you observe. ```hint Count every side The integration changes what employees do, what the learning team that runs the LMS does, and how Coursera sells and renews contracts. Map what each of them would do differently once it ships, including anything that could get worse for Coursera, before you pick metrics. ``` ### Clarifying Questions - Is the integration a proposal Coursera is deciding whether to build, or already live for some customers so its effect can be measured? - How deep is the integration: listing Coursera content in the LMS with single sign-on, or also syncing assignments, progress and completions back into the LMS? - Which outcome matters most to Coursera here: winning new business customers, renewing and expanding existing contracts, or usage within accounts? - Which LMS products and customer sizes are in scope? ### What a Strong Answer Covers - The stakeholders the integration touches (employees, learning and HR administrators, managers, Coursera's sales and customer success teams, the LMS vendor) and the expected impact on each - A primary metric tied to Coursera's enterprise business, such as seat utilization or net revenue retention, with leading indicators for administrator setup and learner usage - A causal design, such as a staged rollout or a difference-in-differences comparison with matched accounts, that handles the bias in which customers choose to integrate - Costs and risks, including building and maintaining connections to many LMS products, data privacy, and Coursera's brand fading inside the customer's tool - A decision rule that connects the findings to expanding, changing or stopping the integration ### Follow-up Questions - Integrated accounts renew more often, but they were also larger and more engaged before integrating. How do you separate the integration's effect? - Employee sign-ins rise after integration, but course completions do not. What might explain it? - How would you decide which LMS product to integrate with next?