Address Missing Income Bracket in California Housing Data
ML Case: Missing Lowest-Income Bracket in California Housing Data
Context
You're building a supervised model (regression) to predict California housing prices using a dataset similar to the classic California Housing data. One key covariate is household income. The training data contains no observations from the lowest-income bracket (< $25k), but the deployed model must perform well across all income ranges, including this unseen bracket at inference time.
Assume the deployment/test distribution will include the full income range, including < $25k. You may optionally have access to unlabeled production covariates (features only) that include the missing bracket.
Task
Design a modeling approach that achieves robust performance across all income ranges, with special attention to the unseen lowest-income bracket. Your answer should cover:
-
Diagnostics: How you’d confirm and quantify the shift and missing support.
-
Modeling strategy: Architectures/algorithms that extrapolate sensibly and incorporate domain knowledge.
-
Distribution shift handling: Methods such as importance weighting, domain adaptation/transfer learning, and data augmentation (if appropriate).
-
Feature scaling and preprocessing choices that help stability.
-
Validation: How you will evaluate performance for the unseen bracket before production, stress tests, and uncertainty estimates.
-
Deployment and incremental retraining plan once data from the missing bracket starts arriving.
You may reference techniques like domain similarity, incremental retraining, covariate shift correction, transfer learning, and feature scaling.
Constraints & Assumptions
-
Preserve the scope, facts, inputs, and requested outputs from the prompt above.
-
If the prompt leaves a detail unspecified, state a reasonable assumption before relying on it.
-
Keep the answer interview-ready: concise enough to present, but concrete enough to implement or evaluate.
Clarifying Questions to Ask
-
Clarify the task, data shape, labels, constraints, and evaluation metric.
-
State assumptions behind the math or modeling technique you choose.
-
Connect theory to practical training, debugging, and deployment implications.
What a Strong Answer Covers
-
Correct definitions and formulas where the prompt requires them.
-
A practical explanation of how the method behaves on real data.
-
Trade-offs, failure modes, diagnostics, and mitigation strategies.
-
Evaluation choices that match the product or modeling objective.
Follow-up Questions
-
How would noisy labels, class imbalance, or distribution shift affect the answer?
-
What would you monitor after deployment?
-
Which baseline would you compare against first?