Explain RF optimization and variable-importance pitfalls

Explain how you would optimize and regularize a Random Forest regressor for tabular data. Cover: (1) Why classic RFs do not prune post-training and how max_depth, min_samples_leaf, and max_features control overfitting. (2) Two importance measures—mean decrease impurity vs. permutation importance—how each is computed, when they disagree, and biases (e.g., favoring high-cardinality categoricals or correlated features). (3) How to obtain reliable importances using out-of-bag estimates, repeated permutations, or conditional/permutation schemes that account for correlations. (4) Practical steps to speed training on large data (e.g., subsampling, feature bagging, warm-starting trees).