Comprehensive ML Concepts: Logistic Regression, Naive Bayes, Transformers, Multi-class Metrics, Bagging vs Boosting
Context
You are interviewing for a Machine Learning Engineer role. Answer the following conceptual and practical questions clearly and concisely.
Questions
-
Logistic Regression
-
Explain the core principles and statistical assumptions behind logistic regression.
-
Naive Bayes
-
How does Naive Bayes work? When and why does it perform well?
-
Transformer Architecture
-
Describe the transformer architecture. Why does self-attention help?
-
Multi-class Evaluation Metrics
-
What metrics would you use to evaluate a multi-class classification model and why? Briefly compare their use cases.
-
Bagging vs. Boosting
-
Compare bagging and boosting. How do they reduce error (bias/variance), and what are the trade-offs?