What is RBF kernel?
- RBF kernel is more flexible than a linear kernel.
- As a result, in machine learning, when models are more flexible they can easily fit the noise in the data as well and consequently leading to over-fitting.
- This is analogous to Logistic Regression and Decision Tree.
- Decision Tree being more flexible than Logistic Regression is prone to over-fitting the data.