In the course of learning machine learning, I understand that bootstrapping is considered a powerful approach for adjusting for overfitting in measures of predictive ability of a model. Based on information I have gathered, I have tried the following approach for my work (logistic regression to predict binary outcome with 50 predictor variables),
First, I would appreciate if someone could comment on whether there is any problem in the approach.
Second, do I understand right that I am basically evaluating the selected variables for their predictive ability, but not the model itself. Because during each iteration, the model is fit with different data and thus the model will be different each time with different estimated coefficients. So, can we really say that we are evaluating the model?
I will be very thankful for anyone who could help me out with this confusion!