1. Difference between predict and predict_proba
predict_proba() will give out the probabilities
predict() will give the class value.
Class value can be used wherever the evaluation metric is accuracy, recall, precision ...
Whereas probabilities can be used wherever the evaluation metric is AUC, ROC_AUC, MSE, MAE, RMSE ...