How do you choose your final model?

I am curious how do you choose your final model for submission? I am using stratified cross-validation with 10-50 folds and models with smaller loss (mean over folds) are performing worse on the test set. Do you have some methods that would allow to state that this model will finally perform better?