If you arent allergic to condoms and u use them, can something happen to you?

I dont know if im allergic to condoms or lubricant, bc of either one i just got rid of a yeast infection. Can something happen to me if i use allergic condoms and i really wasnt allergic to them?