Hi, I have been off the pill for 2 months, and about 4 days ago, I knocked my left nipple, and now there feels like a hard cyst or similar beside it, and it has pushed the nipple sideways. What should I do? I have had tender breasts since being off the pill so at first I just thought it was that. Now that I have my period, my breasts tend to stop being sore, and that s when I noticed the left nipple is a bit hard.