I Went To The ER 8 Hours Ago, Due To

I went to the ER 8 hours ago, due to rectal bleeding, and when I was being discharged I believe th Dr told me if I develop a fever I need to go back to the ER ASAP. Looking over the post care I don't see that and now I'm running a fever of 101 and shaking like crazy. I have IBS, and a new internal hemorrhoid. Should I go back to the ER? I just don't wanna wake up my husband and kids unless it's necessary.