Child. High Fever, Lazy Eye. History Of RSV Problems. Prescribed Zrytec. Help

My daughter is 5 years old. She has always had RSV problems since she was born at 33 weeks. She has an inhaler and does breathing treatments when her breathing is bad (right now we have NOT had any problems in that area since Feb.). She woke up Sunday with her eye looking bad; it looked like lazy eye (no running, itching, etc.). Monday morning woke up and it was crusted over but still no itching, etc. -- same thing Tuesday morning, but she started running temperature of 103.6 in the afternoon. Still no complaining with itching, etc. she complained that she felt sick. She has run a fever all day and back up to 103.8 tonight. Took her to doctor and they didn't think pink eye but gave her drops and said they thought it was allergies and told me to give her Zrytec. I'm just confused with the high fever. Should I take her back to the doctor??