Can I Stop Taking Omeprazole And Start Taking Natural Supplements?

I was on prednisone back in Dec. for 10 days, 30mg a day. Was not tapered off and went through some very terrible side effects. Acid Reflux being just one of them. I'm taking 20mg of omeprazole an hour before breakfast & 1 150 mg of radintine at bed time. I starting to experience some side effects from that now. Joint pain, bloating, gassiness, belching, can't sleep, not eatting much, anxiety, etc... Can I stop taking the omeparzole and start taking an all natural suppelement Slippy Elm bark?