Fractured Left Foot, Cast Removed, Still Unable To Walk. Suggestion And Advise

I had fracture my left foot 5th metatarsal between head and shaft , doctor said we can treat this with non surgical ,, it's been 4 weeks , yesterday when I went to them they removed my cast and put me bandage told me to bear partial weight step by step for another two weeks , when I put my feet body weight , I feel sharp pain n couldn't walk just moving myself little weight bearing with the help of crutches , do I need to wait for 2 weeks , or after then do I have to see physiotherapist I'm confused I thought I can walk after removing cast , could you docs pls suggest me advise for me recover soon .