I feel kind of bad and don't know if I was in the wrong?

There was a man in a wheel chair and I always take pity on such people but this guy just started shouting excuse me excuse me to try and get into a shop. I was thinking I know your behind me and in a wheel chair I understand this, but Im not moving any faster because I can't, and Im not going to rush because he was shouting like a maniac I know people in wheel chairs need special treatment but I felt he was going over the tip so I slowly moved because I don't like being shouted at. I know I must of looked like a complete horrible person but was I really that wrong to of done that, need some clarity on the situation.