Can I ask how old you are fella?
This is one of those type of things that's annoying, and out of order, but yet happens. Little Barstewards.
It's one of the reasons i'm confident to get my camera out in a public place, because due to the fact i'm only 19, I still look young, so chances are that nobody will randomly say anything to me.
I'm not saying that because i'm only 19, i'm immune (spelling) to random abuse by scumbags, or chavs etc, but by being younger, people tend not to bother.
If there was 2 people, 2 exact locations and 2 exact times of day, only difference being 1 was aged 20, and one was aged 40, you could put money on the fact that if anything was going to be said, it'd be to the older person.
It's a sad, sad thing, but it happens.
But then again, it can work the opposite way round. So I guess it's swings and roundabouts.
Fair play to you fella, i'd have probably left aswell if they were threatening me. Not because i'm a coward, as i'm sure you're not, but for the fact of being on my own & being smart enough to leave before it got worse. Last thing you want is to be set-about-on by a load of little arsewipes with nobody in sight & are on your own.