A midget? No.
But, I did get my arse kicked by my friend's elder brother who had downs syndrome, when i was about 8.
I hit him with a plastic sword and the fucker went ape-shit. He pushed my face into the carpet until I cried! As a result, I still get a little spooked when I see a bus-load of them on a day out somewhere.