Hee, hee...good question, and a reasonable answer! Knights in plate armour were like tanks, used for frontal assaults against lighter-armed infantry. Light cavalry (i.e. Horsemen) were better for hit-and-run tactics, which is what occurs when someone passes through your ZOC.
So sure...it's because they are weighed down by the armour!