Have not tried it myself, but would making those horses immobile through some spells and ability, namely blinding light and entangle, work?
As I skimmed through the change log a moment before, it stated that from patch k, immobile units cannot defensively retreat. I thought it might become handy...