Yes they do.
Even if you can't find anything to fight with them, they keep the special promotion ability. In my last game I upgraded a kris swordsman all the way to great war infantry before he got his special upgarde. It turned out to be extra attack and movement, totally worth it.