I think it's the opposite. Due to the limits on how many athletes from one country can participate in the olympics in a given sport the athletes from Hong Kong wouldn't even be there. In table tennis for example the 4 best ranked men are chinese so they had to make tough choices as to who they could bring (they could only field 2 in the singles). The athletes from Hong Kong would have competed with them to participate.