No, it makes sense. I wasn't sure if the POTUS had the power to oust governors- "state's rights" may be a buzzword, but it is also a very real part of the American constitutional system- but it is not as immediately obvious that he wouldn't, while legislators sit in altogether different branch of government. A more centralised system might allow the executive to boot governors, but I can't imagine any meaningfully democratic system actually allowing them to boot representatives. (Certainly the British executive can't; that's why they have to resort to murdering them.)
"States' rights" kinda goes out the window though if an elected official from that state starts advocating the violent overthrow of the federal government. You don't get to threaten the federal government if you are a part of that government. And yes, state governments are part of the larger federal system and are not as independent as they sometimes like to think they are.
And while no president has ever attempted to remove an elected state official, there is some precedent for the president having authority over individual state governors. Just take a look at the federalization of the National Guard and the deployment of the 101st Airborne Division to Little Rock, Arkansas to enforce integration since the governor refused to and even said he would use his state's National Guard troops to prevent black students from entering white schools.