Because I don't think golf relies on physical exertion and primarily uses mental thinking to win. Like chess.
While, the mopping part might be exerting, the point of curling is not to mop is it? And the exertion is not exactly, sprinting, weightlifting and so on.