Depends who does it. Roosevelt is safe.
Anyone else and especially Russia, Norway, India, Egypt and Aztecs a big no no. And when you encounter them, start making armies. They will declare war on you quickly even if you are in an island, and they are half way the other side of the map.