In order to establish an embassy, you need to chose Conduct espionage from the city's contextual menu (pop-up menu or whatever).
You will get the contextual menu by Ctrl+Click:ing on the capital.
Ctrl+Click is useful throughout the game, use it on units, terrain, whatever...
Also, if...