To the best of my knowledge, the sea tiles are just like the land ones.
It must be in your cultural borders, but not necessarily any city's borders. If you build the improvement on it (i.e. fishing boat for all sea tiles), you have one (fish, whale, whatever) to trade, and you get the health...