Page 77 of the manual says:
Tiles with "bonus" resources provide a lot of food once a worker constructs the appropriate improvement on the resource. These include bananas, cattle, deer, fish, and wheat.
But for fish it seems the game gives you the additional food even though the tile is not...