No, they don't. You can see how much each unit is benefitted when a great general is nearby, and its the same regardless of how many generals are nearby.
If you have excess generals, use them for citadels, or if you're sweden, for city state alliances.