Despite being labeled as "+5% Settlement Growth Rate" the fish factory resource in Modern Age actually reduces the amount of food required for growth and thus if you stack enough of them you will end up with negative requirements and cities stuck unable to grow.