You are right, that feature is part of GS. I am still playing Vanilla and there are no map labels.
I was already considering finally expanding my Civ6... But with this surprising port to PS4, I might switch to a fully expanded couch experience on PS4 this winter