I have had this problem ever since civ5 and civ6. Randomly every turn, randomly can make it full game without it.
Happens with mods
Happens without mods
Happens on turn 1
Happens on turn 500
Happen on every turn
Happen on every 5 turns
Happen on every 50 turns
Happens over LAN
Happens over internet
Happens on crappy computer
Happens on good computer
Happens with dirX 10
Happens with dirX11
Happens with dirX12
Happens with lowest gfx
Happens with highest gfx
Happens with player players verifying game files
Happens with vsync on
Happens with vsync off
Happens with gsync on
My solution for civ6 is nice. You get an alert when someone is desyncing and they get put back into loading screen (they auto rejoin) so just do NOT end your turn until they say "IM BACK". if you end your turn AI will take over and mess up all their stuff.
With civ5 it really sucked, cause they didn't know they desynced until they saw the map all weird and such.