Honestly, just a hunch. After trying everything else I could think of I decided to try changing that. Set it to fullscreen and we played for 4+ hours without any issue, then the next day I swapped it back to borderless loaded up the game and we went out of sync 7 turns in again, so I went back...