villager swap in lots of rogues and wonders under the sun (summer event quest)

I hosted all the games this has happened in, the games load normally, there is no sign of desynch on both ends and only the host seems to get vill swapped, since no one of my coop partners got this problem playing with me - the first 5 villagers that start next to your tc seem to be the only ones that get affected by this, seeing that the other ones that spawn close to the wonder load normally
It doesnt seem to affect a civ in specific, since i played with 4 of 6 civs (excluding egypt and babylonians) and all my coop partners didnt play with a single civ too (played with all 6 as coop partners)