I read somewhere that it was the portugese who were first to trade with them. Maybe what i read was wrong.
but also in the game shogun total war, the portugese were first to arrive, but that is only a game, so it may not be accurate, however you are probably right, considering you are dutch...