Well if you look more closely into Japanese history, you would also find various other peoples, such as the Kumamoto, Hayato, the Ainu, Chinese settlers, etc. Basically Japan is a huge mix of peoples from surrounding areas, with Koreans and CHinese being the majority.
Samgusaki, Nihon Shoki...