The quest system also grants affinity xp, but it is currently broken and you don't receive affinity quests like you should past turn 100. Ryoga's Affinity Quest Fix mod fixes this.
You can also get affinity points for a random affinity from alien skeletons sometimes. You can also get a free affinity level from progenitor ruins. The might tree has some virtues that boost affinity as well.