You get points for each turn you control a victory point. You control it by having a military unit there. The victory points are given to all starting positions. This sucks when you start 1 tile off the coast or 1 tile away from a better location. Because if you move, then your capital is no longer directly on top of the victory location, so now you must try and protect 2 locations (your capital AND the victory point).