2.7 AI-only Game Statistics (update: now with summary list of games)

pineappledan

Deity
Joined
Aug 9, 2017
Messages
8,420
Location
Alberta, Canada
Which is pretty close! In academia the number usually used for minimum required samples before applying C.L.T is 30, and Venice only has 28 games, but it still goes to show that the binomial assumption isn't terrible. Ideally of course all the civs have well over 30 games but that's hard to do when my computers are running 4UC games now
Woo!
 

CrazyG

Deity
Joined
Oct 14, 2016
Messages
6,057
Location
Beijing
I would be interested in seeing which social policy trees and ideologies correlate with victory. Would it be possible to have the utility also collect this information? It might be good to record religious beliefs (or at least which civs found a religion) as well.
 

CrazyG

Deity
Joined
Oct 14, 2016
Messages
6,057
Location
Beijing
Here's a graph of the civs win rate against their score on turn 100. A few interesting observations to see:

image1.png
 

pineappledan

Deity
Joined
Aug 9, 2017
Messages
8,420
Location
Alberta, Canada
The main takeaway I found from last time I compared scores to win rates is that they are basically not correlated.
 

stii

Emperor
Joined
Oct 3, 2010
Messages
1,155
Score is a pretty terrible way of seeing who is winning except in the broadest terms. While it does include the important things it also includes lots of very unimportant that also give lots of points.
 

Legen

Emperor
Joined
Sep 13, 2015
Messages
1,157
To confirm, is the AI still getting :c5goldenage: GAP from its difficulty bonuses? That's something that I've argued in the past about Brazil's performance months ago, and that may be affecting the results. This is also something I'm considering making a proposal about.
 

L. Vern

Chieftain
Joined
Sep 5, 2022
Messages
44
Location
Ontario, Canada
The main takeaway I found from last time I compared scores to win rates is that they are basically not correlated.
IIRC that was comparing scores at game-end time, It was possible that score at 100/200 turns could be correlated better but looks like a pretty weak correlation also
 

CrazyG

Deity
Joined
Oct 14, 2016
Messages
6,057
Location
Beijing
IIRC that was comparing scores at game-end time, It was possible that score at 100/200 turns could be correlated better but looks like a pretty weak correlation also
I calced these values for correlation between win rate and score (this is win rate, not individual games since you didn't provide that)

Turn 100: 0.27
Turn 200: 0.33
Turn 300: 0.37

I would guess that what's going on here is that having a low score is a good indicator of being a loser, but predicting the winner using score is pretty difficult. If possible, I'd track who has what social policies for more interesting exploration.
 

balparmak

Prince
Joined
Sep 20, 2015
Messages
544
This raises the question, how much does the AI consider the score when setting its rivals, or deciding its gameplan? If it heavily relies on score while score itself isn't a good metric, that's problematic and needs to change. @Recursive any thoughts?
 
Last edited:

Recursive

Already Looping
Moderator
Joined
Dec 19, 2017
Messages
3,907
Location
Antarctica
This raises the question, how much does the AI consider the score when setting its rivals, or deciding its gameplan? If it heavily relies on score while score itself isn't a good metric, that's problematic and needs to change. @Recursive any thoughts?
The player score? Not at all.
 

CppMaster

Deity
Joined
Feb 13, 2018
Messages
2,181
Location
Poland
Have the score ever been adjusted? Because the time victory may be unbalanced otherwise. Or we don't care at all about the time victory? I like that in Humankind or Stellaris you win when you develop the greatest empire (by having the highest score), so the metric has to be adjusted in order to judge fairly.
 
Top Bottom