Is the forum dying or in a renaissance: a statistical survey

Quintillus

Resident Medieval Monk
Super Moderator
Supporter
Joined
Mar 17, 2007
Messages
9,311
At least once a year, and often more than that, I read a thread that alternately proclaims that the forum (either C&C or Civ3 in general) is either dying, or in a renaissance. While there's always a few to argue either way, usually the only consensus is, "we don't have as many members as we did in the hayday." So, I decided to make use of the Wayback Machine, and see if I could get some more definitive answers, as well as to compare the trends across versions.

First, let's take a look at CFC in general. The below chart shows the total number of posts in the Civ forums over time.

AllCivForums.png


Growth was ever-increasing at ever-increasing rates until about July, 2006. That's about 9 months after Civ4 was released, and the time Civ4 Warlords was released. After that the growth has been more linear in general. Two data points stand out. There's a noticeable increase between July and October 2007, almost surely due to Civ4: Beyond the Sword's release - further evidence of that expansion's better reception than Warlords. Immediately after that, there's a drop in the number of posts. This isn't due to a moderation crackdown and massive thread deletion, but rather, the move of Never Ending Stories from Civ3 to Other Games, and with that, over 300,000 posts being moved.

But that doesn't tell a whole lot about any particular version of Civ, beyond that BTS was well-received. So let's look at the number of posts for each Civ version over time.

CivX.png


This tells a bit more. Civ3 grew at an increasing or steady rate until the beginning of 2005 - for about 3.25 years after its release, and more than a year after Conquests' release. Thereafter, the growth began slowing, at first gradually through about April, 2008 (the exact timing is obscured by the NES move and lack of data points in late 2007), and since then, it's been at a noticeably slower rate. However, the rate of growth did actually increase between 2010 and 2011. There have been almost 42,000 posts in the past year in the Civ3 forums - more than 100 per day. It's a far cry from the 1200 per day in 2004, or the 200 per day in the mid-2010 to mid-2011 revival, but still fairly active.

Civ4, meanwhile, experienced increasing or steady growth until about April, 2010, about 4.5 years after its release. Although now growing more slowly, it's still a significant part of CFC traffic.

Civ5, unlike previous versions, is showing noticeably slower growth less than two years after its release. Fewer recent data points in the Wayback Machine makes it impossible to say exactly when the decline began, but it's significant. Whether the recent Gods and Kings expansion will change that, we'll find out.

Now let's look at the individual forums to see what's driving growth.

Civ3Forums.png


The forum that immediately jumps out is Stories and Tales, with its drop of over half when NES left. Nevertheless, it's since regained over 40,000 posts.

We can see that while Civ3 General Discussions dominated early, since then, Creation and Customization has become king. It's also noteworthy that most of the new posts today are in Creation and Customization. 22,000 of the 42,000 posts in the past year have been there, and 27,000 of the 89,000 posts in the year before that. Multiplayer also continues to grow, having surpassed the slow-growing Strategy forum. With this closer view, we can see that an influx of posts in the Democracy Game forum was responsible for most if not all of the 2010 post increase, with 37,000 posts from mid-2010 to mid-2011, but that forum has had only 4 posts in the past year.

We can also see trends such as the flatlining of the Game of the Month, and if the graph were larger, a similar, though slower, decrease in the number of Hall of Fame posts, though from a much slower rate of posts to begin with. Odd spikes in the General forum are also seen when expansion pack forums are merged in.

It's also interesting to look at the story for Civ2:

Civ2.png


Civ2 has clearly reached the stable phase of forum activity. Growth was fast until early 2003, and by August of 2003 had noticeably slowed. Most likely, Civ3's PTW and Conquests expansions were significant factors in this. By the July 2005 to July 2006 period, Civ4's first year, activity averaged 10 posts per day. By the direct comparison, it appears that Civ3 has more than 10 times as much activity in its 10th year of release as Civ2. However, it must be considered that computers were much more common by the time Civ2 came out, as well as that while CFC is popular with Civ3 players, Apolyton seems to be more popular with Civ2 players Extrapolating, it appears likely that Civ4 will be more popular in its 10th year than Civ3, although it's questionable whether that will be the case for Civ5, which had 89,000 fewer posts in the past year than Civ4 despite being much newer. However, this could also be due to the effect of 2K's official forum.

Looking at Civ2's forum activity does give some more insight.

Civ2Forums.png


Quite noticeable is that soon after April of 2004, the Multiplayer forum, until then the most popular, slowed to a crawl. Its rate of growth had been slowing, though much slower, since early 2003. While this doesn't indicate a huge immediate impact from Civ3: Play the World, the numbers do show that Civ3's multiplayer numbers began increasing quickly as Civ2's decreased quickly in mid-2004 (the huge popularity of Civ3 General Discussions obscures this on the Civ3 Forum graph). Thus, it can be postulated that Civ3 Conquests' multiplayer, combined with more people having PTW or higher, contributed greatly to Civ2's multiplayer decline.

Also worth noting is that while C&C has become a primary activity area for Civ3, Civ2's Scenario Creation forum has been mostly dormant since July 2005, about the same time Civ4 came out. The recently added Civ2 Scenario League forum is now more popular than Scenario Creation.

Some trends aren't visible in the graphs, but are in the numbers. Civ3 was the only version of Civ to ever achieve 90% of the Civ forum posts, doing so in late 2004 before Civ4 was imminent, and is likely to remain the only one. Less than a month after its release, it already had 56% of the Civ posts at the then-young CFC. Civ4 passed Civ3 in mid-2008, and broke 50% of Civ posts in late 2008. Surprisingly, Civ4 has actually increased in percentage of Civ posts in the past year, with a small increase from 53.36% to 53.44%. The only other increase seen for a not-most-recent version was when the Never Ending Stories left the Civ forums for Other Games, which boosted both Civ1 and Civ2 by a small amount.

Finally, the notion that no one ever comes here except for Off Topic can be disspelled. When comparing the Civ forums to Off Topic, the Civ forums have consistently had 60-70% of the total posts.

OffTopic.png


While the numbers would be slightly closer with World History and Sports Talk included, even if we threw in the whole Colosseum and All Other Games (which includes Never Ending Stories), Civ would still have a comfortable lead. It's also worth noting that while it appears that Off Topic is in decline, the last datapoint does not include the new split-off Off Topic zones, which would give an additional 77,000 posts to the Off-Topic side.

Attached you'll find the spreadsheet I used for this in .zip format, unzippable to a .xlsx file (I can also modify this to include a .xls file if someone's interested in that). This has been updated as of February, 2013 (after one view for the original version).
 

Link to video.

:high5: :goodjob:


Random Thoughts
Where did you get the data points?

Would it be possible to breakdown Stories and Creation/Customization forums into their subforums?

I see some things (Civ3 Ideas and Civ3 UQAC) that I don't recognize. Can you expound or define them?

It looks like Civ3 General and Civ3 Stories are currently growing at the same rate.

In the data you have, is it possible to determine where a person's first post it located?
 
Link to Video

After about 45 seconds "fascinating" almost becomes background noise and is hardly processed anymore... interesting.

Where did you get the data points?

I used the Wayback Machine's snapshots of http://forums.civfanatics.com/, such as this one from 2009. Then it was just using the post counts for each forum.

Would it be possible to breakdown Stories and Creation/Customization forums into their subforums?

Possibly. Sometimes the Wayback Machine has data for sub-pages, sometimes it doesn't. For the main page, it has 461 captures. A few of those are really close together time-wise (a few hours), but in the 2006-2007 range I probably could have used monthly stats if I'd wanted to. For the subforums, it has a lot less. C&C has 34 and S&T has 18 (the earliest of the latter being in 2004). I probably could, but I might have to use different data points for the main forums - I chose the ones I did primarily to try to get them somewhat evenly spaced, and then zoomed in on a few eventful times, such as the release of BTS and Warlords, to see if I found any noticeable changes. The points I chose might not correspond with the S&T or C&C points.

I see some things (Civ3 Ideas and Civ3 UQAC) that I don't recognize. Can you expound or define them?

Way back when, there were a few additional fora that aren't here anymore. Civ3 Ideas is the Civ3 Ideas and Suggestions forum from before Civ3's release, similar to the Civ5 Suggestions and Ideas one more recently. I had to look up what UQAC was - it didn't even make it to Civ3's release. Turns out Thunderfall had the answer:

UQAC stands for Ultimate Questions & Answers Collection. It was like an early version of Info Center in which each category has its own thread.

I haven't found any archive of an actual UQAC thread. It was mentioned a few times, such as upon its creation a few months before the forum opened. I also found what I believe to be the oldest thread at CFC.

It looks like Civ3 General and Civ3 Stories are currently growing at the same rate.

Pretty much. In the past year (to the day), Civ3 General got 5700 posts, whereas S&T got 5900 posts.

In the data you have, is it possible to determine where a person's first post it located?

Not in this data, but I'm pretty sure there's a way to do that in the CFC search feature... will update in a few minutes once I've recollected it...

There is! Go to the Advanced Search feature, then put your name in (or the name of whoever you're stalking), and in the lower left of the search area, put "Sort Results By" to Last Posting Date in Ascending Order. Then switch the results from Threads to Posts. And voila! I also put the restriction of posts from A Year Ago and Older for the server's sake.

Turns out my 1st 10 posts were in the Civ4 forums (although the New Members thread got moved to Civ5 later on). But by my 44th post about a week later, I'd decided to go back to Civ3.
 
Oh! I see that the Wayback Machine is an actual internet thingee. I thought you were referring to Mr. Peabody, a Jay Ward cartoon creation.

About the first post: I was curious if there was a way to determine the count of first posts by forum. I'm not sure if that would mean anything, however. :sad:
 
Just went through the new Democracy and Multi-Team Games forums. Because of the "private forums", there were actually close to 2115 posts unseen to non-members. These are posts just from 6/11 to present. There are quite a bit more in private forums before the 6/11 point.

At the begining of the current ISDG, there was a restructuring of the Democracy Game fora. Just wanted to let you know there were more than 4 posts. :D
 
Very interesting. A rennaisance would imply that there is a sudden increase diverging form the trend. This is not the case.

Civ3 isn't really dying either though. There still is activity, but it's mostly a small core, that I doubt will change much.
 
I was implying it's all my fault.

:lol:
Yup. I can see the drop in overall posts when we heard you were thinking about signing up. But don't change. We seem to have gotten over it.
 
I'm with Spock; fascinating!

We are holding our own.

I've never been to Civ 4 (I don't think) and 5 got boring very quickly. III has been my game since it first came out..
 
The problem with the analysis is that you are using linear charts.
If you used logarithmic charts you would see that the growth was constantly decreasing.

Look at the numbers in the first chart.
There was a doubling from 1/1/04 to 6/1/06. Roughl two and a half years.

Recently, 2/1/10 to 6/1/12 it increased from about 4million to about 5.6 million, which is roughly 40%.

The activity is growing, but the rate of growth is decreasing.

Logarithmic graphs show percentages. Linear graphs are misleading as they tend to look more impressive that the data actually indicates.

They do show the relative popularity of the various games, and as expected, newer is more popular.
 
About the first post: I was curious if there was a way to determine the count of first posts by forum. I'm not sure if that would mean anything, however. :sad:

Ohhhh... that I don't know of a way to calculate. It would be interesting, though. I'd guess it wouldn't necessarily follow the most popular forums overall, but it's hard to say. Maybe one of the CFC administrators would have the ability to figure that out.

Just went through the new Democracy and Multi-Team Games forums. Because of the "private forums", there were actually close to 2115 posts unseen to non-members. These are posts just from 6/11 to present. There are quite a bit more in private forums before the 6/11 point.

At the begining of the current ISDG, there was a restructuring of the Democracy Game fora. Just wanted to let you know there were more than 4 posts. :D

I'd noticed that the Democracy games' post numbers were all over the place. I thought it was mostly archiving (and possibly un-archiving with the big jump) - I hadn't realized there were private forums within there. It's good to know there's more than 4 posts worth of activity!

The data of number of posts, are they cumulative posts to date or posts per month, year ?

They're cumulative since the beginning of CFC.

Very interesting. A rennaisance would imply that there is a sudden increase diverging form the trend. This is not the case.

Civ3 isn't really dying either though. There still is activity, but it's mostly a small core, that I doubt will change much.

That seems to be the case, yes. It's a slow decrease, about 19% per year if we take Democracy Games out of the count (it throws off the numbers a bit too much given the available data).

Versus Civ4's 46% year-over-year decrease, two-points-make-a-trend projections indicate that in 4 years Civ3 will be as popular as Civ5 (in new posts/year), and in 5 years Civ3 will be more popular. But Civ4, with hardly any decrease in the same time, will be nearly as popular as it is today. More sophisticated statistics might paint a different picture, as is the fact that Civ5 still has new expansions coming out likely to influence it.

I was implying it's all my fault.

:lol: Your start date might be in the timeframe when the post count noticeably decreased, but I don't think correlation implies causation here.

The problem with the analysis is that you are using linear charts.
If you used logarithmic charts you would see that the growth was constantly decreasing.

Look at the numbers in the first chart.
There was a doubling from 1/1/04 to 6/1/06. Roughl two and a half years.

Recently, 2/1/10 to 6/1/12 it increased from about 4million to about 5.6 million, which is roughly 40%.

The activity is growing, but the rate of growth is decreasing.

Logarithmic graphs show percentages. Linear graphs are misleading as they tend to look more impressive that the data actually indicates.

They do show the relative popularity of the various games, and as expected, newer is more popular.

Actually, the overall activity (per-time) is decreasing, too, in all Civ forums except perhaps Civ1 and Civ2, where the volume is much lower to start with (though Civ4 comes impressively close to even recently). I think there's advantage to both.

CivXLogarithmic.png


The logarithmic version does show the impressive rates of growth each version had early on, and the subsequent slowing in the rate of growth. But after a certain amount of time, it becomes more difficulty to discern anything - Civ3 looks basically flat/inactive since 2006 or so (other than the NES drop), whereas Civ4 looks hardly active even today. Of course it is logarithmic, so that isn't the case... but I think for this data set, a lot would be lost without a linear graph, too. Logarithmic also might not be a good fit for video games where participation isn't excepted to grow exponentially for very long, versus something like newly introduced kudzu where maybe it would grow exponentially for a long time (I don't know why I thought of kudzu as an example first).

Though it is more useful for the less posted versions, notably Civ1.

However, I am not a statistician, so I'm really relying mostly on intuition as to what's the best sort of graph.
 
Excellent research Quintillus! If I could suggest you post this in OT and the other subforums, so that more people see it, that would be great!
 
It would be nice to see a graph comparing specific subforums across versions. For example a graph comparing C&C for all versions. In some ways this might be a more accurate estimate of activity.

Taking Civ 3 as an example: at this point there is little reason to discuss potential features or how it compares to earlier versions. Strategies are well worked out. Bugs & AI issues are commonly known. Yet C&C remains vibrant. It's not uncommon to see posts from new members there. New members' posts in C&C even include questions that more properly belong in other forums, such as general installation issues. C2 C&C looks like it has a similar prominence in the overall C2 forum.

How best to structure the graph is a question. Using a ratio of C&C posts vs. total number for that Civ version as the y-axis unit would falsely favor earlier versions. One solution might be to structure the time axis as "time since release". The zero point would be a different real-world date for each version but the linear intervals would match - allowing easier visual comparison in addition to the statistics. I suspect that using a subforum vs. total posts ratio as the unit would also help correct for the expected dips when new versions come out.

A shortcoming of this type of subforum comparison would be the extension of curves beyond the available data for C5. It might still be useful as a beginning point for tracking expected trends since the addition of future data for C5 could be matched against predictive curves based on the trends of earlier versions. Versions released a long time prior to the establishment of their subforums would similarly lack data at the beginning of the graph. And numbers would be skewed from the time when Apolyton was still vibrant. Even so a lot of useful analysis could be derived from a graph structured with the same unit of time you've used but a different interpretation of the zero point.



Data concerning the separate Macintosh subforums for each version seems to be lacking in the posted graphs. Were they included in the data collection and the overall analysis? If so is it available in a way that would allow editing those graphs to include the Mac subforums as a line.
 
I'd noticed that the Democracy games' post numbers were all over the place. I thought it was mostly archiving (and possibly un-archiving with the big jump) - I hadn't realized there were private forums within there. It's good to know there's more than 4 posts worth of activity!



They're cumulative since the beginning of CFC.

As you say they're cumulative from the beginning, I'm wondedering how many of the 214,527 posts that are in the Civ III Archives were counted in your gatherings.
 
Very interesting data Quintillus! I am wondering if you could do a similar comparison with the number of units that are created for each version of civ? It would be interesting to see how that has changed over time and how civ3 compares to civ4 unit creation numbers.
 
Perhaps judging the health of the forums would be better determined from the amount of downloads? I know that I will post far less frequently than I download something from the site. I typically see over 1000 people (guests and members) on the site regardless of the time of day.

After being away from the forums for an extended time, it feels like the amount of new files to download has doubled. I am truly amazed at the quality and quantity of the submissions found here.

Just because most of the visitors to the forums are silent, it doesn't mean the forum(s) is(are) dying.

BTW, excellent research and discussion :)
 
Back
Top Bottom