As promised, some various thoughts:
As HOF-III players know, their Quartermaster's Challenge had an event known as Pentathlon, which required a submission of every mapsize. This event was deliberately dropped for Quattromaster's because Huge maps in Civ4 are nothing short of atrocious on computer resources. Instead League of Nations was devised as a replacement.
Interestingly enough though, we do assign the most points to Huge maps and scale down from there. It's possible a bell curve would be more appropriate, peaking on standard, with Huge and Large matching Small and Standard, and Duel getting the least amount of love at all, if any.
When designed, it was known that it penalized Vanilla users. Even if it chose the best 18, there would still be a selection advantage for Warlords players. It was decided not to worry about it based largely on our experience in HOF-III, where after the XP's started rolling out, Vanilla submissions became practically extinct. That hasn't happened in IV, as Vanilla remains quite strong, possibly due to the Gauntlets.
Of course there's going to be more of a problem with this once BTS is released. Then again, I have to wonder how someone can be such a Civaholic that they compete in CFC's Hall of Fame and not own an expansion pack a year old?
The Gauntlets have taken hold more so than expected. I do believe they are the heart and soul of the Hall of Fame.
If they need fixed, it's up to Firaxis to do it.
They weren't really intended for single play. If we add new levels to the Challenge, Duel may not make it.
There is always the possibility of a point scale on era starts, penalizing later age beginnings, but with the proposed BTS feature of buying advanced starts, this issue looks more and more problematic.
I look at submissions all the time and think "that's a quality game" or "that's a crap submission (filler material, etc)". However, I'm not going to publically state which games are which. First and foremost, that's because I'm here to judge the legality of the games, not the games themselves. Secondly, one person's cheese is another person's brainfood. Some of my own submissions are Future Duels, and a few of them I had didn't just play to fill a slot, I actually had a ton of fun, which is the ultimate point.
Then again, I too believe the HOF can be "more better" (as Denniz put it). There's two things I'd like to see happen most of all. First, I'd like to see the Quattromaster Challenge heightened in stature. We're the preeminent competitive environment of the largest Civilization community in the world, the Hall of Fame is the top of the food chain. The things that were done in Hall of Fame III directly impacted the very development of Civilization IV, and what we've done here has influenced patches and expansion packs both. We make the game as much as we break it, the two go hand in hand.
On the flip side, I think there's room for improvement in our submissions though. There's this general attitude out there that in order to play for the Hall of Fame you have to be seriously anal about milking for points and spending hours plotting tricks to save a turn or two. It drives me absolutely bonkers that people see that as a prerequisite for HOF competition. We welcome all submissions played within the rules, the tables sort themselves out as far as who is great, who is good, etc, etc. I have no idea how to expand on this one at this time though...
As far the as the overall Challenge goes, some kind of multilevel split seems to make sense. I almost wonder if an easier lower level shouldn't be added where Gauntlets aren't required, and then a higher level added where career Gauntlet submissions would be cumulative, a global rankings of sorts. That *might* make it more accessible and yet more elite simultaneously, but at this point in the evening, I'm in strong need of dinner and could very much be talking out my rear.