Download database restructuring

Discussion in 'Civ2 - Scenario Creation' started by The_J, Jul 3, 2021.

  1. Blake00

    Blake00 King Supporter

    Joined:
    Sep 24, 2016
    Messages:
    822
    Gender:
    Male
    Location:
    Australia
  2. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    Not the scenarios though, that is done already ;).
     
    Blake00 likes this.
  3. Blake00

    Blake00 King Supporter

    Joined:
    Sep 24, 2016
    Messages:
    822
    Gender:
    Male
    Location:
    Australia
  4. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    I have the list, so I can easily check this manually.
    A part links to scenario league pages, so I can chek the download still, and move it accordingly.
    For truly dead links, I've asked in the interal moderators subforum if we need a "dysfunct mods" category per Civ section, or if there is any other way (besides re-uploads, which is something else we are discussion), but haven't come to a conclusion.
     
  5. Blake00

    Blake00 King Supporter

    Joined:
    Sep 24, 2016
    Messages:
    822
    Gender:
    Male
    Location:
    Australia
    No worries mate, let me know how it goes as I probably have or can get quite a lot of the files for those truly dead downloads. That the was the other B topic of my original thread as I reckon I can help with that. :)

    .
     
  6. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    As soon as everything's re-organized, I'll have a look which scenarios are truly lost, who of the creators is active/inactive, and if maybe someone has the files still. We still need to decide among the moderators, but there is the option that we might re-upload recovered scenarios of inactive authors (active authors would first be asked themself, if they have it on their own, or if they give consent, or not, etc.; Not so easy, as you can see).
     
    Blake00 likes this.
  7. JPetroski

    JPetroski Deity

    Joined:
    Jan 24, 2011
    Messages:
    3,852
    I'm late to the party but I support this decision wholeheartedly :)

    Personally I'd argue that inactive author works should simply be reuploaded - in most cases the readmes will say we're free to do so if properly credited. I am only aware of one author (Michael Jeszenka) who had requested that his works be removed. I would argue that his wishes should be granted, or at least have someone scrub the files of his name and upload as "anonymous" if the scenario itself is to be saved. I suspect his motivation had to do with the fact that he was active as a scenario designer when he was a younger teen and used his real name. Not all of us want to own that ;)
     
    Blake00 and The_J like this.
  8. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    I've now made the request to the admins to have the above implemented.
    Please let me know if there are any strong issues with this solution. (the issue with the maps was mentioned, but that can be sorted out on a case by case basis).
    I don't know when the admins get around to do it, but I hope in the coming weeks. After the implementation there will be a few days, when all the current downloads will probably be in the ToT or MGE category, I will need some time to move everything around.

    Thanks everyone for their input, and thanks @Blake00 for initiating it :hatsoff:.
     
    Blake00 likes this.
  9. Blake00

    Blake00 King Supporter

    Joined:
    Sep 24, 2016
    Messages:
    822
    Gender:
    Male
    Location:
    Australia
  10. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    @leif erikson has implemented the changes today :hatsoff:.
    It seems right now that everything is where it should be.
    Right now all current downloads are in the Civ2: ToT section (besides one test move).
    I will move all the downloads to the right categories over the weekend.

    For some things it will not be obvious for me where it should be, so expect some questions ^^.
     
    gapetit, Blake00 and Civinator like this.
  11. Blake00

    Blake00 King Supporter

    Joined:
    Sep 24, 2016
    Messages:
    822
    Gender:
    Male
    Location:
    Australia
  12. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    Okay, I've now moved all the scenarios around, and everything else what was obviously labelled.

    For a few things I need help.

    #1 Scenarios labelled as ToT, but automatic check says MGE
    It would be nice if someone could fire these up and confirm if they're MGE or ToT

    #2 Scenarios, where I could not determine it automatically or through the description
    Same here as above, if someone could do a check with their Civ2 version please :).

    #3 Classification issues
    This should be a map, no?

    #4 Lost scenarios
    These downloads seem to be lost (many by the user Ansar). If anyone has these somewhere, please let me know, I can then replace the broken downloads.


    After most of these are done, I guess I'll try to tacke the unit graphics probelm...
     
    Blake00 likes this.
  13. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    Okay, I've had a look at this. The site https://www.civfanatics.com/civ2/downloads/ is part of our main page (which you just reach under civfanatics.com).
    It's a wordpress installation (AFAIK), which we use to compile information and post news.
    The linked page is indeed outdated. I'll request permission to fix it (since this is again a different set of permissions than our moderator permissions).
     
    Last edited: Aug 4, 2021
    Blake00 and Knighttime like this.
  14. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    Okay, so... I've updated the description on this site, with some smaller things.
    Please let me know if there is anything criticial or otherwise very important (e.g. what about the test of time patch project?) which should be added there.

    BUT:
    I basically discovered that we have an old remnant download database here, from probably before the time when we had our current one. The 753 (or whatever the number was there) downloads mentioned there probably refer to this.
    Now... I need another weekend or 2 to sort this out, oh boy :cringe:.
     
  15. Prof. Garfield

    Prof. Garfield Deity Supporter

    Joined:
    Mar 6, 2004
    Messages:
    3,522
    Location:
    Ontario
    The Test of Time Patch Project is occasionally updated by @TheNamelessOne , and scenarios tend to take advantage of the latest features once they are available. Since the downloads section might seem a bit more 'official' than a forum thread, I would be concerned that someone might download an outdated version of the patch and run into trouble. At the moment, the first post for the Test of Time Patch Project Thread points to the post with the latest version, so it is convenient to link to there. Theoretically, it shouldn't be a problem to update the download database either, but in practice I could see it getting forgotten.
     
  16. Blake00

    Blake00 King Supporter

    Joined:
    Sep 24, 2016
    Messages:
    822
    Gender:
    Male
    Location:
    Australia
    Done with work for the week so should hopefully be able to go through your problem list asap, although I'm dealing with a bit of a unpleasant fever from the 2nd pfizer jab so it may still be a couple of days as my bed is calling me lol.

    Oh wow.. we were just talking about updating the menu to have links to the modern day download resource area as well the classic old backup one. Sounds like you're thinking about merging the old into the new?? That would be very cool however that's gonna be a hell of a job mate as I've spent quite a lot of time in that old downloads area and a lot of of the scenarios are broken up into separate zip files (eg one for scenario plus one or more for sounds). Also a decent number of those scenarios have duplicates in the newer downloads resource area and also over on the CFC hosted Scenario League plus sometimes these older ones are an inferior older version of the mod.
     
  17. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    mmmhh... okay, so right now it sounds like it shouldn't be necessary to add it, since it's not a de-facto standard of some kind, right?
    (this introduction section in the overview is very brief, so it's not meant to be extensive, but rather only critical things).

    Get well soon :).

    Yes, I thought about merging the old into the new one, and then getting rid of the old one.
    In theory the automatic down and re-uploading should be a lot easier here, but I feared what you said: Outdated and duplicated items.
    I think for some things this will be less of an issue (e.g. graphics), but I can see the problem with the scenarios.
    I guess I'll first download everything, then see if I can compile everything into a list, and then make a first check myself with the list in the new DB. That should help.

    Oh boy...
     
  18. Blake00

    Blake00 King Supporter

    Joined:
    Sep 24, 2016
    Messages:
    822
    Gender:
    Male
    Location:
    Australia
    Yeah we can just create a entry in the resource downloads section that links to NamelessOne's thread since downloads section supports external link instead of attached files. In several cases where I created an entry in the downloads section for a modern day project I just linked to the authors thread in case of file updates.

    Yeah it's a real mess and some of those duplicates would be in completely different looking zip files too. Just a mess. I doubt anyone would hold it against you for leaving as is as it was not part of the original scope of the job request. Although if you don't do it then you'd need to go update the drop down menu again as I noticed you've removed the legacy download link entirely from it. The legacy download section will be more lost than ever if no one can get to it from the front page anymore.

    Speaking of ToTPP I suspect from some of the below cases that the specially designed ToT Patch Project scenarios are messing with your version checker. Maybe @Prof. Garfield has some thoughts on that.

    Right let's get into this...

    https://forums.civfanatics.com/resources/middle-earth.6573
    Tested - Definitely MGE era, will not load in ToT, Ansar mislabeled.
    https://forums.civfanatics.com/resources/operation-herbstnebel-v2-0-for-tot.26528
    Tested - Definitely ToT, is specially designed for ToTPP.
    https://forums.civfanatics.com/resources/second-front-redux-by-captain-nemo-converted-for-tot.26593
    Tested - Definitely ToT, is specially designed for ToTPP.
    https://forums.civfanatics.com/resources/cold-war-crisis-for-test-of-time.24382
    Tested - Definitely ToT, but doesn't appear to be ToTPP so not sure why it fails your version checker.


    https://forums.civfanatics.com/resources/dragon.6588
    Tested - Definitely MGE era.
    https://forums.civfanatics.com/resources/epiccasualwwiieurope.28575
    Tested - Definitely ToT, is specially designed for ToTPP.
    https://forums.civfanatics.com/resources/epicwwiieuropeproject.28911
    Tested - Definitely ToT, is specially designed for ToTPP.
    https://forums.civfanatics.com/resources/tes-the-stormcloak-rebellion-project.28912
    Tested - Definitely ToT, is specially designed for ToTPP.

    Nope don't let the name fool ya.. Every time I see it I think "why did @Kasius Klej call it that???" I mean I know technically why as the scenario uses a small map but yeah soooo not a good name lol... It's a shame as it's very cool and he a put huge amount of work into that scenario & modpack as it has all these cool Civ1 graphics and clever features modded in yet he gives it name that no one will probably click on because they think its just some map thing lol! Also please note it's definitely a MGE era scenario mod.

    Yup Ansar did some cataloging/rescuing work similar to what I'm doing now except he did some weird linking to the old downloads area that sometimes worked and sometimes didn't and he didn't always put author name which was bad form.

    https://forums.civfanatics.com/resources/la-belle-epoque-v2-0.2154
    Got it! MGE scenario. It's over at the Scenario League HERE. Maybe change the download link to just link to that page as that's what I've done with other SL scenarios in the CFC download resource area as the SL is on CFC's servers so no point uploading a duplicate file wasting space. Just interlink instead. :) ->DONE
    https://forums.civfanatics.com/resources/ultima-5-scenario.7738
    Got it! MGE scenario. Actually recently found this one on the forums in THIS THREAD too. Change download to link to the thread I guess but the actual file is located offsite which is a worry though. ->DONE
    https://forums.civfanatics.com/resources/anorak.6549
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. ->DONE
    https://forums.civfanatics.com/resources/atlantis-the-lost-empire-v1-1.6553
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. ->NEED TO MERGE DOWNLOAD
    https://forums.civfanatics.com/resources/dracula-of-transylvania.6562
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. ->NEED TO MERGE DOWNLOAD
    https://forums.civfanatics.com/resources/empires-war-for-supremacy.6558
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. ->NEED TO MERGE DOWNLOAD
    https://forums.civfanatics.com/resources/final-fantasy-iii.6548
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. ->DONE
    https://forums.civfanatics.com/resources/j-r-r-tolkiens-dagor-bragollach-the-battle-of-s.6567
    DELETE. Ansar is not original author and I've made a much better page that utilises CFC SL HERE. ->DONE
    https://forums.civfanatics.com/resources/kingdom-of-athel-loren.6559
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. ->NEED TO MERGE DOWNLOAD
    https://forums.civfanatics.com/resources/lord-of-the-rings-v4-0.6589
    DELETE. Ansar is not original author and I've made a much better page that utilises CFC SL HERE. ->DONE
    https://forums.civfanatics.com/resources/magicians.6547
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. -> DONE
    https://forums.civfanatics.com/resources/moria-a-dark-journey-in-the-dark-v1-0.6572
    DELETE. Ansar is not original author and I've made a much better page that utilises CFC SL HERE. -> DONE
    https://forums.civfanatics.com/resources/myth-fall-of-the-gods.6574
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. ->NEED TO MERGE DOWNLOAD
    https://forums.civfanatics.com/resources/prince-of-darkness.6551
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. -> NEED TO MERGE DOWNLOAD
    https://forums.civfanatics.com/resources/return-of-the-king.6584
    DELETE. Ansar is not original author and I've made a much better page that utilises CFC SL HERE. ->DONE
    https://forums.civfanatics.com/resources/the-fellowship-of-the-ring.6585
    DELETE. Ansar is not original author and I've made a much better page that utilises CFC SL HERE. ->DONE
    https://forums.civfanatics.com/resources/ultima-online-the-second-age-v2-41.6557
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. -> NEED TO MERGE DOWNLOAD
    https://forums.civfanatics.com/resources/underdark.6550
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. -> NEED TO MERGE DOWNLOAD
    https://forums.civfanatics.com/resources/war-of-the-realm.6587
    Got it! MGE scenario. Is over in the legacy CFC collection so I guess just link to the fantasy download page there unless you plan to go ahead with merge. -> NEED TO MERGE DOWNLOAD
    https://forums.civfanatics.com/reso...eater-scenario-official-release-pending.24792
    GONE! No luck with this one. Found his project forum thread but nothing useful there. Tried his website and download link in webarchive but no luck. His profile gives his steam account name so I could try msg'ing him there.

    #5 I also notice the ToT graphics area is still filled with MGE stuff.. So I'll see if I can go through that for ya soon too.

    .
     
    Last edited by a moderator: Aug 12, 2021
    Civinator likes this.
  19. The_J

    The_J Say No 2 Net Validations Super Moderator Supporter

    Joined:
    Oct 22, 2008
    Messages:
    33,946
    Location:
    DE/NL/FR
    Thanks a lot :hatsoff:.

    Seems the download database is a bit inconvenient with the re-uploads, as my mod privilieges don't allow me to directly re-upload a file, but rather I first need to claim ownership, re-upload the file, and move ownership back to the original user.
    I plan to move the stuff from the legacy site over, and to directly delete the entries there.
    I did already some of the easier updates, I'll continue with the rest tonight.
     
    Knighttime and Blake00 like this.
  20. Prof. Garfield

    Prof. Garfield Deity Supporter

    Joined:
    Mar 6, 2004
    Messages:
    3,522
    Location:
    Ontario
    I wrote this in the original thread:

    I checked a Test of Time Patch Project saved file, and the byte in question has a 33. I don't know when the Test of Time Patch project started differentiating saved files, but even a game saved with the most recent version still uses 33. Since 32 was the official version 1.1 patch, I think it is safe to say that all TOTPP saved games have 33 as the version byte. If @TheNamelessOne happens to be around, he can weigh in.

    So TOTPP saved games use bytes with value 33, and official v1.1 patched saves use 32 (must be converted to ascii character). Since this stuff wasn't in the document screenshot, I can see how it would be missed.
     
    Blake00 and The_J like this.

Share This Page