Jump to content

TheAlmightyOS

Members
  • Posts

    217
  • Joined

  • Last visited

Everything posted by TheAlmightyOS

  1. First off, sorry to some of the authors. You may notice the comma's in your comments have been changed to periods. In the conversion from nismobg's Community Mods and Plugins Library was a rough one. Converting his post from text to csv forced me to make some hard choices. However, now that the bulk of the data has been transferred, we can focus on cleaning up the small errors Ok, hard decision time. We got searches, we got pages to display the data... most of the data.... This is where I need users and mod authors to give me some input. Something that I always knew was going to be an issue was how to identify a mod within the DB. Up to this point I have used the mod name. However, that does not work when attempting to update a mod who's name is a sentence complete with punctuation. Also, the mod name / thread title might change. This will cause major issues later on and needs to be changed now before the database is finalized. Now, I don't wan't the authors to do anything different. I just need a different interface with, something more...static. An alpha-numaric that is unique to that mod? One option is combination of the userid and the threadid of a mod. Picking on RoverDude a tad, his useris is 108138. One of RoverDude's mods that I love using is FTT. The threadid for that thread is 91706. So the unique id for RoverDude's FTT Mod would be 108138-91706 However, this would NOT work for Hooligan labs. Hooligan Labs, like quite a few threads I sampled, have many mods in a single thread. So the above would only create a unique id for their posting, not for their individual mods. Mod Authors: Suggestions on what I should use for a unique identifier for your mod? Users, I need your input as well. I need to know what is important to you to see on that first post. There is an upper limit to how many characters you can put in a single post. I do not know the exact number, however I do know that the current database displayed in bbcode is roughly exactly 305998 characters and too large to fit. So to post it we need to chose what columns are important and which ones will only be available on the database site. Thank you everyone who participates The current database can be viewed HERE The current database Search can be viewed HERE
  2. It took me the better part of five hours for just this one bit of functionality, but after working with BlueFish and getting some aid from a family member that went to MIT for this sort of thing, I have it operational. I present to you, the working model of the Kerbal Modification Catalog: http://cyberhub.ftp.sh/KSP_DB/dbalpha3.php The database IS NOT complete. I will work on that tommorow. I am very happy with how this is turning out and quickly. Only a few more bridges to cross.
  3. MySQL [brain]> SELECT expletives FROM vocabulary WHERE NSFW = "Yes"; Added one extra variable and the whole thing tumbled down like a house of cards. PHP and MySQL.... there is like 4 different ways of making it work and all those are depreciated now for a system that is barely documented. Fear not, I have not given up. I have just traded in Notepad++ and nano for a IDE. This thing is getting built!
  4. eureka! I finaly figured out the HTML/PHP/SQL communication that is needed for the core functionality. I thought I was not being literal enough in my code when in fact the reverse was true. The more options and modules I stripped out the better it worked which is reverse of what the sites I had been reading on the subject had been suggesting. A working example is at the following link.http://cyberhub.ftp.sh/KSP_DB/dbalpha2.php . The search is restricted to usernames only in a small test db. Look to the first post of this thread for some good test cases. When I get a chance I will update OP with a dev roadmap, enable search for all columns and get the DB to at least mirror the current CMPL
  5. Slow going. Think I am trying to impliment too much at once. However, if I do not release an apha that can at LEAST outperform the old Community Mod Library then I won't be able to drum up enough Author and user support to move to phase two. Very close to full search functionality.
  6. Xatafase is $#!+. Moving on to custom made pages. Joy:rolleyes:
  7. Thank's Ippo. Nice to know one has an audience I am holding off on building a whole interface from scratch till I can test out xataface. Supposedly an all-in-one build your own site around a database. Right now it isn't even installing right which is not a good sign. Made some choices. Going to make it so only a single author is listed int the mod_author field of this table. If this takes off and I want to get fancy down the line I can always add a table with additional information like collaborators, images, videos, documentation, etc I will do so. For now the basics need to be meet. Secondly, all information provided by the author will be put into the database. If the author lists a github site on their post but the github does not have a download of the mod, I will still include the github site. It will be made clear to the end user that the links are not necessarily to locations where the mod itself can be downloaded. On the flipside, if an author has a direct download to the mod on their forum post (mysite.fake/mymod.zip) it will NOT be included in the database. That would be in violation of one of the rules I don't ever want to break: no downloads. The catalog is only supposed to help users find mods, not download or install them. And on top of that: if the mod was updated, is the link still valid or does it go to the old download? Too much to keep track of
  8. Over the past few days I have been attempting to make batch updates to existing records in the database with limited success. There are always a few errors and I end up restoring from backup. I have concluded from this testing that mod records should be updated individually and, if possible, though a GUI. Candidates for this GUI include the Adminer editor and phpMyAdmin. Both of these, IMHO are bad choices for giving to maintainers as tools. I think I will have to write something up simple or keep looking for a GUI MySQL editor. I also came a few questions today as I entered the data: should I post a mod's github page even if the mod can not be downloaded from there? If the mod direct-links to a download, should I store that link in "other" or let the user go though the forum link to find the download. Thinking the later but still. Also, Multiple authors... the table does not handle them well in the current state. I need to think on how to handle those types of situations, though they are few. I don't want to chop it off at the first author and leave everyone else off. Maybe a Current_Maintainer and a Collaborators fields? I know I am basically talking to myself right now but at least this keeps a record of what I have been thinking as it all comes together. The meds are really giving my memory a beating and this thread helps keep me on track
  9. PHP and MySQL is very easy to throw together. I already have a few test pages. However, putting the data in the forum is a NO GO. There is no way around it without compromising the security of this forum (which would get me banned) or impersonating an admin (which would get me banned) or sending an email to Squad asking for a change in policy for the forum (which...actually I wouldn't get banned for that, but just to stay safe...). So for now I am going to remove the requirement that the core features be on the forum. The new plan is to post an updated query output to the first post whenever there is a change (much like the CMPL), however, there will be more information and links to sites where you can perform searches and get customized information.
  10. Perfect. I want to thank everyone for participating in this thought experiment of mine. The general conclusion seems to be that speed and velocity are relative to the frame to which they are measured. I was thinking about the universe much like this: When I thought, jokingly, "why waste the rocket fuel? Let the galaxies come to you!". Then the stupid idea was stuck in my head. First I had to figure out movement. You guys did that nicely. The second part I figured out for myself: Could a vessel or ship, by not moving (within a frame of reference) travel to other planets/solar systems/galaxies? The answer is yes, dependent upon the frame of reference. And, I would add, is no different than the normal means of travel given another frame of reference. Actually might require more fuel too.
  11. I fear I do not have the words to properly format my question/thought. It requires me to know more about physics then I do. Think about the known universe. Everything is is motion. We have spinning planets circling around stars that are in turn traveling in a circular pattern around in a galaxy which is tugging on other galaxy's with gravitational forces. Everything is moving. You put a spacecraft between earth and the moon. Cancel you momentum so that you are not moving. But you are still moving. If you go by the moon and the earth as anchor points, you are standing still in space. But the Earth and moon are spinning around the sun, so, to that effect you are still moving. So what if you could stop? I suppose you would need some sort of anchor point or instrumentation to judge if we were actually stopped. Let's say something of that nature existed. Would it be possible to stop all movement? How much energy might this take? How might forces like gravity effect an object that is "stopped" in space?
  12. The database is cleaned up. Searches from command line are working which means I can make my HTML/PHP search dialogs with little effort. The what little I have in the database can be viewed here for anyone that is interested. It is unformatted and dynamic; as I make changes to the database you will see the changes in real time on that site. I have been spending most of my time today trying to tackle the dynamic posting issue. The administrators of this forum (wisely) disabled html content. That means I can not just post some code in a post linking to the DB. In a way I am thankful for that cause this forum would be a mess if anyone could do that. However, it presents with an interesting problem. At first I came up with a rube goldberg solution of automating the running of a query to be outputted to an HTML file, then converted to a PDF and finally converted to a jpeg and linked to the forum post. It almost worked, however the end result was about the same quality as a 1980's fax machine. That, and you can not click on a picture of a link. So that idea has been scraped I can easily run a html output query whenever I make a change, convert it to bbscript and post it here, but that is not any different then the Community Mods and Plugins Library. In fact, it might just be more work! In closing, the search function and automation are on schedule. Adding more mod data to the DB every day. However, posting dynamic database results to the forum may take an act of Mod. I may have to settle for a manually updated table on the forum that links to the main interface.
  13. First test for the database is to make sure we can query all that information and display it on a page. I can write queries, pipe the output to a webpage and link to it but that isn't any fun! I want the users to be able to actively search it for, lets say, their favorite modder. For this example we are going to use Ippo because, well, they were the first one I tried and got a null result So first I ran a query against the DB for all the mod authors: MariaDB [KSP_Mods]> select distinct Mod_Author from CMPL -> ; +---------------------------------------------------------------------+ | Mod_Author | +---------------------------------------------------------------------+ | Uzza | | RoverDude | | codepoet | | Ippo | | sarbian | | swamp_ig | | cybutek | | Fractal_UK | | Kragrathea | | blizzy78 | | BahamutoD | | SpannerMonkey | | PatPL | | Ezriilc | | L.J. Silver | | Nereid | | Nazari1382 | | BGog42 | | marce | | regex | | ClockPunkPanic | | Sam Hall | | Ninenium | | TwistedMexi | | Mihara | | Kreuzung | | Woopert | | GunTuga Custom Flag Pack | | UAL002 | | xEvilReeperx | | FlowerChild | | DMagic | | magico13 | | peadar1987, Xacktar, DuoDex | | Vendan | | Arsonide | | zyngawow | | malkuth | | rbray89 | | NathanKell | | HoneyFox | | ferram4 | | ferram4: Simpler FAR model | | Gaius | | allista | | Snjo | | many | | IRnifty | | Texel | | taniwha | | stupid_chris | | | | lttito | | UbioZur | | r4m0n | | Youen | | ttb | | Greys | | OrbitusII | | Qberticus | | TriggerAu | | nuclearping | | KevinLaity | | Diazo | | kujuman | | agises | | SirJodelstein | | mrenigma03 | | Biff Space | | avivey | | m4v | | spudbean | | TaranisElsu | | Jarcikon | | qfeys | | Xaiier | | toadicus | | PeteTimesSix | | Magion | | InfiniteDice | | JewelShisen, Hooligan Labs | | DYJ | | Shasol, Asmi | | Stavell | | yongedevil | | Starwaster | | tgruetzm | | Albert VDS | | PakledHostage | | Innsewerants | | Cilph, woogoose | | damny, technogeeky, Dmagic | | DasPenguin85 & Orcmaul | | Absolution | | alexustas | | LostOblivion | | Devo | | MrTheBull | | dtobi | | Tiberion | | kitoban | | mic_e | | NavyFish | | nothke | | carmics | | DennyTX | | Ledenko | | Dragon01, BobCat, Asmi, Blista100, Nertea, Yogui87, WCOLE360, Devo | | BananaDealer | | Talisar | | YANFRET | | frizzank | | Kommitz | | Galacticruler, fangflight | | Alskari | | Kickasskyle, Winston | | LazarusLuan | | Nertea | | e-dog | | Kerb-fu | | hoojiwana | | raidernick | | TurboNisu | | sumghai | | jnrobinson | | Beale | | nli2work | | coolpantskyle | | masTerTorch | | ludsoe | | N3h3mia | | Sethnizzle | | theSpeare | | Kotysoft | | CaptRobau | | ethernet | | rhoark | | Bodrick | | pizzaoverhead | | Iannic-ann-od | | kahlzun | | bac9 | | GilBr0ther | | keptin | | Octagon | | Porkjet | | Taverius | | Normak | | skykooler, taniwha | | sumghai | | Sippyfrog | | Lack | | helldiver, nazari1382 | | Michaelhester07 | | Tajampi | | SpeedyB | | noonespecial | | NovaSilisko | | jackkymoon | | Cerrakk | | Starstrider42 | | Trueborn | | Dooz | | Deadpangod3 | | neocromicon | | AlphaAsh | | Poryy | | KCreator | | medikohl | | Gravitasi | | Sido | | Yaeah | | SirJulio | | hab136 | | BigNose | | Roboto | | Rubber Ducky | | MachXXV | | okbillybunnyface | | KospY, Majiir, zzz, Winn75 | | PalverZ | | Cyrik | | Majiir | | Romfarer | | sirkut | | B | | Padishar | | BlackNecro | | Industries | | Felbourn | | Papa_Joe | | Xytovl | | Biotronic | | Paul Kingtiger, Daishi | | Ted | | Proot | | Thesonicgalaxy | | Valerian | | Razchek, Starwaster | | Why485 | | shaw | | Tingle | +---------------------------------------------------------------------+ 202 rows in set (0.01 sec) This shows me two things. First, the data needs to be cleaned up quite a bit. And secondly, Ippo most definitely is listed in the DB. So now I try to search for Ippo: MariaDB [KSP_Mods]> select Mod_Name, Mod_Author from CMPL where Mod_Author like ' ippo ';Empty set (0.00 sec) Huh, maybe I just wrote the script wrong. let's try with another... MariaDB [KSP_Mods]> select Mod_Name, Mod_Author from CMPL where Mod_Author like ' roverdude '; +-----------------------------------+-------------+ | Mod_Name | Mod_Author | +-----------------------------------+-------------+ | USI Exploration Pack | RoverDude | | Asteroid Recycling Technologies | RoverDude | | Asteroidal Resources | RoverDude | +-----------------------------------+-------------+ 3 rows in set (0.00 sec) dafaq? The only explanation I have is that the table columns were not properly formatted during creation. I am going to have to go back and recreate the table.
  14. Well will you look at that. That is just awesome pjf. I will look around at what you got going over there. I may add a ckan link column later on. KMC has barely made it out the starting gate. I need to finalize how I want the database to look and how to display it's contents properly before I move forward and start adding stuff. Thank you for the heads up and you guys keep being awesome.
  15. Kerbal Mod Catalog [DEAD] Due to other responsibilities and unreliable hardware I am abandoning this project. As it is licensed under WTFPL you are free to pick this up and do whatever the **** you want to it. I talked with a few people via PM about it a month or two ago. Sorry for leaving you hanging. My answers to you both is the database structure does not mater in the end. The primary concern that will make or break this project is reliably updating and displaying the information in that database. I never could do anything but update it manually. Goal: A database that stores information pertaining to the currently maintained mods to be updated regularly. Database should be searchable and browsable. Authors should have to do no extra work to maintain their posting however manual updates are available to those that ask. Core Founding Principles: Primary Content in the forum with additional content, search and features on a external website Database will not store any links that directly download a mod The database web interface will not automatically install mods/software The Kerbal Modification Catalog does not require Mod Authors to do anything differently then they do now. No special files, no pm's. The forum is searched and when we find a new mod we add it. You CAN let us know before that, but you don't have to. Only info made readily available by Mod Authors will be cataloged. Changelog: Version 0.0.1.2 [11/14/2014] Added a License to stay within forum rules: Version 0.0.1.1 [11/13/2014] Defined how forum members can make updates to the database Added more scrubbing to search Currently making the search results look like something other than paper. Not going well (I hate CSS) Added background image. Not crazy about it. Think of it as a placeholder. User input necessary for development to continue. Version 0.0.1.0 [10/29/2014] Moving to Alpha Status Core functionality achieved. See -link- for alpha test site (Server dead, link removed) Roadmap: 1. Add search for other columns 2. Bring database up to production standards 3. Maintainer/Author Submissions 4. Beta Testing / Server Load testing 5. Site graphics and layout. Version 0.0.0.3 [10/23/2014] Not possible to post dynamic content in forum. Restructuring plan to have primary output updated on OP when there is an update and links to additional features. Created HTML Table to BBCode Table script. Added to "Forum View Query" script. Posted pre-alpha proof-of-concept for forum table. Note, time stamps are Central Daylight Time. Version 0.0.0.2 [10/20/2014] Dropped the entire table. Starting over from scratch. Adding column for mod participation in KSP-AVC. Added an auto-generated number to identify mods and reduce duplicates BAD IDEA - Trying to find another way to uniquely identify a modification. Looking into author relations: Change/add requests, etc. Separated KSP version to Major, Minor, Revision and Build. To the user this will not be noticeable but will make searching for version numbers easier. Version 0.0.0.1 [10/18/2014] Created MySQL table on server. Populated table with information from Community Mods and Plugins Library (with permission) Table Columns: TimeStamp, Latest_KSP_Version, Mod_Name, Mod_Author, Mod_Type, Mod_Comments, Mod_Category, License, Forum_Post, Curse_Site, KStuff_Site, Other_Location Need a primary key for the table. Was going to use Mod Name but that would be too easy to create duplicates. Think I might use the thread number of the mod's forum post as the primary key. Need to think on this. Looking at CKAN repo for inspiration Made simple proof of concept php file. As the file shows raw login data for the database it can not be shown here yet Investigation "Dynamic Content" in vBulletin / BBcode Investigation of possible collaboration with CKAN project. Please put thoughts, comments, constructive-criticism, not so constructive criticism and outright personal attacks against my character below. I look forward to hearing your input
  16. Everyone becomes frustrated from time to time, says or posts something out of anger. He came here asking for help and regardless of how it was asked, I say we do our best to help without hostility
  17. check to make absolutely sure that you are using the 32-bit version and not the 64-bit version of KSP. This sounds like one of the issues I had when I was (stubbornly) attempting to make 64-bit work more reliably. The version should be displayed in bottom right hand corner of the opening screens and will say "64-bit" if that is executable that is loading. I know your first error log shows ksp.exe which is the 32bit executable, however I just want to make sure between that error log and now it has not started loading 64bit
  18. Someone should write up a proper how-to while MacTee is away. I would do it myself but my plate overflowith
  19. That is the plan! I want the WIDEST possible sample. What better sample than all of them . So anything on the Community Mods and plugins library that is current, I am downloading. These are my goals: Identify mods with atypical folder structure Extract help/readme/instruction files Extract or record version Extract or record author Extract or record download location Extract or record License information (by your request) ...And more! (linux is awesome) I am going to see just how much data I can collect from the mods zips themselves without relying on outside sources. I don't know what format that data will be in but I will make it available on the 'hub when I get it. First I got to download it all which (obvious, in hindsight) became quite the chore last night. Kinda forgot why we are making this repo, didn't I Anywho gonna try again tonight to at least get the most popular from curse and kerbalstuff. Keks, is there any OTHER data we might need down the road? Like you said, I am going to be hands-on a LOT of data. If there is something specific I can set it aside for later use
  20. Ok, so I edited my script to look though a folder of Zip files and print out the contents of each, thus showing us the ones that do not follow the unspoken standard of "gamedata/stuff". Now I just need to download all the (current) mods and run it on them. With some tweaking I think I could edit it to identify version files and readme files. But my script fu is weak as I need sleep. It will have to wait. Anyone want to help me out, I could use a text file with the direct download URL to every mod you can think of. It could be curse, it could be kerbalstuff, gethub, random cloud... I just need something to feed into my wget command tomorrow so I can start looking for the mods that need special treatment.
  21. My gethub account name is the same as here (and everywhere else): TheAlmightyOS. Nice thing about a unique name is people can find you everywhere. The bad thing about a unique name is people can find you everywhere . Though I am still not sure when I created a GitHub account and for what reason . There are many different models for development out there so I do not know which one you are currently using, but I am used to the Dev/Test/Production model and that it why I am advocating for creating a DEVELOPMENT working repo. This would not be an open-to-public repo, just one that we use to develop our software against, sort of like a development database. Doing so we can see the pro's and con's of the different processes and file structures, make some changes, wipe it and start over if something isn't working the way we want. I am no coder, just a systems tech that works closely and supports developers. And the ones I work with wipe/restore their dev database almost weekly while they are working on a new piece of software. Now making a TEST/Production repo? yeah, I agree that is madness at this point in the game. However that is just how *I* view things. Actual processes will have to be decided as a whole by everyone who wants to actively participate in the project. As for finding the "oddball" mods that can not be dropped into GameData, I have a Linux Bash script that did something similar. Will see if I can modify it to identify those mods. Will start with all mods listed here: http://forum.kerbalspaceprogram.com/threads/55401 I agree on the meta-structure. I think a lot of discussion needs to be done on that before anything else as that is the lynch pin that holds everything together.
  22. EDIT: I just got a lot to say about this project and MacTee's Mod Admin. I see something here and an idea is forming but just not enough to put into words accurately. I will try to write it out when I get a chance. EDIT2: Ok, trying again. First off, so we are on the right foot, I 100% support your idea and think all the work you have done has been spectacular. Any criticism is meant to be constructive. So if it comes off as non constructive slap me and let me know so I can reword it. Now, I want to better understand the goals of the project. In post #102 you redefine the project as being: The mod repository Description files aka meta-data The client application (developer tools and manager application) It looks as if you are currently working on the manager application? If so, have we got the mod repository and the Description files nailed down? That is, do we know how we want the repo configured and by what rules the file format will follow? If not, we could have someone working on these aspects while you create the client application. Also, populating a repo is a lot of work for one person. Maybe we can start training a select few on how to create the DF's (description files) and populate a development/test repository that we can use in application development (aka, Mod Admin all OS) as well as to develop workflow / automation for the maintainers. Basically what I am saying is the same thing I said a few posts up. Don't go it alone. The thread name is "Combining efforts", so let's
  23. Don't shoulder it alone. put up what you got already in Github or something, let us take a crack at it while you are working. When you come back, approve or deny the changes and move forward. That is how opensource/linux projects work. That is what we are trying to emulate, right? We understand your vision. So let us help.
  24. forgive me, I have not had the time to go though the entire thread. Keks, are you building this prototype by yourself?
×
×
  • Create New...