SpaceDock.info (Mod Hosting Site)

[TonyT]

Is it just me or has the website been going up and down over the past weeks? I see that there has been updates but as recently as 10 mins ago, the website was down.

[HebaruSan]

48 minutes ago, TonyT said:

Is it just me or has the website been going up and down over the past weeks? I see that there has been updates but as recently as 10 mins ago, the website was down.

It's just you.

[reschke]

It is super slow today. Normally I download 100-300MB files in less than a minute from almost every other site but Spacedock has been running about 10 minutes to download mods like Nertea's Far Future Technologies which is only 224MB.

 

[ColdJ]

6 hours ago, reschke said:

It is super slow today. Normally I download 100-300MB files in less than a minute from almost every other site but Spacedock has been running about 10 minutes to download mods like Nertea's Far Future Technologies which is only 224MB.

 

Sadly I can confirm this. Averaging about 500 kb a second.

[ColdJ]

Unable to publish my latest mod which is 26mb. It takes forever to upload and always cuts out before it finishes, then tells me I forgot something. I Uploaded a simple text file to have the page ready after many failed attempts but no matter how many times I try I can't get the proper zip file to upload without cutting out.

[DasSkelett]

On 3/4/2022 at 11:57 PM, reschke said:

It is super slow today. Normally I download 100-300MB files in less than a minute from almost every other site but Spacedock has been running about 10 minutes to download mods like Nertea's Far Future Technologies which is only 224MB.

 

On 3/5/2022 at 6:39 AM, ColdJ said:

Sadly I can confirm this. Averaging about 500 kb a second.

5 hours ago, ColdJ said:

Unable to publish my latest mod which is 26mb. It takes forever to upload and always cuts out before it finishes, then tells me I forgot something. I Uploaded a simple text file to have the page ready after many failed attempts but no matter how many times I try I can't get the proper zip file to upload without cutting out.

The server itself is fine, uploads (of 50 MiB files) and downloads work fine for me in a nearby location. I can even reach the usual 480 Mbit/s when downloading with a well-connected server.

Assuming it's not another browser-related bug (I'm using Firefox and it works perfectly), it's most likely issues with the path through the internet between you and SpaceDock. But we can't really do anything against that.

You could try downloading a test file from this page, which is served from the same datacenter as SpaceDock: http://fsn.icmp.hetzner.com/
If it is similarly slow, then we know for sure it's no SD's server, if it's a lot faster, we know we need to dig deeper.

Edited March 7, 2022 by DasSkelett
Fix testfile link

[Stone Blue]

I'm in Eastern US, and just downloaded that 1GB test file... Only took a few minutes, and very constant and steady 3.0-3.6 MB/s .... averaged to 32.6Mbps for the whole thing...

I usually get 3.8-4.5MB/s on SD... but... you know how it goes...

[ColdJ]

1 hour ago, DasSkelett said:

If it is similarly slow, then we know for sure it's no SD's server, if it's a lot faster, we know we need to dig deeper.

Sent you a personal message. Forgot to mention I use Firefox browser.

[reschke]

6 hours ago, DasSkelett said:

Assuming it's not another browser-related bug (I'm using Firefox and it works perfectly), it's most likely issues with the path through the internet between you and SpaceDock. But we can't really do anything against that.

You could try downloading a test file from this page, which is served from the same datacenter as SpaceDock: http://fsn.icmp.hetzner.com/
If it is similarly slow, then we know for sure it's no SD's server, if it's a lot faster, we know we need to dig deeper.

Thanks for the information. I am using Firefox and am located in Alabama. Currently running the test download on the 100MB file and it is taking nearly 5 minutes to download. I'm doing good right now to hit 500Kb on the DL speed. I usually get similar speeds to what @Stone Blue mentioned in his test file download. I'm sure it has to be something between me and the server if others are getting what I am used to getting.

Edited March 7, 2022 by reschke

[Stone Blue]

I'm on Firefox also.
Yeah, Idk... I rarely have a problem with SD speeds/connectivity, whenever orthers report bandwith/connection issues. I usually only ever see issues when its a kknown issue with the SD server in Germany itself... vOv
Maybe I am just lucky, always being able to connect with good servers.. ?? vOv

[cineboxandrew]

I'm having trouble uploading through Curl. I get an error that the site is down when I'm able to access it in a browser 

5
{"error":false}<!DOCTYPE html>
36
<html lang="en">
37
  <head>
38
    <meta charset="utf-8">
39
    <meta http-equiv="X-UA-Compatible" content="IE=edge">
40
    <meta name="viewport" content="width=device-width, initial-scale=1">
41
    <title>SpaceDock - Error</title>
42

43
    <!-- Bootstrap -->
44
    <link href="https://staticweb.52k.de/css/bootstrap-4.3.1.css" rel="stylesheet">
45

46
  </head>
47
  <body>
48
    <div class=" text-center">
49
       <h1 class="display-4"><img src="https://staticweb.52k.de/images/sd.png"><br /></h1>
50
       <h1 class="display-4">The site is unavailable right now.&nbsp; </h1>
51
<p class="lead">Please check the <a href="https://forum.kerbalspaceprogram.com/index.php?/topic/170865-spacedockinfo-mod-hosting-site">KSP Forums</a>&nbsp;for updates.<br />If you want to help with uptimes you can help us cover server costs by <a href="https://www.patreon.com/user?u=2903335&ty=h">donating to us on patreon</a>.</p>
52
       <hr class="my-4">
53
		
54
    </div>
55
    
56
    <!-- jQuery (necessary for Bootstrap's JavaScript plugins) --> 
57
    <script src="https://staticweb.52k.de/js/jquery-3.3.1.min.js"></script>
58

59
    <!-- Include all compiled plugins (below), or include individual files as needed --> 
57
    <script src="https://staticweb.52k.de/js/popper.min.js"></script>
58
    <script src="https://staticweb.52k.de/js/bootstrap-4.3.1.js"></script>
59
  </body>
60
</html>

The curl command is here:

https://github.com/drewcassidy/KSP-Conformal-Decals/blob/github-actions/.github/workflows/ksp-publish.yml#L117-L127

Edited March 10, 2022 by cineboxandrew

[DasSkelett]

3 hours ago, cineboxandrew said:

I'm having trouble uploading through Curl. I get an error that the site is down when I'm able to access it in a browser 

Thanks for letting us know. I can reproduce it, but have no clue why this happens yet...

[Lisias]

6 hours ago, cineboxandrew said:

I'm having trouble uploading through Curl. I get an error that the site is down when I'm able to access it in a browser.

The curl command is here:

https://github.com/drewcassidy/KSP-Conformal-Decals/blob/github-actions/.github/workflows/ksp-publish.yml#L117-L127

Use the -A option to set the same user-agent string your browser is using.

Even by the site allowing unknown user-agents to hit it, sometimes the CDN or any other service-in-the-middle borks when an unrecognized user agent is detected .

Some of them even blocks the request when they detect the default curl user-agent...

Edited March 10, 2022 by Lisias
unrelated. SpaceDock doesn't requires it.

[DasSkelett]

5 hours ago, cineboxandrew said:

The curl command is here:

https://github.com/drewcassidy/KSP-Conformal-Decals/blob/github-actions/.github/workflows/ksp-publish.yml#L117-L127

I think it's the curl command. "-c" only *writes* the cookies to the file, use "-b" to read from a cookie file.

Somehow the 403 is converted into a 502 while the request is passed through the proxies, maybe because the body isn't fully read before the response is sent.

26 minutes ago, Lisias said:

Use the -A option to set the same user-agent string your browser is using.

Even by the site allowing unknown user-agents to hit it, sometimes the CDN or any other service-in-the-middle borks when an unrecognized user agent is detected .

Some of them even blocks the request when they detect the default curl user-agent...

SpaceDock doesn't do any user agent checks, and there aren't any external CDNs in front, so that's not a problem.

[cineboxandrew]

5 hours ago, DasSkelett said:

think it's the curl command. "-c" only *writes* the cookies to the file, use "-b" to read from a cookie file.

Somehow the 403 is converted into a 502 while the request is passed through the proxies, maybe because the body isn't fully read before the response is sent.

Ah, thanks. You should probably update the example command in the docs then https://github.com/KSP-SpaceDock/SpaceDock/blob/master/api.md

 

[ColdJ]

@DasSkelett

Finally got my latest mod to upload. It took over 5 minutes to upload 25mb but when I downloaded to make sure it was all there it only took 2 seconds, so something is definitely off with the process.

At least it actually made it. So I am happy.

 

[cineboxandrew]

On 3/11/2022 at 5:10 AM, ColdJ said:

@DasSkelett

Finally got my latest mod to upload. It took over 5 minutes to upload 25mb but when I downloaded to make sure it was all there it only took 2 seconds, so something is definitely off with the process.

At least it actually made it. So I am happy.

 

Sounds like a problem with your ISP upload speed. From GitHub actions im uploading a 2.5MB mod in under 5 seconds

[ColdJ]

9 hours ago, cineboxandrew said:

Sounds like a problem with your ISP upload speed. From GitHub actions im uploading a 2.5MB mod in under 5 seconds

It was fine before the fix on the 20th of February to solve the Chrome problem. That is the trouble with thousands of lines of code, a small change can have unforseen effects in other parts of a program.

I can upload to a file sharing site at the expected speed so it is definitely related to the Spacedock server.

[ColdJ]

Hi. Still having trouble uploading to Spacedock. My last mods only made it after about 10 attempts each. The dropouts seem to happen at random times in the upload.

I am trying to upload an update today that is around 29 mb but after 2 hours it still can't make it.

Is there any possibility of having a choice between the pre Chrome fix upload method and the post Chrome upload method?

[linuxgurugamer]

Hmmm, I uploaded to Spacedock this morning using Chrome, didn’t have any issues.  Could it be some sort of issue with your internet?

[ColdJ]

1 minute ago, linuxgurugamer said:

Hmmm, I uploaded to Spacedock this morning using Chrome, didn’t have any issues.  Could it be some sort of issue with your internet?

Hi, I don't use Chrome, before the fix I had no problems, after it is very hit and miss and very slow for me. As you can see from my posts, it has been a month since I brought this up previously. As it was still happening I was wondering if maybe there was another way to approach it.

[DasSkelett]

10 hours ago, ColdJ said:

Is there any possibility of having a choice between the pre Chrome fix upload method and the post Chrome upload method?

No. this is not possible. We cannot run two versions of the reverse proxy at the same time.

[ColdJ]

9 minutes ago, DasSkelett said:

No. this is not possible. We cannot run two versions of the reverse proxy at the same time.

Have you had any progress in working out why the fix for Chrome would cause problems for other browsers?

[DasSkelett]

33 minutes ago, ColdJ said:

Have you had any progress in working out why the fix for Chrome would cause problems for other browsers?

No, but you can take a look through the CHANGELOG files of ATS and see if you find something that sounds like it could cause your problem:

1. https://github.com/apache/trafficserver/blob/8.1.x/CHANGELOG-8.0.6
2. https://github.com/apache/trafficserver/blob/8.1.x/CHANGELOG-8.1.0
3. https://github.com/apache/trafficserver/blob/8.1.x/CHANGELOG-8.1.1

[ColdJ]

3 minutes ago, DasSkelett said:

No, but you can take a look through the CHANGELOG files of ATS and see if you find something that sounds like it could cause your problem:

Found the problem.....

Joking of course. If I could program and work that out then I would have solved it and given you the fix already. I know that that is not my forte and I very very much appreciative of the work you do. I know there are people who expect you to be able to just click your fingers and have it done, but I am not one of those. It is just frustrating, not being able to upload when I used to be able to quite easily. And I would prefer not to install the intrusive Chrome that has had over 20 major vunerabilies found in it in just this year.

I will keep constantly trying in the hopes that 1 attempt might get through, but I am feeling like my days of being able to share what I have made might be over.