-
Notifications
You must be signed in to change notification settings - Fork 5.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Geographical CDN issue causing meteor & package install problem #6960
Comments
@dksharp Seems like a connectivity problem. Can you see what happens if you run this command? Mac OS X
Linux
If the same thing happens, will you provide the output of: |
@abernix output of: host static-meteor.netdna-ssl.com- traceroute to static-meteor.netdna-ssl.com (198.232.125.32), 30 hops max, 60 byte packets PS: I have seen one recent same question, maybe of yesterday, on stackoverflow. same problem. |
I am able to do all other work just fine. installing other things and all. Connection is fine. Only installing meteor is giving me this error. |
@dksharp There were no additional error messages from the But you're right, I've seen other recent similarities #6723 (comment). |
@abernix I have been trying this since Sunday. can't find any solution. |
Ok, new command, old CDN: Mac OS X
Linux
@dksharp, Can you see if that works? (It's a 167MB file, just FYI, so it needs a long, reliable download.) |
@abernix Yeah. It works. Why that standard command is not working :( |
It's a network problem. I can't say for sure why, but it seems to be a problem with the new CDN. It's only happening to some people. Thank you very much for helping to figure it out. Could you try one more time with this (slightly different) command: (which enables cURL retries and file-resume) Mac OS X
Linux
Thanks again, @dksharp |
Its working. I think new CDN is closing connection abruptly or something like that. |
Ok, that last command works though? If it does, then we can look into changing the install script to use those extra flags. Please report back if it works with the |
Btw, while this is not the recommended installation method, you can use that bootstrap tarball by:
Which will install it into your home directory in the You can then:
|
The last command worked. I did it using both flags. Will report with using individually. |
Thanks, we're looking into this. |
Folks who are having problems (eg @dksharp): Where in the world are you located? This may be a geographically specific issue with our new CDN. |
I saw India (2x) and Lebanon. |
I've replicated the issue with a VPN to India. We'll be filing a support ticket with the CDN when we have more details. In the mean time, we've reverted to the old CDN for the installer. The meteor package updater ( Thanks again, @abernix, for your help here. Much appreciated. |
Yes, guys I'm facing this issue in India from past 3+ days. Though, I did installed meteor manually but it was painful as compared to our recommended process. Also, becuase of this...now everytime I had to use sudo with meteor command. |
@allpratik When did you see this? We reverted an hour or two ago, so if you're still seeing problems then there's a surprise. |
Or do you mean you're seeing the issue downloading packages? |
@glasser No I didn't tried packages. Also, I tested it before 10 hrs. So, let me check current situation and also check packages as well. |
I tested downloading multiple files over the VPN to India. Curious results. Here's what I've found so far:
So it seems the error only occurs with big files, via curl not the meteor tool, from some places (only tested India so far). |
If anyone else who saw this issue could please post their IP address and the output of |
And if you are not comfortable posting your IP publicly, feel free to email me privately at nick@meteor.com. |
@shaileshtheroyal You also had problems installing/downloading, I believe. Could you provide your information as @n1mmy posted above? @n1mmy Is it possible the Windows installer is/was accessing the new CDN already as well? If so, maybe reach out to the two people in RocketChat/Rocket.Chat#6955 for their traceroute...err... |
@n1mmy I've been having the same problem in Belgium last couple of days. I can confirm it's due to bad internet connection but I don't think it's because of curl. When trying wget, the same problem occurred. Network at my student house is pretty bad. Downloading over 4G did the trick for me. |
Sounds like my problem... MacOS standart installation doesn't go over 27% |
@abernix Yup, windows is the same CDN as the installer. Updated the windows ticket too. Thanks. @gothicn @titmastercrunch Not sure if you folks have the same issue, but I'd really appreciate it if you could try something for me. Can you please run each of these commands:
2 or 3 times each and report back the results? |
Everything fine. No errors, download finishes 100% successfully. MacOS el capitan Should i create a separate issue? I didn't find any solutions. |
But when Meteor is downloading packages, it is hitting up CDN with multiple requests in serial, not only one curl one, no? And then there are multiple ones in parallel. Maybe you can use the Apache benchmarking tool |
I appreciate all the good information. Here is what I have done after I think I understood how to avoid the meteor-tool issue: taking a long time, apparently randomly, when I enter > meteor to run a project. |
@mitar in your CI scripts is the tool downloading older versions? Do you install 1.4.1.1, then run A workaround (if it is the tool being slow but not curl), would be install the version that you need to begin with with |
Hm, you are right. I have both |
@mitar, not necessarily. But am I right in saying that your test script is just running |
I linked it above: https://circleci.com/gh/meteor/blaze/67 |
And no, it should not download latest version of the tool. |
@mitar it seems to have hung at "Building plugin I think we've seen similar timeout errors of late with |
Hm, maybe the log is cutoff and this is not the latest thing? |
CircleCI failure:
|
You are hitting the MaxCDN Paris Datacenter While downloading autoupdate@1.2.11...: While downloading caching-compiler@1.0.6...: While downloading ddp-client@1.2.9...: While downloading ddp-server@1.2.10...: While downloading http@1.1.8...: While downloading templating@1.1.14...: |
I've been trying to install meteor, over the course of several months now, attempting to contribute Markdown Support to Rocket.Chat. You can see there, that I've been working on this since Jul 22. All that time, I have tried to install on several machines, (latest 2 releases of 10.x, Several flavors of Ubuntu 16, and once, even Windows 10 out of desperation) and even tried several different networks, just to ensure it wasn't my networking situation. I've even used corkscrew to set up tunneling for me on a migratory bastion server that I've moved around different regions using DO droplets. In each case, it's always the same: I run:
And in each case, I get:
|
I started having problems to download meteor packages since one week ago and it has become worse and worse, not sure if anyone still experiencing the same (meteor per se is downloaded but packages fail): maxcdn
amazonwsip
tracert
error
EDIT: After a long number of retries and waiting for some time it finally worked 👍 |
@abernix @n1mmy Can something like https://unpkg.com/ help solve the issue for once and for all. |
I think we need a participant vote on this, so please bear with this wall of text and vote at the end because I was about to close this issue about an hour before @tcastelli posted his most recent update. I felt like this was resolved best-as-possible, for a number of reasons:
Network problems may never (won't) go away – but Meteor can get better at dealing with them, as has tried with the above solutions. @niwsa, I'm not sure that replacing one CDN with another CDN is the solution (nor do I think it would be a "once and for all"). Unpkg is really just another NPM CDN and using it, even right now, wouldn't solve this problem because Meteor is more than just NPM – its packages are not all NPM and are in their own atmosphere, well, literally. It could be argued that the best-of-the-best CDN would be the most ideal for Atmosphere packages, but even if a particular CDN performs well for some users, it won't for others – a huge number of Meteor users are in places where network conditions just actually are bad – for example, China where the wall makes it very difficult for anything to work properly – NPM or otherwise! There is no putting CDN problems to rest and NPM has fought with this problem for a long time - Meteor has an additional angle of needing packages from two sources: its own and NPM. Let's vote, using reactions and comments
Based on the results, I will create new issues for specific problems, create action items, and we can work together to resolve those with the users who are affected by them. My vote is still to close. |
I also think there's always gonna be networks errors and in general I think the new measures in latest versions are normally enough. However, like what happened with METEOR_WAREHOUSE_URLBASE, I think that another env variable could be used for packages url (or not sure if that exists already and we can use the trick to change it like with warehouse). Also some documentation about those env variables would be great (with possible url alternatives when experiencing problems). Regarding opening more specific issues (Windows + multiple packages at the same time), I also think is a good idea, I just didn't know it was something related to Windows only. @abernix Should I open an issue for that or is that already tracked somewhere else? |
@tcastelli My request to you, for testing purposes, would be to use the Windows workaround suggested in this comment by setting (Also, I quasi-agree on the documentation aspect, but that it should be a last resort as if we can get everything working properly it will take care of itself. I dislike the idea of users having to make these "tweaks", which tend to sit around forever, and think it would be preferred if we could intelligently make those decisions for them.) |
Thanks for the clarification about warehouse, I tried indeed to change it to cloudfront when I was facing the problem, and it dind't help at that time, so it doesn't seem something related to the CDN then. I have opened a new issue RocketChat/Rocket.Chat#8013 for Windows specifics. In terms of documentation I think it won't hurt to have it well documented (especially if later on private servers area allowed), but I agree that automatically trying to fix the problem would be ideal, so maybe internally an array of WAREHOUSE_URLBASE urls could be stored in the build tool, and try to fetch from a different one if the first fails. |
Hm, but the previous CDN worker very well and none of those issues were present there. The long list of fixes you had to introduce now for retrying and all other stuff were simply not present there and there were no such long issues like this one with that CDN. So we do not have to talk about "best-of-the-best CDN" in abstract terms, we can just move to a previous CDN? |
I don't think you can say they were not present, just that you did not experience them. There were absolutely problems with the old CDN as well – some of the problems that the community was hit with full force with the change to the new CDN (which by the way, again had an identified problem) were in-fact long-standing problems which may have been skipped over in the past. I think the improvements to the tool all make a lot of sense and most of them should have been there before. These have all made the tool more resilient for folks with sub-par network conditions, and the bottom line is it seems to be working now. Ultimately, per my comments here I'm guessing this comes down to the graciousness (emphasis on the emphasis) of MaxCDN and that makes a lot of sense. Amazon is probably less gracious. |
Though China users would still suffer network problems, it seems that the CDN works well for most developers. Thanks @abernix and MDG ones! I guess we can close this. PS: I had already edited the issue content of this issue for China (Mainland) users. It should work. |
My issue also fixed and I can install Meteor and packages successfully. Thanks MDG. |
Per my comment above (and because this seems to actually be solved), I'm closing this and locking further conversation on it. I know this issue hit users hard. Thank you to the large number of participants who reported problems, submitted |
To China (Mainland) Users:
Original Issue Content
div@dk:~$ curl https://install.meteor.com/ | sh
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 6675 0 6675 0 0 4772 0 --:--:-- 0:00:01 --:--:-- 4774
Downloading Meteor distribution
### 4.2%
curl: (18) transfer closed with 168048742 bytes remaining to read
The text was updated successfully, but these errors were encountered: