packagist: TransportException 404 Not Found for packagist.org urls
Filing a separate issue following from #470, given this is not related to SlowTimer.
This still happens on a regular basis in Wikimedia CI pipeline. Is there a way in which we can prevent this issue in a more general way, that hopefully also avoids too much load or storage pressure on your side?
See https://phabricator.wikimedia.org/P7484$1052 for a recent transcript of a build in which this error occurred.
For that build, it seems like the failure was printed only 4 seconds after the composer require
command.
01:00:57 DEBUG:quibble.cmd:composer require composer/spdx-licenses=1.4.0 psy/psysh=0.9.6 monolog/monolog=~1.22.1 phpunit/phpunit=4.8.36 \|\| ^6.5 wikimedia/avro=1.8.0 mediawiki/mediawiki-codesniffer=21.0.0 wmde/hamcrest-html-matchers=^0.1.0 seld/jsonlint=1.7.1 wikimedia/testing-access-wrapper=~1.0 jakub-onderka/php-parallel-lint=0.9.2 jetbrains/phpstorm-stubs=dev-master#38ff1a581b297f7901e961b8c923862ea80c3b96 hamcrest/hamcrest-php=^2.0 nmred/kafka-php=0.1.5 justinrainbow/json-schema=~5.2 nikic/php-parser=3.1.3 cache/integration-tests=0.16.0
--
01:01:00
01:01:00 [Composer\Downloader\TransportException]
01:01:00 The "http://packagist.org/p/provider-latest%2489d14de6aab31e05c38c5a490ca286c3895c7713604e767413aeb3ee5f9d0784.json" file could not be downloaded (HTTP/1.1 404 Not Found)
01:01:00
01:01:00 Exception trace:
01:01:00 () at /srv/composer/vendor/composer/composer/src/Composer/Util/RemoteFilesystem.php:430
01:01:00 Composer\Util\RemoteFilesystem->get() at /srv/composer/vendor/composer/composer/src/Composer/Util/RemoteFilesystem.php:101
01:01:00 Composer\Util\RemoteFilesystem->getContents() at
Also:
- https://github.com/composer/packagist/issues/470
- https://github.com/composer/composer/issues/2198
- https://github.com/composer/composer/issues/2228
- https://github.com/composer/composer/issues/7021
- https://github.com/composer/composer/issues/7404
- https://github.com/composer/composer/issues/7599
- Downstream: https://phabricator.wikimedia.org/T182266
About this issue
- Original URL
- State: closed
- Created 6 years ago
- Comments: 57 (10 by maintainers)
This should not happen anymore now, it was a race condition between mirrors but I put a fallback in place now so they should go fetch the missing file if a race happens. Please do tell if you see it again.
@Seldaek I am also experiencing this a lot today. e.g. https://drone.owncloud.com/owncloud/core/18699 and pick any of the red jobs. https://drone.owncloud.com/owncloud/core/18699/130
and the errors have various different
provider-yyyy*.json
file names.I am guessing that there is some problem with packagist server(s) somewhere?
Is there a status page or twitter thread or… where real-time status of the packagist servers is posted? That would be handy - to know if there is already a known problem being worked.
And how are we supposed to report this sort of error? which is probably a real-time packagist mirror/server sysadmin problem not a packagist software bug.
This has been resolved, we had an issue with the metadata mirroring over the weekend sorry about that. I would recommend removing the mirror configs you set as workarounds.
@dilshandesh that seems unrelated, please don’t pile up random stuff in this old issue, rather open a new one if you have an issue you can reliably reproduce.
This mirror works for me: https://packagist.phpcomposer.com
use: composer config -g repo.packagist composer https://packagist.phpcomposer.com
and/or add to your repository section in composer.json
Hi, im having the same problem with
composer create-project --repository-url=https://repo.magento.com/ magento/project-community-edition .
Downloading https://repo.packagist.org/p/symfony/process%245c5f786d7473c01dfa73e8b7d64e9bf4421871a0b87715596246536ed9fc707c.json
@Seldaek
Because otherwise we are left trying to report via the bug-reporting mechanism on GitHub, and that is not the ideal way to report system-network problems.
@Seldaek Seems resolved, thanks!
Same here [Composer\Downloader\TransportException]
The “https://packagist.org/p/paragonie/random_compat%244a8fbabca55a661e93fb
f2683edec96d140551495786c09184236c31934ed17a.json” file could not be downlo
aded (HTTP/1.1 404 Not Found)
@Seldaek whattup?