conan-center-index: [bug] Conan search returns timeout

To help us debug your issue please explain:

Hi!

As Conan Center is growing, the time requested to list all recipes is no longer enough:

conan search -r conan-center
ERROR: HTTPSConnectionPool(host='conan.bintray.com', port=443): Read timed out. (read timeout=60.0). [Remote: conan-center]

As you can see, 60 seconds is not enough to retrieve all information.

However, if I update the timeout request by CONAN_TIMEOUT_REQUEST, I can receive the answer:

CONAN_REQUEST_TIMEOUT=360 conan search -r conan-center
Existing package recipes:

7z_installer/1.0@conan/stable
Args/5.0.1.4@igormironchik/stable
...

Usingtime it took 1m39.

As Conan Center is the official repository, I think search should work without timeouts. So Or Bintray is slow, Or Conan needs to update its timeout limit.

Conan Version: 1.16.1

I’ve read the CONTRIBUTING guide.
I’ve specified the Conan version, operating system version and any tool that can be relevant.
I’ve explained the steps to reproduce the error or the motivation/use case of the question/suggestion.

About this issue

Original URL
State: closed
Created 5 years ago
Reactions: 7
Comments: 29 (20 by maintainers)

Commits related to this issue

Clamp Boost version - in hopes of avoiding CI job failures caused by slow JFrog REST API. - example failure: - job: https://github.com/johnmcfarlane/cnl/runs/4427931463?check_suite_focus=true#s... — committed to johnmcfarlane/cnl by johnmcfarlane 3 years ago
Clamp Boost version - in hopes of avoiding CI job failures caused by slow JFrog REST API. - example failure: - job: https://github.com/johnmcfarlane/cnl/runs/4427931463?check_suite_focus=true#s... — committed to johnmcfarlane/cnl by johnmcfarlane 3 years ago
Clamp Boost version - in hopes of avoiding CI job failures caused by slow JFrog REST API. - example failure: - job: https://github.com/johnmcfarlane/cnl/runs/4427931463?check_suite_focus=true#s... — committed to johnmcfarlane/cnl by johnmcfarlane 3 years ago

Most upvoted comments

Unfortunately, search performance is becoming a significant bottleneck and often fails in my case. Sample error message:

conan search "boost/*" --remote=all --raw

ERROR: HTTPSConnectionPool(host='conan.bintray.com', port=443): Max retries exceeded with url: /v1/conans/search?q=boost%2F%2A (Caused by ReadTimeoutError("HTTPSConnectionPool(host='conan.bintray.com', port=443): Read timed out. (read timeout=60.0)"))

Unable to connect to conan-center=https://conan.bintray.com
1. Make sure the remote is reachable or,
2. Disable it by using conan remote disable,
Then try again.

DominikDeak on Aug 24, 2020

The problem persists. Any solution insight?

conan search -r all openssl ERROR: HTTPSConnectionPool(host=‘conan.bintray.com’, port=443): Max retries exceeded with url: /v1/conans/search?q=openssl (Caused by ReadTimeoutError(“HTTPSConnectionPool(host=‘conan.bintray.com’, port=443): Read timed out. (read timeout=60.0)”))

nminkov on Jan 25, 2021

Hi all,

yes, we are aware of this limitation. It is in our todo list, but as it is a complex thing that requires changes in the backend it will take some time. Thanks very much for your patience.

memsharded on Feb 24, 2020

@uilianries I appreciate the feedback. Unfortunately the problem I am having is that I want to be able to specify version ranges within my conanfiles for different packages I am consuming. Since these dependencies are downloaded during my CMake run with cmake-conan (https://github.com/conan-io/cmake-conan) i don’t think there is any way to avoid this problem beacuse CMake will always be using the command line to fetch the dependencies.

For now I will have to just hard-code all of the version numbers to not be ranges, but I would prefer to be able to make my dependencies more flexible than that.

tjwrona on Jan 4, 2021

Also hit this issue.

It also happens if I have a range in conanfile.txt:

[requires]
boost/[>=1.73]

$> conan install -if build .
Configuration:
[settings]
arch=x86_64
arch_build=x86_64
build_type=Release
compiler=Visual Studio
compiler.runtime=MD
compiler.version=16
os=Windows
os_build=Windows
[options]
[build_requires]
[env]

ERROR: HTTPSConnectionPool(host='conan.bintray.com', port=443): Max retries exceeded with url: /v1/conans/search?q=boost%2F%2A&ignorecase=False (Caused by ReadTimeoutError("HTTPSConnectionPool(host='conan.bintray.com', port=443): Read timed out. (read timeout=60.0)"))

Unable to connect to conan-center=https://conan.bintray.com
1. Make sure the remote is reachable or,
2. Disable it by using conan remote disable,
Then try again.

Output of time conan search boost/* -r all:

ERROR: HTTPSConnectionPool(host='api.bintray.com', port=443): Max retries exceeded with url: /conan/conan/conan-center/v1/conans/search?q=boost%2F%2A (Caused by ReadTimeoutError("HTTPSConnectionPool(host='api.bintray.com', port=443): Read timed out. (read timeout=60.0)"))

Unable to connect to conan-center=https://api.bintray.com/conan/conan/conan-center
1. Make sure the remote is reachable or,
2. Disable it by using conan remote disable,
Then try again.

real    4m2.708s
user    0m0.015s
sys     0m0.000s

AndWass on Oct 15, 2020

Moved to conan-center-index, as this is mostly about the ConanCenter, not the client side.

memsharded on Feb 24, 2020

Discord? That’s cool, thanks for sharing! haha

uilianries on Feb 21, 2020