uv: 401 Installing from Internal Index due to .netrc

I was excited by the work done in this issue, so I tried checking out main and testing uv to see if it improved performance on 1 package I found slow. Instead I found that using main uv now gives me a 401 error for installing any internal package with index server. Packages that previously worked to install now fail. I’ve bisected commits to find the first commit that fails is this commit.

The exact command being run is cargo run -- pip install --index-url=SOME_URL numpy. The url has credentials in it. I do have .netrc file, but they are not intended for this installation especially when --index-url has all credentials needed already and did work prior to that pr. Similarly pip works for similar command pip install --index-url=SOME_URL numpy and I’d guess is sticking to credentials inside index-url over mixing it with .netrc.

Here’s the verbose logs from the first failing commit,

Logs

    0.000830s DEBUG uv_client::registry_client Using registry request timeout of 300s
 uv::requirements::from_source source=numpy
    0.257274s DEBUG uv_interpreter::python_environment Found a virtualenv through VIRTUAL_ENV at: /Users/pa-loaner/Snapchat/Dev/.venvs/bento_uv2
    0.257714s DEBUG uv_interpreter::interpreter Probing interpreter info for: /Users/pa-loaner/Snapchat/Dev/.venvs/bento_uv2/bin/python
    0.539855s DEBUG uv_interpreter::interpreter Found Python 3.9.16 for: /Users/pa-loaner/Snapchat/Dev/.venvs/bento_uv2/bin/python
    0.540817s DEBUG uv::commands::pip_install Using Python 3.9.16 environment at /Users/pa-loaner/Snapchat/Dev/.venvs/bento_uv2/bin/python
 uv_client::flat_index::from_entries
 uv_resolver::resolver::solve
      0.548281s   0ms DEBUG uv_resolver::resolver Solving with target Python version 3.9.16
   uv_resolver::resolver::choose_version package=root
   uv_resolver::resolver::get_dependencies package=root, version=0a0.dev0
        0.548614s   0ms DEBUG uv_resolver::resolver Adding direct dependency: numpy*
   uv_resolver::resolver::choose_version package=numpy
     uv_resolver::resolver::package_wait package_name=numpy
 uv_resolver::resolver::process_request request=Versions numpy
   uv_client::registry_client::simple_api package=numpy
     uv_client::cached_client::get_cacheable
       uv_client::cached_client::read_and_parse_cache file=/Users/pa-loaner/Library/Caches/uv/simple-v3/dc13ddb23a33f0c4/numpy.rkyv
 uv_resolver::resolver::process_request request=Prefetch numpy *
 uv_client::cached_client::from_path_sync path="/Users/pa-loaner/Library/Caches/uv/simple-v3/dc13ddb23a33f0c4/numpy.rkyv"
          0.549991s   0ms DEBUG uv_client::cached_client No cache entry for: https://registry.snapchat.com/python/virtual/numpy/
       uv_client::cached_client::fresh_request url="https://registry.snapchat.com/python/virtual/numpy/"
error: HTTP status client error (401 Unauthorized) for url (https://registry.snapchat.com/python/virtual/numpy/)

Like before, I’m happy to test out any specific commands/extra log statements that would be helpful.

edit: Credentials in netrc are not wrong though and maybe could be used somehow. The netrc looks like,

machine registry.snapchat.com login LCAv1 password AUTH

while --index-url passed is https://LCAv1:password@registry.snapchat.com/python/virtual. Login and password are same either way, but guessing the two aren’t mixing as expected. I wonder if /python/virtual part is lost.

About this issue

Original URL
State: closed
Created 4 months ago
Comments: 19 (14 by maintainers)

Commits related to this issue

Avoid duplicating authorization header with netrc (#2325) ## Summary The netrc middleware we added in https://github.com/astral-sh/uv/pull/2241 has a slight problem. If you include credentials i... — committed to astral-sh/uv by charliermarsh 4 months ago

Most upvoted comments

I’ll test the PR in ~1 hour when I’m back home. The diagnosis makes full sense to me.

hmc-cs-mdrissi on Mar 10, 2024

I can confirm there’s two headers for me too when it fails. I added the logs from this pr you did before. I also tried RUST_LOG=trace but that doesn’t log headers.

For my use case it does not really matter which of the two credentials you pick. My personal intuition though is if url has credentials it’d be used first over a separate file.

hmc-cs-mdrissi on Mar 10, 2024

I did one extra test and main works if I include index url without auth.

uv pip install --index-url=https://LCAv1:password@registry.snapchat.com/python/virtual # Fail
uv pip install --index-url=https://registry.snapchat.com/python/virtual # Works

So it’s using netrc + index-url well if index-url doesn’t also have authenication data in it. But if they both have it even if it’s same password/login, then it fails.

hmc-cs-mdrissi on Mar 10, 2024