go: cmd/go: cannot Resolve K8s Package from Dependency

@swtch1 this situation comes about because of breaking changes in the github.com/Azure/azure-sdk-for-go packages. Because the import path of the github.com/Azure/azure-sdk-for-go/... packages did not change after the breaking change, it’s impossible to work out which version is “correct”. Hence the power of semantic import versioning.

There is a way to “fix” your case however, and that is to bootstrap your dependencies from the github.com/prometheus/prometheus module:

# use a clean GOPATH for testing
export GOPATH=$(mktemp -d)

cd $(mktemp -d)
mkdir hello
cd hello
go mod init example.com/hello
cat <<EOD > main.go
package main

import (
        "github.com/prometheus/prometheus/config"
)

func main() {}

var c config.Config
EOD

# create a temporary directory for a prometheus clone
pd=$(mktemp -d)
git clone https://github.com/prometheus/prometheus/ $pd
pushd $pd
go mod init
popd

# now back to our example
go mod edit -require=github.com/prometheus/prometheus@latest -replace=github.com/prometheus/prometheus=$pd

go build main.go

succeeds.

cc @rsc @bcmills. Perhaps when resolving github.com/prometheus/prometheus, we see that it’s a non-module dependency, we also see that it could be converted from its existing dependency management configuration (govendor), should we use the dependencies implied by the result of go mod init?

EDIT: to merge the two go mod edit lines.

Having a similar issue as described here: https://groups.google.com/forum/#!topic/golang-nuts/BYV0IH_809Q. Thanks @myitcv for pointing me to this issue.

The “fix” seems to be some of what @bcmills described. ApiMachinery wasn’t the version I wanted even after a go get. I had to set this manually with go mod edit -replace. This kind of thing doesn’t really make me feel too confident about the system as even after I fixed that one package, it exposed others that I now have to also fix manually… 😕

# k8s.io/kubernetes/pkg/util/parsers
/go/pkg/mod/k8s.io/kubernetes@v1.11.3/pkg/util/parsers/parsers.go:36:16: undefined: reference.ParseNormalizedNamed
# github.com/hashicorp/consul/lib
/go/pkg/mod/github.com/hashicorp/consul@v1.2.3/lib/serf.go:18:6: base.MinQueueDepth undefined (type *serf.Config has no field or method MinQueueDepth)
/go/pkg/mod/github.com/hashicorp/consul@v1.2.3/lib/serf.go:24:6: base.LeavePropagateDelay undefined (type *serf.Config has no field or method LeavePropagateDelay)

Ok, there is one outstanding bug here, but the rest seems to work fine without any replace directives.

The bug is that, for some reason, go get github.com/Azure/azure-sdk-for-go@v5.0.0-beta adds v20.1.0+incompatible instead of the requested version.

If I fix that with a go mod edit, it seems to remain stable. I end up needing to fix up two other versions to point to non-semver revisions (one for k8s.io/apimachinery, which uses a different versioning scheme for its tags, and one for github.com/hashicorp/serf, which some other (tagged) hashicorp package requires at a version newer than the latest tag), but beyond that everything builds.

Using the source file from the original report:

$ go mod init github.com/golang/go/issues/27457
go: creating new go.mod: module github.com/golang/go/issues/27457

$ go get k8s.io/apimachinery@kubernetes-1.11.3
go: finding k8s.io/apimachinery kubernetes-1.11.3
go: finding k8s.io/apimachinery latest

$ go get github.com/hashicorp/serf@48d5794
go: finding github.com/hashicorp/serf 48d5794

$ go get github.com/Azure/azure-sdk-for-go@v5.0.0-beta
go: finding github.com/Azure/azure-sdk-for-go v5.0.0-beta

$ go build all
[…]
can't load package: package github.com/Azure/azure-sdk-for-go/arm/compute: unknown import path "github.com/Azure/azure-sdk-for-go/arm/compute": cannot find module providing package github.com/Azure/azure-sdk-for-go/arm/compute
can't load package: package github.com/Azure/azure-sdk-for-go/arm/network: unknown import path "github.com/Azure/azure-sdk-for-go/arm/network": cannot find module providing package github.com/Azure/azure-sdk-for-go/arm/network

$ go mod edit -require github.com/Azure/azure-sdk-for-go@v5.0.0-beta.0.20161028183111-bd73d950fa44+incompatible

$ go build all

$ go mod tidy

$ go build all

$

@myitcv your script modifications worked for me. I really can’t thank you enough… I haven’t been able to build this project since I added those deps. This is seriously huge, thank you! Also not something I think I would have figured out on my own as I played with the replacements and other methods for hours.