crc: [BUG] All pods failing to pull images

General information

• OS: macOS
• Hypervisor: KVM / Hyper-V / hyperkit / vfkit
• Did you run crc setup before starting it (Yes/No)? Yes
• Running CRC on: Laptop

CRC version

CRC version: 2.9.0+589ab2cd
OpenShift version: 4.11.3
Podman version: 4.2.0

CRC status

DEBU CRC version: 2.9.0+589ab2cd                  
DEBU OpenShift version: 4.11.3                    
DEBU Podman version: 4.2.0                        
DEBU Running 'crc status'                         
DEBU Checking file: /Users/convery/.crc/machines/crc/.crc-exist 
DEBU Checking file: /Users/convery/.crc/machines/crc/.crc-exist 
DEBU Running SSH command: df -B1 --output=size,used,target /sysroot | tail -1 
DEBU Using ssh private keys: [/Users/convery/.crc/machines/crc/id_ecdsa /Users/convery/.crc/cache/crc_vfkit_4.11.3_arm64/id_ecdsa_crc] 
DEBU SSH command results: err: <nil>, output: 32737570816 13377323008 /sysroot 
CRC VM:          Running
OpenShift:       Running (v4.11.3)
Podman:          
Disk Usage:      13.38GB of 32.74GB (Inside the CRC VM)
Cache Usage:     36.85GB
Cache Directory: /Users/convery/.crc/cache

CRC config

- consent-telemetry                     : no

Host Operating System

ProductName:	macOS
ProductVersion:	12.6
BuildVersion:	21G115

Steps to reproduce

1. Start arc
2. Go to the cluster UI and view the pods in the openshift-marketplace project

Expected

All pods to be running

Actual

All pods bar 1 are failing as they are timing out trying to talk to redhat.

Looks like a networking issue given Failed to pull image "registry.redhat.io/redhat/certified-operator-index:v4.11": rpc error: code = Unknown desc = Get "https://registry.redhat.io/auth/realms/rhcc/protocol/redhat-docker-v2/auth?scope=repository%3Aredhat%2Fcertified-operator-index%3Apull&service=docker-registry": dial tcp: lookup registry.redhat.io on 192.168.127.1:53: read udp 192.168.127.2:60694->192.168.127.1:53: i/o timeout

If I try and pull a random image it also fails i.e. Failed to pull image "nginx": rpc error: code = Unknown desc = pinging container registry registry-1.docker.io: Get "https://registry-1.docker.io/v2/": dial tcp: lookup registry-1.docker.io on 192.168.127.1:53: read udp 192.168.127.2:55975->192.168.127.1:53: i/o timeout

Logs

Before gather the logs try following if that fix your issue

$ crc delete -f
$ crc cleanup
$ crc setup
$ crc start --log-level debug

Please consider posting the output of crc start --log-level debug on http://gist.github.com/ and post the link in the issue.