argo-cd: Exec in apps outside of ArgoCD namespace not working

Together with the 2.5.0 update I deployed all ArgoCD apps apart from ArgoCD itself to their respective namespaces. When I want to exec into an ArgoCD pod everything works as usual. However when I try to exec into a pod in a different namespace I receive the error Terminal Connection Error: Internal error.

My policy.csv

p, admin, exec, create, */*, allow
g, group-name, admin

Checking the RBAC permissions for the argocd-server serviceaccount everything also looks good.

kubectl auth can-i create pods --subresource='exec' --as=system:serviceaccount:argocd:argocd-server
yes

The logs unfortunately don’t print anything useful.