kubeflow: Spark-operator, spartakus and tensorboard are missing when installing to existing Kubernetes cluster

/kind bug

What steps did you take and what happened: [A clear and concise description of what the bug is.]

I’m trying to install Kubeflow on an existing Kubernetes (1.15.12) cluster following the instructions of the doc:

1. Download the kfctl v1.1.0 release from the Kubeflow releases page.
2. Unpack the tar ball
3. Set environment
4. Run:

   mkdir -p ${KF_DIR}
   cd ${KF_DIR}
   kfctl apply -V -f ${CONFIG_URI}```
   
   

Where CONFIG_URI="https://raw.githubusercontent.com/kubeflow/manifests/v1.1-branch/kfdef/kfctl_k8s_istio.v1.1.0.yaml"

1. Things start to deploy, and then I get the following error:

INFO[0087] Successfully applied application bootstrap    filename="kustomize/kustomize.go:273"
INFO[0087] Deploying application spark-operator          filename="kustomize/kustomize.go:248"
2020/08/27 09:33:38 absolute path error in '/home/me/kubeflow/foobar/.cache/manifests/manifests-1.1-branch/stacks/kubernetes/application/spark-operator' : evalsymlink failure on '/home/me/kubeflow/foobar/.cache/manifests/manifests-1.1-branch/stacks/kubernetes/application/spark-operator' : lstat /home/me/kubeflow/foobar/.cache/manifests/manifests-1.1-branch/stacks/kubernetes/application/spark-operator: no such file or directory
ERRO[0087] Error evaluating kustomization manifest for spark-operator: accumulating resources: accumulating resources from '../../.cache/manifests/manifests-1.1-branch/stacks/kubernetes/application/spark-operator': open /home/me/kubeflow/foobar/.cache/manifests/manifests-1.1-branch/stacks/kubernetes/application/spark-operator: no such file or directory  filename="kustomize/kustomize.go:155"
Error: failed to apply:  (kubeflow.error): Code 500 with message: kfApp Apply failed for kustomize:  (kubeflow.error): Code 500 with message: error evaluating kustomization manifest for spark-operator: accumulating resources: accumulating resources from '../../.cache/manifests/manifests-1.1-branch/stacks/kubernetes/application/spark-operator': open /home/me/kubeflow/foobar/.cache/manifests/manifests-1.1-branch/stacks/kubernetes/application/spark-operator: no such file or directory
Usage:
  kfctl apply -f ${CONFIG} [flags]

Flags:
      --context string   Optional kubernetes context to use when applying resources. Currently not used by KFDef resources.
  -f, --file string      Static config file to use. Can be either a local path:
                                        export CONFIG=./kfctl_gcp_iap.yaml
                                or a URL:
                                        export CONFIG=https://raw.githubusercontent.com/kubeflow/manifests/v1.0-branch/kfdef/kfctl_gcp_iap.v1.0.0.yaml
                                        export CONFIG=https://raw.githubusercontent.com/kubeflow/manifests/v1.0-branch/kfdef/kfctl_istio_dex.v1.0.0.yaml
                                        export CONFIG=https://raw.githubusercontent.com/kubeflow/manifests/v1.0-branch/kfdef/kfctl_aws.v1.0.0.yaml
                                        export CONFIG=https://raw.githubusercontent.com/kubeflow/manifests/v1.0-branch/kfdef/kfctl_k8s_istio.v1.0.0.yaml
                                kfctl apply -V --file=${CONFIG}
  -h, --help             help for apply
  -V, --verbose          verbose output default is false

kfctl exited with error: failed to apply:  (kubeflow.error): Code 500 with message: kfApp Apply failed for kustomize:  (kubeflow.error): Code 500 with message: error evaluating kustomization manifest for spark-operator: accumulating resources: accumulating resources from '../../.cache/manifests/manifests-1.1-branch/stacks/kubernetes/application/spark-operator': open /home/me/kubeflow/foobar/.cache/manifests/manifests-1.1-branch/stacks/kubernetes/application/spark-operator: no such file or directory

That spark-operator directory does not exist indeed. Neither does github contain it at https://github.com/kubeflow/manifests/tree/v1.1-branch/stacks/kubernetes/application . Although I could find it under the ibm stack dir: https://github.com/kubeflow/manifests/tree/v1.1-branch/stacks/ibm/application/spark-operator

What did you expect to happen:

Kubeflow is being successfully deployed.

Anything else you would like to add:

After I’ve removed the spark-operator section from kfctl_k8s_istio.v1.1.0.yaml I’ve got the same error for spartakus and then for tensorboard. Removing all of these from that yaml allowed the install process to complete successfully.

Environment:

• Kubeflow version: dashboard shows: build version dev_local
• kfctl version: (use kfctl version): kfctl v1.1.0-0-g9a3621e
• Kubernetes platform: Kubernetes cluster at Scaleway
• Kubernetes version: (use kubectl version):

Client Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.6", GitCommit:"dff82dc0de47299ab66c83c626e08b245ab19037", GitTreeState:"clean", BuildDate:"2020-07-16T14:19:25Z", GoVersion:"go1.13.13", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.12", GitCommit:"e2a822d9f3c2fdb5c9bfbe64313cf9f657f0a725", GitTreeState:"clean", BuildDate:"2020-05-06T05:09:48Z", GoVersion:"go1.12.17", Compiler:"gc", Platform:"linux/amd64"}

• OS (e.g. from /etc/os-release): Ubuntu 20.04.1 LTS