spark-on-k8s-operator: error: unable to recognize "examples/spark-pi.yaml": no matches for kind "SparkApplication" in version "sparkoperator.k8s.io/v1beta1"

Downloaded the latest operator source code and run: kubectl apply -f examples/spark-pi.yaml then got errors as below:

error: unable to recognize "examples/spark-pi.yaml": no matches for kind "SparkApplication" in version "sparkoperator.k8s.io/v1beta1"

Did I miss anything here?

PS: I installed the spark-operator today and the list of my crd is:

$kubectl get crd
NAME                                              AGE
scheduledsparkapplications.sparkoperator.k8s.io   4h51m
sparkapplications.sparkoperator.k8s.io            4h51m

And both of them are using the v1beta1 version:

$ kubectl describe crd scheduledsparkapplications.sparkoperator.k8s.io | grep "API Version"
API Version:  apiextensions.k8s.io/v1beta1

$ kubectl describe crd sparkapplications.sparkoperator.k8s.io  | grep "API Version"
API Version:  apiextensions.k8s.io/v1beta1

About this issue

Original URL
State: closed
Created 5 years ago
Comments: 15 (7 by maintainers)

Most upvoted comments

Actually I was wrong. The namespace you specified using --namespace is the namespace where the operator gets installed into. The sparkJobNamespace is the namespace in which SparkApplications are watched and run.

liyinan926 on Jan 19, 2019