scheduler-plugins: Co-scheduled pods never get scheduled

Hello,

I have a cluster with 10 nodes, I am co-scheduling 8 pods but they are always pending, below are the events seen in one of the pods:

Events:
  Type     Reason            Age   From                         Message
  ----     ------            ----  ----                         -------
  Warning  FailedScheduling  21m   scheduler-plugins-scheduler  0/10 nodes are available: 10 pre-filter pod ray-head-urm-exp--1-klbn8 cannot find enough sibling pods, current pods number: 1, minMember of group: 8.
  Warning  FailedScheduling  21m   scheduler-plugins-scheduler  0/10 nodes are available: 10 pod with pgName: default/ray-pg last failed in 3s, deny.
  Warning  FailedScheduling  20m   scheduler-plugins-scheduler  optimistic rejection in PostFilter
  Warning  FailedScheduling  19m   scheduler-plugins-scheduler  optimistic rejection in PostFilter
  Warning  FailedScheduling  15m   scheduler-plugins-scheduler  optimistic rejection in PostFilter
  Warning  FailedScheduling  13m   scheduler-plugins-scheduler  optimistic rejection in PostFilter
  Warning  FailedScheduling  19s   scheduler-plugins-scheduler  optimistic rejection in PostFilter

Co-scheduler version k8s.gcr.io/scheduler-plugins/kube-scheduler:v0.22.6