origin: Container creation fails because of "Failed create pod sandbox"

Pods are not getting created anymore

Version

oc v3.6.173.0.7 kubernetes v1.6.1+5115d708d7 features: Basic-Auth

Server https://api.starter-ca-central-1.openshift.com:443 openshift v3.7.0-0.143.7 kubernetes v1.7.0+80709908fd

Steps To Reproduce

1. create a application (e.g. resid (persistent) from catalog)
2. check pod/container creation
3. wait for timeouts

Current Result

Warn messages on pod: 1:33:46 PM | Normal | Sandbox changed | Pod sandbox changed, it will be killed and re-created. 2 times in the last 5 minutes -- | -- | -- | -- 1:33:42 PM | Warning | Failed create pod sand box | Failed create pod sandbox. 2 times in the last 5 minutes –> pod is not created

the only real error I could grab was : Failed kill pod | error killing pod: failed to "KillPodSandbox" for "c4c2ec61-ba29-11e7-8b2c-02d8407159d1" with KillPodSandboxError: "rpc error: code = 2 desc = NetworkPlugin cni failed to teardown pod \"redis-1-deploy_instantsoundbot\" network: CNI request failed with status 400: 'Failed to execute iptables-restore: exit status 4 (Another app is currently holding the xtables lock. Perhaps you want to use the -w option?\n)\n'"

Expected Result

pod should start up as the used to do…

Additional Information

Couldn’t get oc adm diagnostics working atm I guess it could have to do with the introduction of https://github.com/openshift/origin/pull/15880