argo-cd: Sync gets stuck and must be terminated/restarted manually in order to work

Hi, Im having a very similar issue, is there at least a way to automatically terminate a long running sync? I could not find a setting like this.

Thinking about this a bit more - It may be that the application syncing issue is just a symptom of a wider issue? The health check does eventually get to a Healthy state and is in a “Degraded” state when the certificate issuance is pending.

I can make a PR for the small change above, which reduces issues when using cert-manager certificates, but that won’t fix the underlying sync issue. Where after getting into a degraded state, the application will wait for all resources to report “healthy” and seemingly deadlocks or waits for an event that never arrives.

I have been playing with a similar issue on version v1.7.8+ef5010c, in an app of apps scenario.

When the syncing hit a “Degraded” state, as part of the certificate issuing, it seems that the application syncing started waiting on everything all over again and would never get the healthy notifications.

I think it is an issue with the certificate health check, I overrode the default check by changing the argocd-cm.yaml file with the below (only replacing Degraded with Progressing):

data:
  resource.customizations: |
    cert-manager.io/Certificate:
      health.lua: |
        hs = {}
        if obj.status ~= nil then
          if obj.status.conditions ~= nil then
            for i, condition in ipairs(obj.status.conditions) do
              if condition.type == "Ready" and condition.status == "False" then
                hs.status = "Progressing"
                hs.message = condition.message
                return hs
              end
              if condition.type == "Ready" and condition.status == "True" then
                hs.status = "Healthy"
                hs.message = condition.message
                return hs
              end
            end
          end
        end

        hs.status = "Progressing"
        hs.message = "Waiting for certificate"
        return hs

Seems to have resolved the issue for me (at least in the very small number of tests I have done since).

One interesting symptom: When ArgoCD is stuck with “waiting for completion of hook …” no operation works with that Application resource until the sync operation is manually terminated.

For example:

• Application gets stuck with “waiting for completion of hook …”
• Application receives DELETE via the ArgoCD HTTP API.
• Nothing changes, Application can stay in this state for days until the Sync is manually terminated.
• Once the sync is manually terminated, the deletion (issued days ago) immediately proceeds and Application is deleted.

@rbreeze, I was running v1.7.6, the default appVersion of the helm chart at the time. Also encountered issues where deletion gets stuck.

However, I have since updated to v1.8.3 and I am no longer facing any issues! Everything working as expected.

i have the same issue as @lifelofranco mentioned Argo CD v1.8.3+0f9c684 Build Date 2021-01-21T22:20:39Z