sidecar: Constant 409 update in progress bug

We’re facing a very strange issue which is constantly breaking out deploys.

We have to manually delete all the Lambda’s before trying to deploy, otherwise we encounter the following:

Error executing "UpdateFunctionCode" on "https://lambda.***.amazona  
  ws.com/2015-03-31/functions/SC-Appname-staging-Sidecar-Dacast-CreateLivestrea  
  m/code"; AWS HTTP error: Client error: `PUT https://lambda.***.amazon  
  aws.com/2015-03-31/functions/SC-Appname-staging-Sidecar-Dacast-CreateLivestre  
  am/code` resulted in a `409 Conflict` response:                              
  {"Type":"User","message":"The operation cannot be performed at this time. A  
  n update is in progress for resource: arn:aws (truncated...)                 
   ResourceConflictException (client): The operation cannot be performed at t  
  his time. An update is in progress for resource: arn:aws:lambda:***:6  
  88009524528:function:SC-Appname-staging-Sidecar-Dacast-CreateLivestream - {"T  
  ype":"User","message":"The operation cannot be performed at this time. An u  
  pdate is in progress for resource: arn:aws:lambda:***:688009524528:fu  
  nction:SC-Appname-staging-Sidecar-Dacast-CreateLivestream"}   

We’re a bit lost here, is there anything we’re doing wrong? We have changed our Sidecar implementation in the last 3 months, it just started happening 4 days ago and it’s becoming a hair puller.

Any guidance?

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Reactions: 1
  • Comments: 26 (13 by maintainers)

Most upvoted comments

Awesome. Thank you so much. These bugs can be killer without reliable steps to reproduce. Great work.

@aarondfrancis awesome, thanks for this fix! Have updated and tried a few deploys, no problems seen!

@aarondfrancis

Hello, I’ve now experiencing this issue today too.

Sorry for the delay, I’ve been taking weekends off with the family.

For some reason, deployments work today. No errors, no deleting lambdas and no renaming. I’m going to assume this was some sort of AWS hiccup.

Would you still like the error log from last weeks deploy and Sidecar class for reference?

Also, if there’s a way I can support your open source efforts, let me know. Torchlight looks awesome, I just don’t have a use for it… yet 😄