airflow: Wrong timeout value for ExternalTaskSensor running in deferrable mode
Apache Airflow version
2.10.3
If “Other Airflow 2 version” selected, which one?
No response
What happened?
The WorkflowTrigger used by ExternalTaskSensor should have a time limit set from timeout attribute instead of execution_timeout
What you think should happen instead?
No response
How to reproduce
- Start an ExternalTaskSensor in deferrable mode to monitor a non-running DAG, using default arguments.
- The Sensor never timeout because the monitored DAGs do not update, and the timeout value is wrongly set from
execution_timeoutinstead oftimeout
Operating System
Linux
Versions of Apache Airflow Providers
No response
Deployment
Google Cloud Composer
Deployment details
No response
Anything else?
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project’s Code of Conduct
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 17 (4 by maintainers)
It’s partially overlap with #33718, which is making Deferrable sensor to not retry when
timeoutis reach.However, even with that fix in place, the sensor still needs to call defer with the correct
timeoutparameter, which is not the case withExternalTaskSensor: it’s passingexecution_timeoutinstead oftimeout