airflow: Dag Dependency page not showing anything

Apache Airflow version: 2.1.

Environment: Ubuntu 20.04

  • Cloud provider or hardware configuration: AWS
  • OS (e.g. from /etc/os-release): UBUNTU 20.04 LTS
  • Kernel (e.g. uname -a): Linux 20.04.1-Ubuntu SMP Tue Jun 1 09:54:15 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
  • Install tools: python and pip

What happened: After performing the upgrade from 2.0.2 to 2.10 using the guide available in the documentation, Airflow upgraded successfully, Dag dependency page isn’t working as expected. The DAG dependency page doesn’t show the dependency graph.

What you expected to happen: I expected the dag dependency page to show the dags and their dependency in a Graph view

How to reproduce it: Its reproduced by opening these pages every time.

Dag Dependency Page

How often does this problem occur? Once? Every time etc? Every time

Any relevant logs to include? Put them here in side a detail tag:

Upgrade Check Log

/home/ubuntu/env_airflow/lib/python3.8/site-packages/airflow/configuration.py:34
6 DeprecationWarning: The hide_sensitive_variable_fields option in [admin] has been moved to the hide_sensitive_var_conn_fields option in [core] - the old setting has been used, but please update your config. /home/ubuntu/env_airflow/lib/python3.8/site-packages/airflow/configuration.py:34
6 DeprecationWarning: The default_queue option in [celery] has been moved to the default_queue option in [operators] - the old setting has been used, but please update your config. /home/ubuntu/env_airflow/lib/python3.8/site-packages/airflow/plugins_manager.py:
239 DeprecationWarning: This decorator is deprecated.In previous versions, all subclasses of BaseOperator must use apply_default decorator for thedefault_args feature to work properly. In current version, it is optional. The decorator is applied automatically using the metaclass. /home/ubuntu/env_airflow/lib/python3.8/site-packages/airflow/configuration.py:34
6 DeprecationWarning: The default_queue option in [celery] has been moved to the default_queue option in [operators] - the old setting has been used, but please update your config.

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 20 (8 by maintainers)

Most upvoted comments

working as expected now image

Hi @xiaoxugao ,

I might need to open another issue, I upgraded to 2.2.0 I initially had no issues, but over the last couple of weeks been having some issues again.

image

Not sure what the error is apart from this JS error.

Thank you, Sami

@bbovenzi @ashb - It appears like for a fresh build this piece of code is setting value as None. https://github.com/apache/airflow/blob/9a1fc19a627662122dd8dacee2ef61c3edf97b85/airflow/serialization/serialized_objects.py#L682

We just upgraded to 2.1.1 and see the dag dependencies empty. Tried restarting the scheduler multiple times but doesn’t help.

Could it be possible that task_type in the below piece of code is BaseOperator instead of the actual operator? IDK, haven’t been able to reproduce this issue in my local. https://github.com/apache/airflow/blob/9a1fc19a627662122dd8dacee2ef61c3edf97b85/airflow/serialization/serialized_objects.py#L341

I see this error message on the UI. Not sure if it is an underlying UI code issue or issue with the way things are being set. image