tfx: BeamDagRunner, Transform deadlock with Python 3.6
Hi everyone,
Running the taxi_pipeline_beam example fails with
from tensorflow_transform.output_wrapper import TFTransformOutput
File "/srv/hops/anaconda/anaconda/envs/python36/lib/python3.6/site-packages/tensorflow_transform/output_wrapper.py", line 29, in <module>
from tensorflow_transform.tf_metadata import metadata_io
File "<frozen importlib._bootstrap>", line 968, in _find_and_load
File "<frozen importlib._bootstrap>", line 149, in __enter__
File "<frozen importlib._bootstrap>", line 94, in acquire
_frozen_importlib._DeadlockError: deadlock detected by _ModuleLock('tensorflow_transform.tf_metadata.metadata_io') at 139642620901192
while running Transform https://github.com/tensorflow/tfx/blob/0.14.0/tfx/examples/chicago_taxi_pipeline/taxi_pipeline_beam.py#L85
TFX version is 0.14, Beam is 2.15 and running on Flink 1.8.1.
All works well with Python 2.7. Has anyone encountered this issue before?
Thank you, Theo
About this issue
- Original URL
- State: closed
- Created 5 years ago
- Comments: 18
All errors observed here should be fixed with https://github.com/apache/beam/pull/10167. Feel free to patch this PR. We plan to cherrypick this fix into Beam 2.17.0 that is in the works.