DALI: How to deal with corrupt files?
Describe the question.
Hello all,
I have been using DALI for a while now, but recently I have been dealing with a problem of having corrupt files:
Error when constructing operator: readers__VideoResize encountered:
[/opt/dali/dali/operators/reader/loader/video_loader.cc:324] Could not find video stream in datasets/db/Kinetics400/train/bungee jumping/oyj6TFAxpiw_000229_000239.mp4
I tried finding them with a loop using ffmpeg, but it seems it was not enough, so I would like to ask if there is any way to just ignore them in DALI, identify them with DALI or any other simple work around?
Thank for the hard work on the library.
Check for duplicates
- I have searched the open bugs/issues and have found no duplicates for this bug report
About this issue
- Original URL
- State: closed
- Created 8 months ago
- Comments: 16 (8 by maintainers)
I see. Thank you for the reply.
After reencoding my data to H264, .mp4 with yuv420p, I haven’t had other problems.
I might try other formats later if it could get faster, but it’s working fine for now.
@Pedrexus - for now you need to rely on the experimental video reader to handle these.
Let us wait till it is merged and you can test it with the nightly build… just in case.