mmaction2: download_videos.sh in kinetics gives exit status 69 when running ffmpeg command to trim the downloaded videos

Describe the bug I follow the instruction in https://github.com/open-mmlab/mmaction2/tree/master/tools/data/kinetics and have problems in step 2 when running bash download_videos.sh kinetics400. The script does not give any error because they are suppressed by the try get statement here https://github.com/open-mmlab/mmaction2/blob/master/tools/data/kinetics/download.py#L119-L123. If you add print(err) in the except part, you will see a lot of errors like this

Command 'ffmpeg -i "/tmp/kinetics/d85dbb77-46c6-46ba-9b83-0e45fc50f713.mp4" -ss 73 -t 10 -c:v libx264 -c:a copy -threads 1 -loglevel panic "kinetics400/abseiling/mRdyYMPlJ_8_000073_000083.mp4"' returned non-zero exit status 69.

This prevents this line https://github.com/open-mmlab/mmaction2/blob/master/tools/data/kinetics/download.py#L127 from running, causing lots of original video to be stored. Currently, I am having 2 tb of space being used even when it has only downloaded 80k videos. As a result, my hard disk is full before completion.

Any ideas how to resolve this problem?

Reproduction

  1. What command or script did you run? bash download_videos.sh kinetics400

  2. Did you make any modifications on the code or config? Did you understand what you have modified? No. Only add print statement. You need to add the print statement to see the error. Also you will notice that the size of /tmp/kinetics keeps growing because these videos are not deleted.

  3. What dataset did you use? N.A.

Environment

  1. Please run PYTHONPATH=${PWD}:$PYTHONPATH python mmaction/utils/collect_env.py to collect necessary environment information and paste it here.

Python: 3.7.3 (default, Jul 25 2020, 13:03:44) [GCC 8.3.0] CUDA available: True GPU 0,1,2,3,4,5,6,7: Tesla V100-SXM2-32GB CUDA_HOME: /usr/local/cuda NVCC: Build cuda_11.0_bu.TC445_37.28845127_0 GCC: gcc (Debian 8.3.0-6) 8.3.0 PyTorch: 1.7.1+cu110 PyTorch compiling details: PyTorch built with:

  • GCC 7.3
  • C++ Version: 201402
  • Intel® Math Kernel Library Version 2020.0.0 Product Build 20191122 for Intel® 64 architecture applications
  • Intel® MKL-DNN v1.6.0 (Git Hash 5ef631a030a6f73131c77892041042805a06064f)
  • OpenMP 201511 (a.k.a. OpenMP 4.5)
  • NNPACK is enabled
  • CPU capability usage: AVX2
  • CUDA Runtime 11.0
  • NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80
  • CuDNN 8.0.5
  • Magma 2.5.2
  • Build settings: BLAS=MKL, BUILD_TYPE=Release, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DUSE_VULKAN_WRAPPER -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, USE_CUDA=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON,

TorchVision: 0.8.2+cu110 OpenCV: 4.4.0 MMCV: 1.2.2 MMCV Compiler: n/a MMCV CUDA Compiler: n/a MMAction2: 0.9.0+814d97d

About this issue

  • Original URL
  • State: closed
  • Created 4 years ago
  • Comments: 15 (4 by maintainers)

Most upvoted comments