Lip2Wav: Pre-processing and training not working on custom dataset?
Whenever I preprocess the custom dataset, this is the output:
`C:\Users\Graham\Desktop\Lip2Wav-master>python preprocess.py --speaker_root Dataset/larry --speaker larry C:\Users\Graham\AppData\Local\Programs\Python\Python36\lib\site-packages\tensorflow\python\framework\dtypes.py:526: FutureWarning: Passing (type, 1) or ‘1type’ as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / ‘(1,)type’. _np_qint8 = np.dtype([(“qint8”, np.int8, 1)]) C:\Users\Graham\AppData\Local\Programs\Python\Python36\lib\site-packages\tensorflow\python\framework\dtypes.py:527: FutureWarning: Passing (type, 1) or ‘1type’ as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / ‘(1,)type’. _np_quint8 = np.dtype([(“quint8”, np.uint8, 1)]) C:\Users\Graham\AppData\Local\Programs\Python\Python36\lib\site-packages\tensorflow\python\framework\dtypes.py:528: FutureWarning: Passing (type, 1) or ‘1type’ as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / ‘(1,)type’. _np_qint16 = np.dtype([(“qint16”, np.int16, 1)]) C:\Users\Graham\AppData\Local\Programs\Python\Python36\lib\site-packages\tensorflow\python\framework\dtypes.py:529: FutureWarning: Passing (type, 1) or ‘1type’ as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / ‘(1,)type’. _np_quint16 = np.dtype([(“quint16”, np.uint16, 1)]) C:\Users\Graham\AppData\Local\Programs\Python\Python36\lib\site-packages\tensorflow\python\framework\dtypes.py:530: FutureWarning: Passing (type, 1) or ‘1type’ as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / ‘(1,)type’. _np_qint32 = np.dtype([(“qint32”, np.int32, 1)]) C:\Users\Graham\AppData\Local\Programs\Python\Python36\lib\site-packages\tensorflow\python\framework\dtypes.py:535: FutureWarning: Passing (type, 1) or ‘1type’ as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / ‘(1,)type’. np_resource = np.dtype([(“resource”, np.ubyte, 1)]) Started processing for Dataset/larrywith 1 GPUs 0it [00:00, ?it/s]
C:\Users\Graham\Desktop\Lip2Wav-master>`
but there is no new output, and when I try and train, this outputs:
`C:\Users\Graham\Desktop\Lip2Wav-master>python train.py first_run --data_root Dataset/larry/ --preset synthesizer/presets/larry.json Arguments: name: first_run data_root: Dataset/larry/ preset: synthesizer/presets/larry.json models_dir: synthesizer/saved_models/ mode: synthesis GTA: True restore: True summary_interval: 2500 embedding_interval: 1000000000 checkpoint_interval: 1000 eval_interval: 1000 tacotron_train_steps: 2000000 tf_log_level: 1
Traceback (most recent call last): File “train.py”, line 61, in <module> log_dir, hparams = prepare_run(args) File “train.py”, line 21, in prepare_run hparams.add_hparam(‘all_images’, all_images) File “C:\Users\Graham\AppData\Local\Programs\Python\Python36\lib\site-packages\tensorflow\contrib\training\python\training\hparam.py”, line 485, in add_hparam ‘Multi-valued hyperparameters cannot be empty: %s’ % name) ValueError: Multi-valued hyperparameters cannot be empty: all_images
C:\Users\Graham\Desktop\Lip2Wav-master>`
How do you properly use a custom dataset with this project? Thank you.
About this issue
- Original URL
- State: open
- Created 4 years ago
- Comments: 16
That seems to work, but then I get the same error with train.py.
Yes, I got this error too. And I find the solution for it right now .
You need to revise the code in preprocess.py as follow : Before : fulldir = vfile.replace(‘/intervals/’, ‘/preprocessed/’) After fulldir = vfile.replace(‘intervals’, ‘preprocessed’)
You only need to revise the line 65, 97 (two lines only ).
This problem is caused by the line 124 . My enviroment is Windows10 , but the enviroment of author should be Linux . The delimiter of path is different so
vfile.replaceis not expected .You also needn’t to run preprocess.py again to generate images. It’s too long I know. So you can run my code which in my repo https://github.com/Halle-Astra/lip2wav_revised by
python preprocess_win_mv.py <name>.I hope this solution can help you to solve it .