TTS: [Bug] in XTTSv1 and XTTSv2 i get error ❗ len(DataLoader) returns 0 in not-english

Describe the bug

hi first i want to thank you for all your amazing work !

please if you have little time please check this , i have also notebook easy to debug the problem

i follow the steps for recipes in xttsv1,xttsv2

https://github.com/coqui-ai/TTS/tree/dev/recipes/ljspeech/xtts_v1 https://github.com/coqui-ai/TTS/tree/dev/recipes/ljspeech/xtts_v2

AssertionError: ❗ len(DataLoader) returns 0. Make sure your dataset is not empty or len(dataset) > 0.

if i test on vits,glow working just fine with not any problem and i can complete the train https://github.com/coqui-ai/TTS/tree/dev/recipes/ljspeech/vits_tts

To Reproduce

i have create simple notebook for easy to see the problem , i have also fix the dataset i use from kaggle

testTTSV1_2.zip

Expected behavior

No response

Logs

> Training Environment:
 | > Backend: Torch
 | > Mixed precision: False
 | > Precision: float32
 | > Num. of CPUs: 2
 | > Num. of Torch Threads: 1
 | > Torch seed: 1
 | > Torch CUDNN: True
 | > Torch CUDNN deterministic: False
 | > Torch CUDNN benchmark: False
 | > Torch TF32 MatMul: False
 > Start Tensorboard: tensorboard --logdir=/content/GPT_XTTS_LJSpeech_FT_new-November-15-2023_03+10PM-0000000

 > Model has 518128803 parameters

>> DVAE weights restored from: /content/XTTS_v1.1_original_model_files/dvae.pth
 | > Found 1844 files in /content/el


 > EPOCH: 0/1000
 --> /content/GPT_XTTS_LJSpeech_FT_new-November-15-2023_03+10PM-0000000
 ! Run is removed from /content/GPT_XTTS_LJSpeech_FT_new-November-15-2023_03+10PM-0000000

 > Filtering invalid eval samples!!
 > Total eval samples after filtering: 0
Internal Python error in the inspect module.
Below is the traceback from this internal error.

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/trainer/trainer.py", line 1808, in fit
    self._fit()
  File "/usr/local/lib/python3.10/dist-packages/trainer/trainer.py", line 1762, in _fit
    self.eval_epoch()
  File "/usr/local/lib/python3.10/dist-packages/trainer/trainer.py", line 1610, in eval_epoch
    self.get_eval_dataloader(
  File "/usr/local/lib/python3.10/dist-packages/trainer/trainer.py", line 976, in get_eval_dataloader
    return self._get_loader(
  File "/usr/local/lib/python3.10/dist-packages/trainer/trainer.py", line 900, in _get_loader
    len(loader) > 0
AssertionError:  ❗ len(DataLoader) returns 0. Make sure your dataset is not empty or len(dataset) > 0.

Environment

{
    "CUDA": {
        "GPU": [],
        "available": false,
        "version": "11.8"
    },
    "Packages": {
        "PyTorch_debug": false,
        "PyTorch_version": "2.1.0+cu118",
        "TTS": "0.20.5",
        "numpy": "1.22.0"
    },
    "System": {
        "OS": "Linux",
        "architecture": [
            "64bit",
            "ELF"
        ],
        "processor": "x86_64",
        "python": "3.10.12",
        "version": "#1 SMP Wed Aug 30 11:19:59 UTC 2023"
    }
}

Additional context

No response

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 25 (3 by maintainers)

Most upvoted comments

yes same here more hours make worst the stuff i try with 4 hours and then 12 hours also i have a lot time repeat same stuff some time listen with English accents sometime, very slow and fast and noise , so like i see this no working for my Languase and look like also like you say in yours , and yes sometime when it’s working it’s listen natural better for the model vits this i dont know if possible somehow to make work in this version xtts or need wait next release , i hope someone help more on this

i have some question to know i do correct the stuff

1 how many hours need to finetune ( i try 4 - 12 hours)
2 the audio file min duration and max duration with can use (for me i use min 1 sec max 11 sec 22055 mono with clear speak with not noise)
3 how many steps about need  (300k about 1 day train in my case something)
4 with can use multi speakers this help the train or single speaker better only to use , what best to use (i try single and multi-speakers  ) 
5 can replace the symbol English with  the character like unidecode (i use unidecode method and also replace some character to work correct in my lang  )
6 what model it's best to use xtts v1,v2 (i use only last model v2)
7 can train for the begin with out use any checkpoints  like in vits

thank you for your time