wespeaker: Get stuck in load a batch

Hi, dear.

I am following the settings of the original script, using the shards data type, I want to know, is your experiment using SSD? Is it because of the fuck mechanical hard disk that it has been stuck in load a batch? It is not very slow, but it is always stuck there forever.

I have a record about it

`

    print("before get a batch")
    for i, batch in enumerate(dataloader):
        print("get a batch")
        utts = batch['key']
        targets = batch['label']
        features = batch['feat']

` image

after, … of, there is no after.

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Comments: 15

Most upvoted comments

oh, I found my error is caused by num_works, I set it to 0,it can work normally(我也不知道为啥). But…it is not goog method(治标不治本),the speed load data is can not catch up with my 3090 GPU… I am looking for a method can set num_works > 0 and work well.