model-angelo: Run extremely slow on 1080Ti

It took about 8hrs for 50% of the run to finish. Incredibly slow. Installation initially had failed for pytorch so removed the env and recreated. Started fresh and it all went smoothly the next time. No errors.

model_angelo build -h provides the appropriate help output

Command provided includes map, fasta file and output. Speed doesn’t change if I provide the device number or not.

Computer specs OS - Linuxmint 20.1 (Ulyssa) Cuda - 11.7 Driver version - 515.43.04

I’ve also tried the installation on a 3090 machine also (runs redhat, driver version 515,76, cuda 11.7). Same result.

About this issue

Most upvoted comments

UPDATE: I installed it on our HPC and this time, it was marginally faster. It got through the whole initial process and then went through the GNN iterations. After the initial run, it seems to be quite fast (~5-10 minutes) for all the consequent runs. If this is only related to the weights not getting downloaded, I’m wondering why that is the case.