apex: pipeline_parallel - ModuleNotFoundError: No module named 'amp_C'

Hi,

I was using apex and everything worked well until this week when I get the following error:

---> 39 from apex import amp
---> 20 from . import transformer
----> 3 from apex.transformer import pipeline_parallel
----> 1 from apex.transformer.pipeline_parallel.schedules import get_forward_backward_func
----> 4 from apex.transformer.pipeline_parallel.utils import get_num_microbatches
---> 23 import amp_C

ModuleNotFoundError: No module named 'amp_C'

I saw this error occurs in other scenarios (https://github.com/NVIDIA/apex/issues/865), but not at the same place. Do you know how to solve it (PS: I’m running the code in Google colab). Thanks,

About this issue

Original URL
State: open
Created 3 years ago
Reactions: 4
Comments: 15

Most upvoted comments

To check if “amp_C” is really installed, add a print statement in setup.py arround the place that adding “amp_C” targets. I’ve seem sometimes using pip install ... command will NOT trigger these targets, and I have to use command in python setup.py install --cuda_ext like form.

Dixeran on Aug 1, 2023

I have the same issue. The workaround that worked for me is to use the version prior to the last commit here: https://github.com/NVIDIA/apex/tree/3303b3e7174383312a3468ef390060c26e640cb1

As you can see on the commit history the pipeline_parallels was added on October 27th here: https://github.com/NVIDIA/apex/pull/1202 I don’t know what the issue might be but I hope the woraround works for you aswell.

lunasara on Nov 2, 2021

您好，邮件已收到。

hitsz-qfy on Dec 6, 2023

I have the same issue. The workaround that worked for me is to use the version prior to the last commit here: https://github.com/NVIDIA/apex/tree/3303b3e7174383312a3468ef390060c26e640cb1

As you can see on the commit history the pipeline_parallels was added on October 27th here: #1202 I don’t know what the issue might be but I hope the woraround works for you aswell.

How to use the prior version of apex? Are the install commands still below:

git clone https://github.com/NVIDIA/apex cd apex pip install -v --disable-pip-version-check --no-cache-dir --global-option=“–cpp_ext” --global-option=“–cuda_ext” ./

Haoqing-Wang on Nov 3, 2021