aiter: Building and installing whl doesn't work
When building AITER using python3 setup.py develop it works fine
But when using python3 setup.py bdist_wheel --dist-dir=dist followed by pip dist/aiter-0.1.0-cp312-cp312-linux_x86_64.whl any attempt to use results in:
>>> import aiter
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.12/dist-packages/aiter/__init__.py", line 15, in <module>
from .ops.norm import *
ModuleNotFoundError: No module named 'aiter.ops'
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 16 (12 by maintainers)
Commits related to this issue
- Using proposed fix from https://github.com/ROCm/aiter/issues/115 — committed to ROCm/vllm by gshtras 2 years ago
- Aiter whl fix branch (#452) * Using proposed fix from https://github.com/ROCm/aiter/issues/115 * Build fix — committed to ROCm/vllm by gshtras 2 years ago
- ck_fused_moe_stage2 support fix weight shuffle remove ck_moe_fused_stage2's weight_scale expand rename Properly disabling aiter components Aiter whl fix branch (#452) * Using proposed fix from h... — committed to ROCm/vllm by Zzz9990 2 years ago
Now installing from whl appears to be working
hi @gshtras , because fp8 moe use asm and you enable PREBUILD_KERNELS when bdist_wheel, directory of asm is pointed to path of packing, not to path of install. we will deal with ASAP.
we have fixed the error, because of lack of init.py. However, we encounter the other issue after pip install whl successfully. If fix, we will update ASAP.