🐞Describing the bug
Stack Trace
root@lambda-server:~/share/Wav2Lip# python trans.py
Load checkpoint from: ./checkpoints/wav2lip.pth
XGBoost version 1.7.5 has not been tested with coremltools. You may run into unexpected errors. XGBoost 1.4.2 is the most recent version that has been tested.
Failed to load _MLModelProxy: No module named 'coremltools.libcoremlpython'
Traceback (most recent call last):
File "/root/share/Wav2Lip/trans.py", line 31, in <module>
import coremltools as ct
File "/usr/local/lib/python3.10/dist-packages/coremltools/__init__.py", line 121, in <module>
from . import converters, models, optimize, proto
File "/usr/local/lib/python3.10/dist-packages/coremltools/converters/__init__.py", line 7, in <module>
from . import libsvm, sklearn, xgboost
File "/usr/local/lib/python3.10/dist-packages/coremltools/converters/libsvm/__init__.py", line 8, in <module>
from . import _libsvm_converter, _libsvm_util
File "/usr/local/lib/python3.10/dist-packages/coremltools/converters/libsvm/_libsvm_converter.py", line 7, in <module>
from coremltools.models import _METADATA_SOURCE, _METADATA_VERSION
File "/usr/local/lib/python3.10/dist-packages/coremltools/models/__init__.py", line 39, in <module>
from . import ml_program
File "/usr/local/lib/python3.10/dist-packages/coremltools/models/ml_program/__init__.py", line 6, in <module>
from . import compression_utils
File "/usr/local/lib/python3.10/dist-packages/coremltools/models/ml_program/compression_utils.py", line 10, in <module>
from coremltools.optimize.coreml import (
File "/usr/local/lib/python3.10/dist-packages/coremltools/optimize/__init__.py", line 11, in <module>
from . import torch
File "/usr/local/lib/python3.10/dist-packages/coremltools/optimize/torch/__init__.py", line 6, in <module>
from coremltools.optimize.torch import (
File "/usr/local/lib/python3.10/dist-packages/coremltools/optimize/torch/palettization/__init__.py", line 59, in <module>
from .fake_palettize import FakePalettize
File "/usr/local/lib/python3.10/dist-packages/coremltools/optimize/torch/palettization/fake_palettize.py", line 27, in <module>
from .palettization_config import DEFAULT_PALETTIZATION_ADVANCED_OPTIONS
File "/usr/local/lib/python3.10/dist-packages/coremltools/optimize/torch/palettization/palettization_config.py", line 396, in <module>
{
File "/usr/local/lib/python3.10/dist-packages/coremltools/optimize/torch/palettization/palettization_config.py", line 397, in <dictcomp>
key: ModuleDKMPalettizerConfig.from_dict(val)
File "/usr/local/lib/python3.10/dist-packages/coremltools/optimize/torch/_utils/python_utils.py", line 87, in from_dict
return converter.structure_attrs_fromdict(data_dict, cls)
File "/usr/local/lib/python3.10/dist-packages/cattrs/converters.py", line 756, in structure_attrs_fromdict
return cl(**conv_obj)
File "<attrs generated init coremltools.optimize.torch.palettization.palettization_config.ModuleDKMPalettizerConfig>", line 13, in __init__
_setattr('dtype', __attr_converter_dtype(dtype))
File "/usr/local/lib/python3.10/dist-packages/coremltools/optimize/torch/_utils/torch_utils.py", line 101, in maybe_convert_str_to_dtype
"fp8_e4m3": _torch.float8_e4m3fn,
AttributeError: module 'torch' has no attribute 'float8_e4m3fn'
To Reproduce
- Please add a minimal code example that can reproduce the error when running it.
import torch
import torchvision
from models import Wav2Lip
def load_model(path):
model = Wav2Lip()
print("Load checkpoint from: {}".format(path))
checkpoint = torch.load(path)
s = checkpoint["state_dict"]
new_s = {}
for k, v in s.items():
new_s[k.replace('module.', '')] = v
model.load_state_dict(new_s)
return model.eval()
checkpoint_path = './checkpoints/wav2lip.pth'
torch_model = load_model(checkpoint_path)
# Set the model in evaluation mode.
torch_model.eval()
# Trace the model with random data.
# example_input = torch.rand(1, 3, 224, 224)
img_batch = torch.randn(1, 6, 5, 96, 96)
mel_batch = torch.randn(1, 5, 1, 80, 16)
traced_model = torch.jit.trace(torch_model, (mel_batch, img_batch))
out = traced_model(mel_batch, img_batch)
# example_input = (mel_batch, img_batch)
import coremltools as ct
model = ct.convert(
traced_model,
convert_to="mlprogram",
inputs=[ct.TensorType(shape=mel_batch.shape),ct.TensorType(shape=img_batch.shape) ]
)
model.save("newmodel.mlmodel")
- If the model conversion succeeds, but there is a numerical mismatch in predictions, please include the code used for comparisons.
System environment (please complete the following information):
- coremltools version: 8.0
- OS (e.g. MacOS version or Linux type): Ubuntu
- Any other relevant version information (e.g. PyTorch or TensorFlow version):
Additional context
- Add anything else about the problem here that you want to share.
I just downloaded the
manylinux1Python 3.10 wheel for our 8.0 release. It containslibcoremlpython.so.I think you must have somehow installed using an egg, rather than a wheel, i.e. you’re doing a source install rather than a binary install. You could uninstalling then running
pip install --prefer-binary coremltools==8.0.Same problem.
Can you share logs for installing coremltools in a fresh environment?
In my case it did not help, the issue persists. I have tried using a fresh
python==3.10venv environment withtorch==2.4.0(latest tested) andcuda==12.2in two different installations of Ubuntu 22.04. Same error.But we still can convert model
It can works in ubuntu even
Failed to load _MLModelProxy: No module named 'coremltools.libcoremlpython'still appears