unsloth: [Bug] google/gemma3. UnslothVisionDataCollator is only for image models!
I’m using related colab notebook for fine-tuning Gemma3 model for vision task. In docs I saw that I can use Qwen2.5-VL or Pixtral notebooks for tuning, just need to replace model to Gemma. But I’m facing error UnslothVisionDataCollator is only for image models!
how I can fix that?
Link to notebook: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_VL_(7B)-Vision.ipynb#scrollTo=95_Nn-89DhsL
About this issue
- Original URL
- State: closed
- Created a year ago
- Comments: 15
@hexdrx @sensai99 @vody-am
The qwen2-vl/qwen2.5-vl have now been fixed . gemma3 vision still doesn’t work. We’re working on releasing a fix in the upcoming week. Meanwhile if you’re working in a local environment please make sure to:
in colab install cell should be updated to
Meanwhile we will be updating the notebooks shortly
@hexdrx UnslothVisionDataCollator does not currently accept a mixed dataset where some samples do not have an input image.
@sensai99 I was running https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_VL_(7B)-Vision.ipynb#scrollTo=upcOlWe7A1vc but as a jupyter notebook on my own system.
I was seeing issues on
unsloth-zoo 2025.5.11hence downgraded to2025.5.1.The current (working) pyproject.toml is:
The configuration used was: