aitextgen: Error while using the Google collab : cannot import name 'DeepSpeedPlugin' from 'pytorch_lightning.plugins'

I tried both google collab (train from scratch or finetune with GPT-NEO) both have an issue while loading the module and gives : cannot import name 'DeepSpeedPlugin' from 'pytorch_lightning.plugins' (on the first cell while importing aitextgen)

I tried do uninstall and reinstall libraries as mentioned here. But it did not do the trick.

Is there a workaround ?

Thanks in advance.

About this issue

Original URL
State: open
Created a year ago
Reactions: 2
Comments: 24

Most upvoted comments

I manage to resolve the error on the google colab by running this:

!pip install -qq pytorch-lightning==1.7.0 transformers==4.21.3 aitextgen==0.6.0

Please do let me know if it also solves your issue on colab?

analyticray on Mar 30, 2023

try this : #!pip install -q aitextgen

!pip install git+https://github.com/scorixear/aitextgen

#!pip uninstall pytorch-lightning !pip install pytorch-lightning==1.9.4

1.9.4 really works

UESTCSober on Dec 4, 2023

try this : #!pip install -q aitextgen

!pip install git+https://github.com/scorixear/aitextgen

#!pip uninstall pytorch-lightning !pip install pytorch-lightning==1.9.4

ViCtOr-dev13 on Jul 17, 2023

pip install -qq pytorch-lightning==1.7.0 made it work for me on Win10 x64 Py 3.11

VTSTech on Apr 1, 2023