fastT5: forward() got an unexpected keyword argument 'cross_attn_head_mask'

----> 1 paraphrase_t5("Kyle Lowry scored 33 points and Norman Powell added 23 to lift the Toronto Raptors to a 122-125 victory over the Boston Celtics on Wednesday night.")

4 frames
/usr/local/lib/python3.7/dist-packages/torch/nn/modules/module.py in _call_impl(self, *input, **kwargs)
   1049         if not (self._backward_hooks or self._forward_hooks or self._forward_pre_hooks or _global_backward_hooks
   1050                 or _global_forward_hooks or _global_forward_pre_hooks):
-> 1051             return forward_call(*input, **kwargs)
   1052         # Do not call functions when jit is used
   1053         full_backward_hooks, non_full_backward_hooks = [], []

TypeError: forward() got an unexpected keyword argument 'cross_attn_head_mask'

About this issue

Original URL
State: closed
Created 3 years ago
Comments: 20 (14 by maintainers)

Most upvoted comments

It’s enough to downgrade to 4.6.1. Version 4.4.2 doesn’t have this patch: https://github.com/huggingface/transformers/pull/10651

kagrze on Jun 24, 2021

I am having the same issue on latest version of transformers(4.8.0), a workaround would be to downgrade transformers to 4.4.2 and it’ll works. But still needs fixing.

Anku5hk on Jun 24, 2021

@sam-writer You are right, it does look like something specific to the env. I opened an issue here https://github.com/huggingface/transformers/issues/14604

Thanks!

aseifert on Dec 2, 2021