TensorRT: 🐛 [Bug] isBool() INTERNAL ASSERT FAILED while compiling Sequence Generator

Bug Description

I am receving this error when compling a torchscript module. The module is a light wrapper around a SequenceGenerator from fairseq.

RuntimeError: isBool() INTERNAL ASSERT FAILED at "bazel-out/k8-opt/bin/external/libtorch_pre_cxx11_abi/_virtual_includes/ATen/ATen/core/ivalue.h":625, please report a bug to PyTorch.

To Reproduce

I am currently executing sequence generation in torch, using the compile spec.

trt_ts_module = torch_tensorrt.ts.compile(generator,
  inputs=[    
          torch_tensorrt.Input(min_shape=(1,4), opt_shape = (1,10), max_shape = (1,20) , dtype = torch.int32),  
      ],   
      debug= True, 
      enabled_precisions={torch.half},    
      truncate_long_and_double=True,
      require_full_compilation=False, 
      torch_executed_modules= ["fairseq.sequence_generator.SequenceGenerator"], 
      min_block_size = 1
  )

Expected behavior

no compile errors

Environment

building docker image from Dockerfile in repo.

About this issue

Original URL
State: closed
Created a year ago
Comments: 17

Most upvoted comments

Thanks for looking into it! I think you are correct in that recent fixes have helped with this bug. I am actually using a fork of fairseq that doesn’t have this issue. The dockerfile in the shared drive has info on it.

With the most recent updates, I am getting past the bulk of operations but running into a separate issue while finalizing the generated outputs. I believe it has to do with the inputs defaulting to be all zeros, and I’m assuming that is not configurable. I’ll look for a workaround and provide any updates.

Csinclair0 on Jul 21, 2023

can you try fx btw? @Csinclair0

bowang007 on Mar 29, 2023