pytorch-forecasting: RuntimeError: Sizes of tensors must match except in dimension 1
- PyTorch-Forecasting version: 1.0.0
- PyTorch version: 2.0.1+cpu
- Python version: 3.9
- Operating System: Windows11
Expected behavior
I executed code Baseline().predict(val_dataloader, return_y=True) and did not expect any errors
Actual behavior
Received the following error
return torch.cat(sequences, dim=1)
RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 1280 but got size 42 for tensor number 14 in the list.
Code to reproduce the problem
I am running the following code on an internal dataset
max_prediction_length = 6
max_encoder_length = 24
training_cutoff = data["time_idx"].max() - max_prediction_length
training = TimeSeriesDataSet(
data[data['time_idx'] <= training_cutoff],
group_ids=["product_number", "sku_size", "retail_sales_channel"],
time_idx="time_idx",
target="quantity_sold",
min_prediction_length=1,
time_varying_known_reals=["time_idx", "discount_rate"],
time_varying_unknown_categoricals=[],
time_varying_unknown_reals=[
"quantity_physical_closing",
],
add_relative_time_idx=True,
add_target_scales=True,
add_encoder_length=True,
)
validation = TimeSeriesDataSet.from_dataset(training, data, predict=True, stop_randomization=True)
batch_size = 128 # set this between 32 to 128
train_dataloader = training.to_dataloader(train=True, batch_size=batch_size, num_workers=0)
val_dataloader = validation.to_dataloader(train=False, batch_size=batch_size * 10, num_workers=0)
baseline_predictions = Baseline().predict(val_dataloader, return_y=True)
About this issue
- Original URL
- State: open
- Created 3 years ago
- Reactions: 11
- Comments: 16
I am currently faced with similar issue even when I tried to evaluate the performance of the tft model.
predictions = best_tft.predict(val_dataloader, return_y=True, trainer_kwargs=dict(accelerator=“cpu”)) MAE()(predictions.output, predictions.y)
Please, if you find a way around yours, let me know how
I encountered the same error and narrowed down the issue, as mentioned by many above, to the concat_sequences function in utils.py. The following fix worked for me:
Just changing the concat dimension to 0 (the axis containing the batches) fixes the error. I am not sure how this function is used elsewhere in the package and hope it does not break things in those places.
I didn’t run the code, but I know
len(trainning) % 128 == 42 or len(trainning) % 1280 == 42Their code is funny.
Same issue here, can’t predict all my examples because they aren’t a multiplier of
batch_size. Would be great if we can have a fix on this one.