alfred: Unable to reproduce result for validation set

Hi, Thanks for the amazing dataset and for sharing your code. I am unable to reproduce the results for validation set seen. I downloaded the checkpoints as provided by you and I am using the best_seen.pth I am getting SR 0.0097 and GC 0.0659 whereas the result on val seen in the paper is SR 0.037 and GC 0.1.

Could you point to any stuff I might have missed ?

For starting XServer I used sudo nvidia-xconfig -a --use-display-device=None --virtual=1024x786 sudo /usr/bin/X :0 &

I face two warnings UserWarning: Default upsampling behavior when mode=bilinear is changed to align_corners=False since 0.4.0. Please specify align_corners=True if the old behavior is desired. See the documentation of nn.Upsample for details. warnings.warn("Default upsampling behavior when mode={} is changed "

UserWarning: nn.functional.sigmoid is deprecated. Use torch.sigmoid instead. warnings.warn("nn.functional.sigmoid is deprecated. Use torch.sigmoid instead.")

The second warning won’t affect the results but I wanted to confirm if upsampling with align corners was intended or whether the warning appeared earlier too and I should ignore it ?

About this issue

Most upvoted comments

@MohitShridhar okay, thanks a lot!

I am trying with the dockerfile. I will update on the status soon.

Oh I see. Thanks!