RuntimeError:Expected to have finished reduction in the prior iteration
Posted lyl0618
tags:
篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了RuntimeError:Expected to have finished reduction in the prior iteration相关的知识，希望对你有一定的参考价值。
解决办法：
添加find_unused_parameters=true
model=torch.nn.parallel.DistributedDataParallel(model,find_unused_parameters=true)
以上是关于RuntimeError:Expected to have finished reduction in the prior iteration的主要内容，如果未能解决你的问题，请参考以下文章
RuntimeError: Expected all tensors to be on the same device,但发现至少有两个设备，cpu和cuda:0！使用我的模型进行预测时
卡在 Collab RuntimeError: Expected all tensors to be on the same device, but found at least two device
“RuntimeError: Expected 4-dimensional input for 4-dimensional weight 32 3 3, but got 3-dimensional i
RuntimeError: Expected hidden size (2, 24, 50), got (2, 30, 50)
RuntimeError: Expected hidden[0] size (1, 1, 512), got (1, 128, 512) for LSTM pytorch
RuntimeError: Expected a ‘cuda‘ device type for generator but found ‘cpu‘