dim [0、0]の同じ行列が異なるデバイス間で20回転送されました。

Question

Epochである程度は終わっていますが、Epochが終了すると多くの場合、空の行列をコピーするという警告が表示されます。通常、この警告の原因は何ですか？

01/23/2017 13:06:49: Epoch[ 1 of 50]-Minibatch[691301-691400]: ce = 0.06757763 * 9404; errs = 1.595% * 9404; time = 14.3775s; samplesPerSecond = 654.1 01/23/2017 13:07:04: Epoch[ 1 of 50]-Minibatch[691401-691500]: ce = 0.08411693 * 9784; errs = 1.962% * 9784; time = 15.1554s; samplesPerSecond = 645.6 01/23/2017 13:07:18: Epoch[ 1 of 50]-Minibatch[691501-691600]: ce = 0.07443892 * 9847; errs = 1.696% * 9847; time = 14.1284s; samplesPerSecond = 697.0 WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. 01/23/2017 13:07:33: Epoch[ 1 of 50]-Minibatch[691601-691700]: ce = 0.07692308 * 9815; errs = 1.854% * 9815; time = 14.4867s; samplesPerSecond = 677.5 WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. 01/23/2017 13:07:48: Epoch[ 1 of 50]-Minibatch[691701-691800]: ce = 0.08028341 * 9809; errs = 1.906% * 9809; time = 14.7772s; samplesPerSecond = 663.8 01/23/2017 13:08:03: Epoch[ 1 of 50]-Minibatch[691801-691900]: ce = 0.09192892 * 10073; errs = 2.214% * 10073; time = 14.8481s; samplesPerSecond = 678.4 01/23/2017 13:08:17: Epoch[ 1 of 50]-Minibatch[691901-692000]: ce = 0.07414725 * 9616; errs = 1.841% * 9616; time = 14.9059s; samplesPerSecond = 645.1 01/23/2017 13:08:32: Finished Epoch[ 1 of 50]: [Training] ce = 0.08177092 * 67573150; errs = 1.962% * 67573150; totalSamplesSeen = 67573150; learningRatePerSample = 0.0020000001; epochTime=104968s WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times. WARNING: The same matrix with dim [0, 0] has been transferred between different devices for 20 times.

Answer 1

Iは、（空行列でこれを見たことがないが、マトリックスが非ゼロ寸法を有する場合、これはGPUでサポートされていない操作によって引き起こされるか、前方に疎行列を伴う典型的には、計算又は逆方向パス）。このメッセージは通常、各ステップで面倒な操作が問題のマトリックスにもう1つのGPU-CPU-GPUラウンドトリップを追加し続ける長い再発によってトリガーされます。