W1102 10:20:49.709000 1 torch/distributed/run.py:874] 
W1102 10:20:49.709000 1 torch/distributed/run.py:874] *****************************************
W1102 10:20:49.709000 1 torch/distributed/run.py:874] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
W1102 10:20:49.709000 1 torch/distributed/run.py:874] *****************************************
Using Device: cpu, Backend: gloo
Using Device: cpu, Backend: gloo
Distributed Training for WORLD_SIZE: 4, RANK: 0, LOCAL_RANK: 0
Distributed Training for WORLD_SIZE: 4, RANK: 1, LOCAL_RANK: 1
Using dataset from shared PVC at /mnt/sharedUsing dataset from shared PVC at /mnt/shared

Train Epoch: 1 [0/60000 (0%)]	Loss: 2.309268
Train Epoch: 1 [1000/60000 (7%)]	Loss: 2.089345
Train Epoch: 1 [2000/60000 (13%)]	Loss: 1.844954
Train Epoch: 1 [3000/60000 (20%)]	Loss: 1.066982
Train Epoch: 1 [4000/60000 (27%)]	Loss: 0.923391
Train Epoch: 1 [5000/60000 (33%)]	Loss: 0.726968
Train Epoch: 1 [6000/60000 (40%)]	Loss: 0.720730
Train Epoch: 1 [7000/60000 (47%)]	Loss: 0.705370
Train Epoch: 1 [8000/60000 (53%)]	Loss: 0.453031
Train Epoch: 1 [9000/60000 (60%)]	Loss: 0.504699
Train Epoch: 1 [10000/60000 (67%)]	Loss: 0.428031
Train Epoch: 1 [11000/60000 (73%)]	Loss: 0.509181
Train Epoch: 1 [12000/60000 (80%)]	Loss: 0.511274
Train Epoch: 1 [13000/60000 (87%)]	Loss: 0.476302
Train Epoch: 1 [14000/60000 (93%)]	Loss: 0.436199
Train Epoch: 2 [0/60000 (0%)]	Loss: 0.516368
Train Epoch: 2 [1000/60000 (7%)]	Loss: 0.450640
Train Epoch: 2 [2000/60000 (13%)]	Loss: 0.431390
Train Epoch: 2 [3000/60000 (20%)]	Loss: 0.357926
Train Epoch: 2 [4000/60000 (27%)]	Loss: 0.436645
Train Epoch: 2 [5000/60000 (33%)]	Loss: 0.298138
Train Epoch: 2 [6000/60000 (40%)]	Loss: 0.538089
Train Epoch: 2 [7000/60000 (47%)]	Loss: 0.490634
Train Epoch: 2 [8000/60000 (53%)]	Loss: 0.352920
Train Epoch: 2 [9000/60000 (60%)]	Loss: 0.390397
Train Epoch: 2 [10000/60000 (67%)]	Loss: 0.338122
Train Epoch: 2 [11000/60000 (73%)]	Loss: 0.387348
Train Epoch: 2 [12000/60000 (80%)]	Loss: 0.318992
Train Epoch: 2 [13000/60000 (87%)]	Loss: 0.323445
Train Epoch: 2 [14000/60000 (93%)]	Loss: 0.257715
Training is finished