log.txt

Loading features from %s train_ids_0.jsonl

  0%|          | 0/18348799 [00:00<?, ?it/s]
  0%|          | 1410/18348799 [00:00<18:05, 16905.94it/s]
Load Finished
File exists: /home/jinggu/.cache/torchfly/models/unified-gpt2-small.pth
File exists: /home/jinggu/.cache/torchfly/models/unified-gpt2-small.pth
Selected optimization level O1:  Insert automatic casts around Pytorch functions and Tensor methods.

Defaults for this optimization level are:
enabled                : True
opt_level              : O1
cast_model_type        : None
patch_torch_functions  : True
keep_batchnorm_fp32    : None
master_weights         : None
loss_scale             : dynamic
Processing user overrides (additional kwargs that are not None)...
After processing overrides, optimization options are:
enabled                : True
opt_level              : O1
cast_model_type        : None
patch_torch_functions  : True
keep_batchnorm_fp32    : None
master_weights         : None
loss_scale             : dynamic
Process rank: 0, device: cuda:0, n_gpu: 1, distributed training: True, 16-bits training: True

  0%|          | 0/202 [00:00<?, ?it/s]/home/jinggu/anaconda3/envs/test/lib/python3.7/site-packages/torch/utils/checkpoint.py:25: UserWarning: None of the inputs have requires_grad=True. Gradients will be None
  warnings.warn("None of the inputs have requires_grad=True. Gradients will be None")

  0%|          | 1/202 [00:00<03:19,  1.01it/s]
  1%|          | 2/202 [00:01<02:55,  1.14it/s]
  1%|▏         | 3/202 [00:02<02:38,  1.26it/s]
  2%|▏         | 4/202 [00:02<02:28,  1.34it/s]
  2%|▏         | 5/202 [00:03<02:18,  1.42it/s]
  3%|▎         | 6/202 [00:04<02:15,  1.44it/s]
  3%|▎         | 7/202 [00:04<02:15,  1.44it/s]
  4%|▍         | 8/202 [00:05<02:11,  1.48it/s]
  4%|▍         | 9/202 [00:06<02:07,  1.52it/s]
  5%|▍         | 10/202 [00:06<02:03,  1.55it/s]
  5%|▌         | 11/202 [00:07<02:04,  1.54it/s]
  6%|▌         | 12/202 [00:08<02:05,  1.51it/s]
  6%|▋         | 13/202 [00:08<02:02,  1.54it/s]
  7%|▋         | 14/202 [00:09<02:00,  1.56it/s]Gradient overflow.  Skipping step, loss scaler 0 reducing loss scale to 16384.0
/home/jinggu/anaconda3/envs/test/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:91: UserWarning: Seems like `optimizer.step()` has been overridden after learning rate scheduler initialization. Please, make sure to call `optimizer.step()` before `lr_scheduler.step()`. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
  "https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)

  7%|▋         | 14/202 [00:09<02:00,  1.56it/s, kl=7.31, loss=0.0305, speed=11.3]
  7%|▋         | 15/202 [00:09<01:58,  1.58it/s, kl=7.31, loss=0.0305, speed=11.3]
  8%|▊         | 16/202 [00:10<01:56,  1.59it/s, kl=7.31, loss=0.0305, speed=11.3]
  8%|▊         | 17/202 [00:11<01:55,  1.61it/s, kl=7.31, loss=0.0305, speed=11.3]
  9%|▉         | 18/202 [00:11<01:53,  1.62it/s, kl=7.31, loss=0.0305, speed=11.3]
  9%|▉         | 19/202 [00:12<01:53,  1.62it/s, kl=7.31, loss=0.0305, speed=11.3]
 10%|▉         | 20/202 [00:12<01:53,  1.60it/s, kl=7.31, loss=0.0305, speed=11.3]
 10%|█         | 21/202 [00:13<01:52,  1.61it/s, kl=7.31, loss=0.0305, speed=11.3]
 11%|█         | 22/202 [00:14<01:51,  1.61it/s, kl=7.31, loss=0.0305, speed=11.3]
 11%|█▏        | 23/202 [00:14<01:51,  1.61it/s, kl=7.31, loss=0.0305, speed=11.3]
 12%|█▏        | 24/202 [00:15<01:51,  1.60it/s, kl=7.31, loss=0.0305, speed=11.3]
 12%|█▏        | 25/202 [00:16<01:51,  1.58it/s, kl=7.31, loss=0.0305, speed=11.3]
 13%|█▎        | 26/202 [00:16<01:52,  1.56it/s, kl=7.31, loss=0.0305, speed=11.3]
 13%|█▎        | 27/202 [00:17<01:52,  1.55it/s, kl=7.31, loss=0.0305, speed=11.3]
 14%|█▍        | 28/202 [00:18<01:50,  1.57it/s, kl=7.31, loss=0.0305, speed=11.3]
 14%|█▍        | 29/202 [00:18<01:48,  1.59it/s, kl=7.31, loss=0.0305, speed=11.3]
 15%|█▍        | 30/202 [00:19<01:46,  1.61it/s, kl=7.31, loss=0.0305, speed=11.3]
 15%|█▍        | 30/202 [00:19<01:46,  1.61it/s, kl=7.65, loss=0.0326, speed=11.2]
 15%|█▌        | 31/202 [00:19<01:47,  1.60it/s, kl=7.65, loss=0.0326, speed=11.2]
 16%|█▌        | 32/202 [00:20<01:45,  1.61it/s, kl=7.65, loss=0.0326, speed=11.2]
 16%|█▋        | 33/202 [00:21<01:44,  1.62it/s, kl=7.65, loss=0.0326, speed=11.2]
 17%|█▋        | 34/202 [00:21<01:43,  1.62it/s, kl=7.65, loss=0.0326, speed=11.2]
 17%|█▋        | 35/202 [00:22<01:42,  1.63it/s, kl=7.65, loss=0.0326, speed=11.2]
 18%|█▊        | 36/202 [00:22<01:41,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 18%|█▊        | 37/202 [00:23<01:40,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 19%|█▉        | 38/202 [00:24<01:40,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 19%|█▉        | 39/202 [00:24<01:39,  1.63it/s, kl=7.65, loss=0.0326, speed=11.2]
 20%|█▉        | 40/202 [00:25<01:38,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 20%|██        | 41/202 [00:25<01:38,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 21%|██        | 42/202 [00:26<01:37,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 21%|██▏       | 43/202 [00:27<01:36,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 22%|██▏       | 44/202 [00:27<01:36,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 22%|██▏       | 45/202 [00:28<01:35,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 23%|██▎       | 46/202 [00:29<01:35,  1.64it/s, kl=7.65, loss=0.0326, speed=11.2]
 23%|██▎       | 46/202 [00:29<01:35,  1.64it/s, kl=5.44, loss=0.0249, speed=11.4]
 23%|██▎       | 47/202 [00:29<01:35,  1.62it/s, kl=5.44, loss=0.0249, speed=11.4]
 24%|██▍       | 48/202 [00:30<01:35,  1.62it/s, kl=5.44, loss=0.0249, speed=11.4]
 24%|██▍       | 49/202 [00:30<01:34,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 25%|██▍       | 50/202 [00:31<01:33,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 25%|██▌       | 51/202 [00:32<01:32,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 26%|██▌       | 52/202 [00:32<01:31,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 26%|██▌       | 53/202 [00:33<01:31,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 27%|██▋       | 54/202 [00:33<01:30,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 27%|██▋       | 55/202 [00:34<01:29,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 28%|██▊       | 56/202 [00:35<01:29,  1.62it/s, kl=5.44, loss=0.0249, speed=11.4]
 28%|██▊       | 57/202 [00:35<01:29,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 29%|██▊       | 58/202 [00:36<01:28,  1.62it/s, kl=5.44, loss=0.0249, speed=11.4]
 29%|██▉       | 59/202 [00:37<01:27,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 30%|██▉       | 60/202 [00:37<01:27,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 30%|███       | 61/202 [00:38<01:26,  1.63it/s, kl=5.44, loss=0.0249, speed=11.4]
 31%|███       | 62/202 [00:38<01:26,  1.62it/s, kl=5.44, loss=0.0249, speed=11.4]
 31%|███       | 62/202 [00:39<01:26,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 31%|███       | 63/202 [00:39<01:26,  1.60it/s, kl=7.77, loss=0.0345, speed=11.4]
 32%|███▏      | 64/202 [00:40<01:25,  1.61it/s, kl=7.77, loss=0.0345, speed=11.4]
 32%|███▏      | 65/202 [00:40<01:24,  1.61it/s, kl=7.77, loss=0.0345, speed=11.4]
 33%|███▎      | 66/202 [00:41<01:24,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 33%|███▎      | 67/202 [00:41<01:23,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 34%|███▎      | 68/202 [00:42<01:22,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 34%|███▍      | 69/202 [00:43<01:22,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 35%|███▍      | 70/202 [00:43<01:21,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 35%|███▌      | 71/202 [00:44<01:20,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 36%|███▌      | 72/202 [00:45<01:20,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 36%|███▌      | 73/202 [00:45<01:19,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 37%|███▋      | 74/202 [00:46<01:18,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 37%|███▋      | 75/202 [00:46<01:18,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 38%|███▊      | 76/202 [00:47<01:17,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 38%|███▊      | 77/202 [00:48<01:16,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 39%|███▊      | 78/202 [00:48<01:16,  1.62it/s, kl=7.77, loss=0.0345, speed=11.4]
 39%|███▊      | 78/202 [00:49<01:16,  1.62it/s, kl=7.14, loss=0.0285, speed=11.3]
 39%|███▉      | 79/202 [00:49<01:16,  1.60it/s, kl=7.14, loss=0.0285, speed=11.3]
 40%|███▉      | 80/202 [00:50<01:15,  1.61it/s, kl=7.14, loss=0.0285, speed=11.3]
 40%|████      | 81/202 [00:50<01:15,  1.60it/s, kl=7.14, loss=0.0285, speed=11.3]
 41%|████      | 82/202 [00:51<01:17,  1.54it/s, kl=7.14, loss=0.0285, speed=11.3]
 41%|████      | 83/202 [00:51<01:16,  1.55it/s, kl=7.14, loss=0.0285, speed=11.3]
 42%|████▏     | 84/202 [00:52<01:15,  1.57it/s, kl=7.14, loss=0.0285, speed=11.3]
 42%|████▏     | 85/202 [00:53<01:13,  1.58it/s, kl=7.14, loss=0.0285, speed=11.3]
 43%|████▎     | 86/202 [00:53<01:12,  1.59it/s, kl=7.14, loss=0.0285, speed=11.3]
 43%|████▎     | 87/202 [00:54<01:11,  1.60it/s, kl=7.14, loss=0.0285, speed=11.3]
 44%|████▎     | 88/202 [00:55<01:11,  1.60it/s, kl=7.14, loss=0.0285, speed=11.3]
 44%|████▍     | 89/202 [00:55<01:10,  1.61it/s, kl=7.14, loss=0.0285, speed=11.3]
 45%|████▍     | 90/202 [00:56<01:09,  1.61it/s, kl=7.14, loss=0.0285, speed=11.3]
 45%|████▌     | 91/202 [00:56<01:08,  1.61it/s, kl=7.14, loss=0.0285, speed=11.3]
 46%|████▌     | 92/202 [00:57<01:08,  1.61it/s, kl=7.14, loss=0.0285, speed=11.3]
 46%|████▌     | 93/202 [00:58<01:07,  1.61it/s, kl=7.14, loss=0.0285, speed=11.3]
 47%|████▋     | 94/202 [00:58<01:07,  1.61it/s, kl=7.14, loss=0.0285, speed=11.3]
 47%|████▋     | 94/202 [00:59<01:07,  1.61it/s, kl=6.4, loss=0.0193, speed=11.1] 
 47%|████▋     | 95/202 [00:59<01:07,  1.59it/s, kl=6.4, loss=0.0193, speed=11.1]
 48%|████▊     | 96/202 [01:00<01:06,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 48%|████▊     | 97/202 [01:00<01:05,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 49%|████▊     | 98/202 [01:01<01:05,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 49%|████▉     | 99/202 [01:01<01:04,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 50%|████▉     | 100/202 [01:02<01:03,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 50%|█████     | 101/202 [01:03<01:02,  1.61it/s, kl=6.4, loss=0.0193, speed=11.1]
 50%|█████     | 102/202 [01:03<01:02,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 51%|█████     | 103/202 [01:04<01:01,  1.61it/s, kl=6.4, loss=0.0193, speed=11.1]
 51%|█████▏    | 104/202 [01:05<01:01,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 52%|█████▏    | 105/202 [01:05<01:00,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 52%|█████▏    | 106/202 [01:06<00:59,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 53%|█████▎    | 107/202 [01:06<00:59,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 53%|█████▎    | 108/202 [01:07<00:58,  1.61it/s, kl=6.4, loss=0.0193, speed=11.1]
 54%|█████▍    | 109/202 [01:08<00:57,  1.61it/s, kl=6.4, loss=0.0193, speed=11.1]
 54%|█████▍    | 110/202 [01:08<00:57,  1.60it/s, kl=6.4, loss=0.0193, speed=11.1]
 54%|█████▍    | 110/202 [01:09<00:57,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 55%|█████▍    | 111/202 [01:09<00:57,  1.58it/s, kl=4.85, loss=0.0239, speed=11.2]
 55%|█████▌    | 112/202 [01:10<00:56,  1.59it/s, kl=4.85, loss=0.0239, speed=11.2]
 56%|█████▌    | 113/202 [01:10<00:55,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 56%|█████▋    | 114/202 [01:11<00:55,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 57%|█████▋    | 115/202 [01:11<00:54,  1.61it/s, kl=4.85, loss=0.0239, speed=11.2]
 57%|█████▋    | 116/202 [01:12<00:53,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 58%|█████▊    | 117/202 [01:13<00:52,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 58%|█████▊    | 118/202 [01:13<00:52,  1.61it/s, kl=4.85, loss=0.0239, speed=11.2]
 59%|█████▉    | 119/202 [01:14<00:51,  1.61it/s, kl=4.85, loss=0.0239, speed=11.2]
 59%|█████▉    | 120/202 [01:15<00:51,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 60%|█████▉    | 121/202 [01:15<00:50,  1.61it/s, kl=4.85, loss=0.0239, speed=11.2]
 60%|██████    | 122/202 [01:16<00:49,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 61%|██████    | 123/202 [01:16<00:49,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 61%|██████▏   | 124/202 [01:17<00:48,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 62%|██████▏   | 125/202 [01:18<00:48,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 62%|██████▏   | 126/202 [01:18<00:47,  1.60it/s, kl=4.85, loss=0.0239, speed=11.2]
 62%|██████▏   | 126/202 [01:19<00:47,  1.60it/s, kl=6.49, loss=0.023, speed=11.2] 
 63%|██████▎   | 127/202 [01:19<00:47,  1.58it/s, kl=6.49, loss=0.023, speed=11.2]
 63%|██████▎   | 128/202 [01:20<00:46,  1.59it/s, kl=6.49, loss=0.023, speed=11.2]
 64%|██████▍   | 129/202 [01:20<00:45,  1.59it/s, kl=6.49, loss=0.023, speed=11.2]
 64%|██████▍   | 130/202 [01:21<00:45,  1.59it/s, kl=6.49, loss=0.023, speed=11.2]
 65%|██████▍   | 131/202 [01:21<00:44,  1.59it/s, kl=6.49, loss=0.023, speed=11.2]
 65%|██████▌   | 132/202 [01:22<00:44,  1.59it/s, kl=6.49, loss=0.023, speed=11.2]
 66%|██████▌   | 133/202 [01:23<00:43,  1.59it/s, kl=6.49, loss=0.023, speed=11.2]
 66%|██████▋   | 134/202 [01:23<00:42,  1.60it/s, kl=6.49, loss=0.023, speed=11.2]
 67%|██████▋   | 135/202 [01:24<00:41,  1.60it/s, kl=6.49, loss=0.023, speed=11.2]
 67%|██████▋   | 136/202 [01:25<00:41,  1.60it/s, kl=6.49, loss=0.023, speed=11.2]
 68%|██████▊   | 137/202 [01:25<00:40,  1.60it/s, kl=6.49, loss=0.023, speed=11.2]
 68%|██████▊   | 138/202 [01:26<00:39,  1.60it/s, kl=6.49, loss=0.023, speed=11.2]
 69%|██████▉   | 139/202 [01:26<00:39,  1.60it/s, kl=6.49, loss=0.023, speed=11.2]
 69%|██████▉   | 140/202 [01:27<00:38,  1.60it/s, kl=6.49, loss=0.023, speed=11.2]
 70%|██████▉   | 141/202 [01:28<00:38,  1.60it/s, kl=6.49, loss=0.023, speed=11.2]
 70%|███████   | 142/202 [01:28<00:37,  1.60it/s, kl=6.49, loss=0.023, speed=11.2]
 70%|███████   | 142/202 [01:29<00:37,  1.60it/s, kl=6.98, loss=0.0345, speed=11.2]
 71%|███████   | 143/202 [01:29<00:37,  1.58it/s, kl=6.98, loss=0.0345, speed=11.2]
 71%|███████▏  | 144/202 [01:30<00:36,  1.59it/s, kl=6.98, loss=0.0345, speed=11.2]
 72%|███████▏  | 145/202 [01:30<00:35,  1.59it/s, kl=6.98, loss=0.0345, speed=11.2]
 72%|███████▏  | 146/202 [01:31<00:35,  1.59it/s, kl=6.98, loss=0.0345, speed=11.2]
 73%|███████▎  | 147/202 [01:31<00:34,  1.59it/s, kl=6.98, loss=0.0345, speed=11.2]
 73%|███████▎  | 148/202 [01:32<00:34,  1.59it/s, kl=6.98, loss=0.0345, speed=11.2]
 74%|███████▍  | 149/202 [01:33<00:33,  1.59it/s, kl=6.98, loss=0.0345, speed=11.2]
 74%|███████▍  | 150/202 [01:33<00:32,  1.60it/s, kl=6.98, loss=0.0345, speed=11.2]
 75%|███████▍  | 151/202 [01:34<00:31,  1.60it/s, kl=6.98, loss=0.0345, speed=11.2]
 75%|███████▌  | 152/202 [01:35<00:31,  1.60it/s, kl=6.98, loss=0.0345, speed=11.2]
 76%|███████▌  | 153/202 [01:35<00:30,  1.60it/s, kl=6.98, loss=0.0345, speed=11.2]
 76%|███████▌  | 154/202 [01:36<00:29,  1.60it/s, kl=6.98, loss=0.0345, speed=11.2]
 77%|███████▋  | 155/202 [01:36<00:29,  1.60it/s, kl=6.98, loss=0.0345, speed=11.2]
 77%|███████▋  | 156/202 [01:37<00:28,  1.60it/s, kl=6.98, loss=0.0345, speed=11.2]
 78%|███████▊  | 157/202 [01:38<00:28,  1.60it/s, kl=6.98, loss=0.0345, speed=11.2]
 78%|███████▊  | 158/202 [01:38<00:27,  1.59it/s, kl=6.98, loss=0.0345, speed=11.2]
 78%|███████▊  | 158/202 [01:39<00:27,  1.59it/s, kl=7.27, loss=0.0249, speed=11.2]
 79%|███████▊  | 159/202 [01:39<00:27,  1.57it/s, kl=7.27, loss=0.0249, speed=11.2]
 79%|███████▉  | 160/202 [01:40<00:26,  1.59it/s, kl=7.27, loss=0.0249, speed=11.2]
 80%|███████▉  | 161/202 [01:40<00:25,  1.59it/s, kl=7.27, loss=0.0249, speed=11.2]
 80%|████████  | 162/202 [01:41<00:25,  1.60it/s, kl=7.27, loss=0.0249, speed=11.2]
 81%|████████  | 163/202 [01:42<00:24,  1.59it/s, kl=7.27, loss=0.0249, speed=11.2]
 81%|████████  | 164/202 [01:42<00:23,  1.59it/s, kl=7.27, loss=0.0249, speed=11.2]
 82%|████████▏ | 165/202 [01:43<00:23,  1.59it/s, kl=7.27, loss=0.0249, speed=11.2]
 82%|████████▏ | 166/202 [01:43<00:22,  1.60it/s, kl=7.27, loss=0.0249, speed=11.2]
 83%|████████▎ | 167/202 [01:44<00:21,  1.60it/s, kl=7.27, loss=0.0249, speed=11.2]
 83%|████████▎ | 168/202 [01:45<00:21,  1.60it/s, kl=7.27, loss=0.0249, speed=11.2]
 84%|████████▎ | 169/202 [01:45<00:20,  1.60it/s, kl=7.27, loss=0.0249, speed=11.2]
 84%|████████▍ | 170/202 [01:46<00:20,  1.60it/s, kl=7.27, loss=0.0249, speed=11.2]
 85%|████████▍ | 171/202 [01:47<00:19,  1.60it/s, kl=7.27, loss=0.0249, speed=11.2]
 85%|████████▌ | 172/202 [01:47<00:18,  1.60it/s, kl=7.27, loss=0.0249, speed=11.2]
 86%|████████▌ | 173/202 [01:48<00:18,  1.59it/s, kl=7.27, loss=0.0249, speed=11.2]
 86%|████████▌ | 174/202 [01:48<00:17,  1.59it/s, kl=7.27, loss=0.0249, speed=11.2]
 86%|████████▌ | 174/202 [01:49<00:17,  1.59it/s, kl=5.62, loss=0.0308, speed=11.2]
 87%|████████▋ | 175/202 [01:49<00:17,  1.57it/s, kl=5.62, loss=0.0308, speed=11.2]
 87%|████████▋ | 176/202 [01:50<00:16,  1.59it/s, kl=5.62, loss=0.0308, speed=11.2]
 88%|████████▊ | 177/202 [01:50<00:15,  1.59it/s, kl=5.62, loss=0.0308, speed=11.2]
 88%|████████▊ | 178/202 [01:51<00:15,  1.58it/s, kl=5.62, loss=0.0308, speed=11.2]
 89%|████████▊ | 179/202 [01:52<00:14,  1.59it/s, kl=5.62, loss=0.0308, speed=11.2]
 89%|████████▉ | 180/202 [01:52<00:13,  1.59it/s, kl=5.62, loss=0.0308, speed=11.2]
 90%|████████▉ | 181/202 [01:53<00:13,  1.60it/s, kl=5.62, loss=0.0308, speed=11.2]
 90%|█████████ | 182/202 [01:53<00:12,  1.60it/s, kl=5.62, loss=0.0308, speed=11.2]
 91%|█████████ | 183/202 [01:54<00:11,  1.60it/s, kl=5.62, loss=0.0308, speed=11.2]
 91%|█████████ | 184/202 [01:55<00:11,  1.60it/s, kl=5.62, loss=0.0308, speed=11.2]
 92%|█████████▏| 185/202 [01:55<00:10,  1.60it/s, kl=5.62, loss=0.0308, speed=11.2]
 92%|█████████▏| 186/202 [01:56<00:09,  1.60it/s, kl=5.62, loss=0.0308, speed=11.2]
 93%|█████████▎| 187/202 [01:57<00:09,  1.60it/s, kl=5.62, loss=0.0308, speed=11.2]
 93%|█████████▎| 188/202 [01:57<00:08,  1.60it/s, kl=5.62, loss=0.0308, speed=11.2]
 94%|█████████▎| 189/202 [01:58<00:08,  1.59it/s, kl=5.62, loss=0.0308, speed=11.2]
 94%|█████████▍| 190/202 [01:58<00:07,  1.59it/s, kl=5.62, loss=0.0308, speed=11.2]
 94%|█████████▍| 190/202 [01:59<00:07,  1.59it/s, kl=6.12, loss=0.0296, speed=11.2]
 95%|█████████▍| 191/202 [01:59<00:06,  1.58it/s, kl=6.12, loss=0.0296, speed=11.2]
 95%|█████████▌| 192/202 [02:00<00:06,  1.59it/s, kl=6.12, loss=0.0296, speed=11.2]
 96%|█████████▌| 193/202 [02:00<00:05,  1.59it/s, kl=6.12, loss=0.0296, speed=11.2]
 96%|█████████▌| 194/202 [02:01<00:05,  1.60it/s, kl=6.12, loss=0.0296, speed=11.2]
 97%|█████████▋| 195/202 [02:02<00:04,  1.60it/s, kl=6.12, loss=0.0296, speed=11.2]
 97%|█████████▋| 196/202 [02:02<00:03,  1.60it/s, kl=6.12, loss=0.0296, speed=11.2]
 98%|█████████▊| 197/202 [02:03<00:03,  1.60it/s, kl=6.12, loss=0.0296, speed=11.2]
 98%|█████████▊| 198/202 [02:03<00:02,  1.60it/s, kl=6.12, loss=0.0296, speed=11.2]
 99%|█████████▊| 199/202 [02:04<00:01,  1.60it/s, kl=6.12, loss=0.0296, speed=11.2]
 99%|█████████▉| 200/202 [02:05<00:01,  1.60it/s, kl=6.12, loss=0.0296, speed=11.2]
100%|█████████▉| 201/202 [02:05<00:00,  1.60it/s, kl=6.12, loss=0.0296, speed=11.2]
100%|██████████| 202/202 [02:06<00:00,  1.91it/s, kl=6.12, loss=0.0296, speed=11.2]
100%|██████████| 202/202 [02:06<00:00,  1.60it/s, kl=6.12, loss=0.0296, speed=11.2]

  0%|          | 0/202 [00:00<?, ?it/s]
  0%|          | 1/202 [00:00<02:06,  1.59it/s]
  1%|          | 2/202 [00:01<02:07,  1.57it/s]
  1%|▏         | 3/202 [00:01<02:05,  1.59it/s]
  2%|▏         | 4/202 [00:02<02:06,  1.57it/s]
  2%|▏         | 4/202 [00:03<02:06,  1.57it/s, kl=7.83, loss=0.0273, speed=11.5]
  2%|▏         | 5/202 [00:03<02:06,  1.56it/s, kl=7.83, loss=0.0273, speed=11.5]
  3%|▎         | 6/202 [00:03<02:04,  1.57it/s, kl=7.83, loss=0.0273, speed=11.5]
  3%|▎         | 7/202 [00:04<02:04,  1.56it/s, kl=7.83, loss=0.0273, speed=11.5]
  4%|▍         | 8/202 [00:05<02:04,  1.56it/s, kl=7.83, loss=0.0273, speed=11.5]
  4%|▍         | 9/202 [00:05<02:02,  1.58it/s, kl=7.83, loss=0.0273, speed=11.5]
  5%|▍         | 10/202 [00:06<02:01,  1.58it/s, kl=7.83, loss=0.0273, speed=11.5]
  5%|▌         | 11/202 [00:06<02:00,  1.59it/s, kl=7.83, loss=0.0273, speed=11.5]
  6%|▌         | 12/202 [00:07<01:59,  1.59it/s, kl=7.83, loss=0.0273, speed=11.5]
  6%|▋         | 13/202 [00:08<01:58,  1.59it/s, kl=7.83, loss=0.0273, speed=11.5]
  7%|▋         | 14/202 [00:08<01:57,  1.60it/s, kl=7.83, loss=0.0273, speed=11.5]
  7%|▋         | 15/202 [00:09<01:57,  1.60it/s, kl=7.83, loss=0.0273, speed=11.5]
  8%|▊         | 16/202 [00:10<01:56,  1.60it/s, kl=7.83, loss=0.0273, speed=11.5]
  8%|▊         | 17/202 [00:10<01:55,  1.59it/s, kl=7.83, loss=0.0273, speed=11.5]
  9%|▉         | 18/202 [00:11<01:54,  1.60it/s, kl=7.83, loss=0.0273, speed=11.5]
  9%|▉         | 19/202 [00:11<01:54,  1.60it/s, kl=7.83, loss=0.0273, speed=11.5]
 10%|▉         | 20/202 [00:12<01:53,  1.60it/s, kl=7.83, loss=0.0273, speed=11.5]
 10%|▉         | 20/202 [00:13<01:53,  1.60it/s, kl=7.82, loss=0.0236, speed=11.1]
 10%|█         | 21/202 [00:13<01:54,  1.58it/s, kl=7.82, loss=0.0236, speed=11.1]
 11%|█         | 22/202 [00:13<01:53,  1.59it/s, kl=7.82, loss=0.0236, speed=11.1]
 11%|█▏        | 23/202 [00:14<01:52,  1.59it/s, kl=7.82, loss=0.0236, speed=11.1]
 12%|█▏        | 24/202 [00:15<01:51,  1.59it/s, kl=7.82, loss=0.0236, speed=11.1]
 12%|█▏        | 25/202 [00:15<01:51,  1.59it/s, kl=7.82, loss=0.0236, speed=11.1]
 13%|█▎        | 26/202 [00:16<01:50,  1.59it/s, kl=7.82, loss=0.0236, speed=11.1]
 13%|█▎        | 27/202 [00:17<01:49,  1.60it/s, kl=7.82, loss=0.0236, speed=11.1]
 14%|█▍        | 28/202 [00:17<01:50,  1.57it/s, kl=7.82, loss=0.0236, speed=11.1]
 14%|█▍        | 29/202 [00:18<01:49,  1.58it/s, kl=7.82, loss=0.0236, speed=11.1]
 15%|█▍        | 30/202 [00:18<01:49,  1.57it/s, kl=7.82, loss=0.0236, speed=11.1]
 15%|█▌        | 31/202 [00:19<01:48,  1.58it/s, kl=7.82, loss=0.0236, speed=11.1]
 16%|█▌        | 32/202 [00:20<01:46,  1.59it/s, kl=7.82, loss=0.0236, speed=11.1]
 16%|█▋        | 33/202 [00:20<01:46,  1.59it/s, kl=7.82, loss=0.0236, speed=11.1]
 17%|█▋        | 34/202 [00:21<01:45,  1.59it/s, kl=7.82, loss=0.0236, speed=11.1]
 17%|█▋        | 35/202 [00:22<01:44,  1.60it/s, kl=7.82, loss=0.0236, speed=11.1]
 18%|█▊        | 36/202 [00:22<01:43,  1.60it/s, kl=7.82, loss=0.0236, speed=11.1]
 18%|█▊        | 36/202 [00:23<01:43,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 18%|█▊        | 37/202 [00:23<01:44,  1.57it/s, kl=5.89, loss=0.0208, speed=11.1]
 19%|█▉        | 38/202 [00:23<01:43,  1.58it/s, kl=5.89, loss=0.0208, speed=11.1]
 19%|█▉        | 39/202 [00:24<01:42,  1.58it/s, kl=5.89, loss=0.0208, speed=11.1]
 20%|█▉        | 40/202 [00:25<01:41,  1.59it/s, kl=5.89, loss=0.0208, speed=11.1]
 20%|██        | 41/202 [00:25<01:41,  1.59it/s, kl=5.89, loss=0.0208, speed=11.1]
 21%|██        | 42/202 [00:26<01:40,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 21%|██▏       | 43/202 [00:27<01:39,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 22%|██▏       | 44/202 [00:27<01:38,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 22%|██▏       | 45/202 [00:28<01:38,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 23%|██▎       | 46/202 [00:28<01:37,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 23%|██▎       | 47/202 [00:29<01:36,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 24%|██▍       | 48/202 [00:30<01:36,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 24%|██▍       | 49/202 [00:30<01:35,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 25%|██▍       | 50/202 [00:31<01:34,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 25%|██▌       | 51/202 [00:32<01:33,  1.61it/s, kl=5.89, loss=0.0208, speed=11.1]
 26%|██▌       | 52/202 [00:32<01:33,  1.60it/s, kl=5.89, loss=0.0208, speed=11.1]
 26%|██▌       | 52/202 [00:33<01:33,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 26%|██▌       | 53/202 [00:33<01:33,  1.59it/s, kl=5.68, loss=0.0277, speed=11.2]
 27%|██▋       | 54/202 [00:33<01:33,  1.59it/s, kl=5.68, loss=0.0277, speed=11.2]
 27%|██▋       | 55/202 [00:34<01:32,  1.59it/s, kl=5.68, loss=0.0277, speed=11.2]
 28%|██▊       | 56/202 [00:35<01:31,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 28%|██▊       | 57/202 [00:35<01:30,  1.59it/s, kl=5.68, loss=0.0277, speed=11.2]
 29%|██▊       | 58/202 [00:36<01:29,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 29%|██▉       | 59/202 [00:37<01:29,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 30%|██▉       | 60/202 [00:37<01:28,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 30%|███       | 61/202 [00:38<01:28,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 31%|███       | 62/202 [00:38<01:27,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 31%|███       | 63/202 [00:39<01:27,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 32%|███▏      | 64/202 [00:40<01:26,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 32%|███▏      | 65/202 [00:40<01:25,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 33%|███▎      | 66/202 [00:41<01:25,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 33%|███▎      | 67/202 [00:42<01:24,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 34%|███▎      | 68/202 [00:42<01:23,  1.60it/s, kl=5.68, loss=0.0277, speed=11.2]
 34%|███▎      | 68/202 [00:43<01:23,  1.60it/s, kl=5.73, loss=0.0262, speed=11.2]
 34%|███▍      | 69/202 [00:43<01:24,  1.58it/s, kl=5.73, loss=0.0262, speed=11.2]
 35%|███▍      | 70/202 [00:44<01:23,  1.59it/s, kl=5.73, loss=0.0262, speed=11.2]
 35%|███▌      | 71/202 [00:44<01:22,  1.59it/s, kl=5.73, loss=0.0262, speed=11.2]
 36%|███▌      | 72/202 [00:45<01:21,  1.59it/s, kl=5.73, loss=0.0262, speed=11.2]
 36%|███▌      | 73/202 [00:45<01:20,  1.60it/s, kl=5.73, loss=0.0262, speed=11.2]
 37%|███▋      | 74/202 [00:46<01:19,  1.60it/s, kl=5.73, loss=0.0262, speed=11.2]
 37%|███▋      | 75/202 [00:47<01:19,  1.60it/s, kl=5.73, loss=0.0262, speed=11.2]
 38%|███▊      | 76/202 [00:47<01:18,  1.61it/s, kl=5.73, loss=0.0262, speed=11.2]
 38%|███▊      | 77/202 [00:48<01:17,  1.61it/s, kl=5.73, loss=0.0262, speed=11.2]
 39%|███▊      | 78/202 [00:48<01:17,  1.61it/s, kl=5.73, loss=0.0262, speed=11.2]
 39%|███▉      | 79/202 [00:49<01:17,  1.59it/s, kl=5.73, loss=0.0262, speed=11.2]
 40%|███▉      | 80/202 [00:50<01:16,  1.59it/s, kl=5.73, loss=0.0262, speed=11.2]
 40%|████      | 81/202 [00:50<01:15,  1.60it/s, kl=5.73, loss=0.0262, speed=11.2]
 41%|████      | 82/202 [00:51<01:15,  1.58it/s, kl=5.73, loss=0.0262, speed=11.2]
 41%|████      | 83/202 [00:52<01:15,  1.58it/s, kl=5.73, loss=0.0262, speed=11.2]
 42%|████▏     | 84/202 [00:52<01:14,  1.59it/s, kl=5.73, loss=0.0262, speed=11.2]
 42%|████▏     | 84/202 [00:53<01:14,  1.59it/s, kl=4.88, loss=0.0237, speed=11.2]
 42%|████▏     | 85/202 [00:53<01:14,  1.57it/s, kl=4.88, loss=0.0237, speed=11.2]
 43%|████▎     | 86/202 [00:54<01:13,  1.58it/s, kl=4.88, loss=0.0237, speed=11.2]
 43%|████▎     | 87/202 [00:54<01:12,  1.58it/s, kl=4.88, loss=0.0237, speed=11.2]
 44%|████▎     | 88/202 [00:55<01:11,  1.59it/s, kl=4.88, loss=0.0237, speed=11.2]
 44%|████▍     | 89/202 [00:55<01:10,  1.59it/s, kl=4.88, loss=0.0237, speed=11.2]
 45%|████▍     | 90/202 [00:56<01:10,  1.59it/s, kl=4.88, loss=0.0237, speed=11.2]
 45%|████▌     | 91/202 [00:57<01:09,  1.59it/s, kl=4.88, loss=0.0237, speed=11.2]
 46%|████▌     | 92/202 [00:57<01:08,  1.60it/s, kl=4.88, loss=0.0237, speed=11.2]
 46%|████▌     | 93/202 [00:58<01:08,  1.60it/s, kl=4.88, loss=0.0237, speed=11.2]
 47%|████▋     | 94/202 [00:59<01:07,  1.60it/s, kl=4.88, loss=0.0237, speed=11.2]
 47%|████▋     | 95/202 [00:59<01:06,  1.60it/s, kl=4.88, loss=0.0237, speed=11.2]
 48%|████▊     | 96/202 [01:00<01:06,  1.60it/s, kl=4.88, loss=0.0237, speed=11.2]
 48%|████▊     | 97/202 [01:00<01:05,  1.60it/s, kl=4.88, loss=0.0237, speed=11.2]
 49%|████▊     | 98/202 [01:01<01:05,  1.60it/s, kl=4.88, loss=0.0237, speed=11.2]
 49%|████▉     | 99/202 [01:02<01:04,  1.60it/s, kl=4.88, loss=0.0237, speed=11.2]
 50%|████▉     | 100/202 [01:02<01:03,  1.60it/s, kl=4.88, loss=0.0237, speed=11.2]
 50%|████▉     | 100/202 [01:03<01:03,  1.60it/s, kl=6.41, loss=0.0247, speed=11.2]
 50%|█████     | 101/202 [01:03<01:03,  1.58it/s, kl=6.41, loss=0.0247, speed=11.2]
 50%|█████     | 102/202 [01:04<01:03,  1.57it/s, kl=6.41, loss=0.0247, speed=11.2]
 51%|█████     | 103/202 [01:04<01:03,  1.56it/s, kl=6.41, loss=0.0247, speed=11.2]
 51%|█████▏    | 104/202 [01:05<01:02,  1.57it/s, kl=6.41, loss=0.0247, speed=11.2]
 52%|█████▏    | 105/202 [01:06<01:01,  1.58it/s, kl=6.41, loss=0.0247, speed=11.2]
 52%|█████▏    | 106/202 [01:06<01:00,  1.59it/s, kl=6.41, loss=0.0247, speed=11.2]
 53%|█████▎    | 107/202 [01:07<00:59,  1.59it/s, kl=6.41, loss=0.0247, speed=11.2]
 53%|█████▎    | 108/202 [01:07<00:59,  1.59it/s, kl=6.41, loss=0.0247, speed=11.2]
 54%|█████▍    | 109/202 [01:08<00:58,  1.59it/s, kl=6.41, loss=0.0247, speed=11.2]
 54%|█████▍    | 110/202 [01:09<00:59,  1.56it/s, kl=6.41, loss=0.0247, speed=11.2]
 55%|█████▍    | 111/202 [01:09<00:59,  1.54it/s, kl=6.41, loss=0.0247, speed=11.2]
 55%|█████▌    | 112/202 [01:10<00:59,  1.50it/s, kl=6.41, loss=0.0247, speed=11.2]
 56%|█████▌    | 113/202 [01:11<00:59,  1.48it/s, kl=6.41, loss=0.0247, speed=11.2]
 56%|█████▋    | 114/202 [01:11<00:58,  1.52it/s, kl=6.41, loss=0.0247, speed=11.2]
 57%|█████▋    | 115/202 [01:12<00:56,  1.53it/s, kl=6.41, loss=0.0247, speed=11.2]
 57%|█████▋    | 116/202 [01:13<00:55,  1.55it/s, kl=6.41, loss=0.0247, speed=11.2]
 57%|█████▋    | 116/202 [01:13<00:55,  1.55it/s, kl=8.12, loss=0.024, speed=10.8] 
 58%|█████▊    | 117/202 [01:13<00:54,  1.55it/s, kl=8.12, loss=0.024, speed=10.8]
 58%|█████▊    | 118/202 [01:14<00:55,  1.52it/s, kl=8.12, loss=0.024, speed=10.8]
 59%|█████▉    | 119/202 [01:15<00:55,  1.50it/s, kl=8.12, loss=0.024, speed=10.8]
 59%|█████▉    | 120/202 [01:15<00:55,  1.47it/s, kl=8.12, loss=0.024, speed=10.8]
 60%|█████▉    | 121/202 [01:16<00:56,  1.44it/s, kl=8.12, loss=0.024, speed=10.8]
 60%|██████    | 122/202 [01:17<00:55,  1.44it/s, kl=8.12, loss=0.024, speed=10.8]
 61%|██████    | 123/202 [01:18<00:55,  1.43it/s, kl=8.12, loss=0.024, speed=10.8]
 61%|██████▏   | 124/202 [01:18<00:54,  1.44it/s, kl=8.12, loss=0.024, speed=10.8]
 62%|██████▏   | 125/202 [01:19<00:53,  1.45it/s, kl=8.12, loss=0.024, speed=10.8]
 62%|██████▏   | 126/202 [01:20<00:52,  1.46it/s, kl=8.12, loss=0.024, speed=10.8]
 63%|██████▎   | 127/202 [01:20<00:51,  1.46it/s, kl=8.12, loss=0.024, speed=10.8]
 63%|██████▎   | 128/202 [01:21<00:50,  1.48it/s, kl=8.12, loss=0.024, speed=10.8]
 64%|██████▍   | 129/202 [01:22<00:49,  1.49it/s, kl=8.12, loss=0.024, speed=10.8]
 64%|██████▍   | 130/202 [01:22<00:48,  1.49it/s, kl=8.12, loss=0.024, speed=10.8]
 65%|██████▍   | 131/202 [01:23<00:47,  1.49it/s, kl=8.12, loss=0.024, speed=10.8]
 65%|██████▌   | 132/202 [01:24<00:46,  1.49it/s, kl=8.12, loss=0.024, speed=10.8]
 65%|██████▌   | 132/202 [01:24<00:46,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 66%|██████▌   | 133/202 [01:24<00:46,  1.48it/s, kl=6.11, loss=0.0225, speed=10.2]
 66%|██████▋   | 134/202 [01:25<00:45,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 67%|██████▋   | 135/202 [01:26<00:44,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 67%|██████▋   | 136/202 [01:26<00:44,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 68%|██████▊   | 137/202 [01:27<00:43,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 68%|██████▊   | 138/202 [01:28<00:43,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 69%|██████▉   | 139/202 [01:28<00:42,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 69%|██████▉   | 140/202 [01:29<00:41,  1.50it/s, kl=6.11, loss=0.0225, speed=10.2]
 70%|██████▉   | 141/202 [01:30<00:40,  1.50it/s, kl=6.11, loss=0.0225, speed=10.2]
 70%|███████   | 142/202 [01:30<00:40,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 71%|███████   | 143/202 [01:31<00:39,  1.50it/s, kl=6.11, loss=0.0225, speed=10.2]
 71%|███████▏  | 144/202 [01:32<00:38,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 72%|███████▏  | 145/202 [01:32<00:38,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 72%|███████▏  | 146/202 [01:33<00:37,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 73%|███████▎  | 147/202 [01:34<00:36,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 73%|███████▎  | 148/202 [01:34<00:36,  1.49it/s, kl=6.11, loss=0.0225, speed=10.2]
 73%|███████▎  | 148/202 [01:35<00:36,  1.49it/s, kl=5.28, loss=0.0287, speed=10.4]
 74%|███████▍  | 149/202 [01:35<00:35,  1.48it/s, kl=5.28, loss=0.0287, speed=10.4]
 74%|███████▍  | 150/202 [01:36<00:35,  1.48it/s, kl=5.28, loss=0.0287, speed=10.4]
 75%|███████▍  | 151/202 [01:36<00:34,  1.49it/s, kl=5.28, loss=0.0287, speed=10.4]
 75%|███████▌  | 152/202 [01:37<00:33,  1.49it/s, kl=5.28, loss=0.0287, speed=10.4]
 76%|███████▌  | 153/202 [01:38<00:32,  1.49it/s, kl=5.28, loss=0.0287, speed=10.4]
 76%|███████▌  | 154/202 [01:38<00:32,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 77%|███████▋  | 155/202 [01:39<00:31,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 77%|███████▋  | 156/202 [01:40<00:30,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 78%|███████▊  | 157/202 [01:40<00:29,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 78%|███████▊  | 158/202 [01:41<00:29,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 79%|███████▊  | 159/202 [01:42<00:28,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 79%|███████▉  | 160/202 [01:42<00:27,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 80%|███████▉  | 161/202 [01:43<00:27,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 80%|████████  | 162/202 [01:44<00:26,  1.49it/s, kl=5.28, loss=0.0287, speed=10.4]
 81%|████████  | 163/202 [01:44<00:26,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 81%|████████  | 164/202 [01:45<00:25,  1.50it/s, kl=5.28, loss=0.0287, speed=10.4]
 81%|████████  | 164/202 [01:46<00:25,  1.50it/s, kl=6.15, loss=0.0279, speed=10.5]
 82%|████████▏ | 165/202 [01:46<00:24,  1.48it/s, kl=6.15, loss=0.0279, speed=10.5]
 82%|████████▏ | 166/202 [01:46<00:24,  1.49it/s, kl=6.15, loss=0.0279, speed=10.5]
 83%|████████▎ | 167/202 [01:47<00:23,  1.49it/s, kl=6.15, loss=0.0279, speed=10.5]
 83%|████████▎ | 168/202 [01:48<00:22,  1.50it/s, kl=6.15, loss=0.0279, speed=10.5]
 84%|████████▎ | 169/202 [01:48<00:22,  1.49it/s, kl=6.15, loss=0.0279, speed=10.5]
 84%|████████▍ | 170/202 [01:49<00:21,  1.49it/s, kl=6.15, loss=0.0279, speed=10.5]
 85%|████████▍ | 171/202 [01:50<00:20,  1.50it/s, kl=6.15, loss=0.0279, speed=10.5]
 85%|████████▌ | 172/202 [01:50<00:20,  1.50it/s, kl=6.15, loss=0.0279, speed=10.5]
 86%|████████▌ | 173/202 [01:51<00:19,  1.51it/s, kl=6.15, loss=0.0279, speed=10.5]
 86%|████████▌ | 174/202 [01:52<00:18,  1.51it/s, kl=6.15, loss=0.0279, speed=10.5]
 87%|████████▋ | 175/202 [01:52<00:17,  1.51it/s, kl=6.15, loss=0.0279, speed=10.5]
 87%|████████▋ | 176/202 [01:53<00:17,  1.50it/s, kl=6.15, loss=0.0279, speed=10.5]
 88%|████████▊ | 177/202 [01:54<00:16,  1.50it/s, kl=6.15, loss=0.0279, speed=10.5]
 88%|████████▊ | 178/202 [01:54<00:15,  1.51it/s, kl=6.15, loss=0.0279, speed=10.5]
 89%|████████▊ | 179/202 [01:55<00:15,  1.51it/s, kl=6.15, loss=0.0279, speed=10.5]
 89%|████████▉ | 180/202 [01:56<00:14,  1.50it/s, kl=6.15, loss=0.0279, speed=10.5]
 89%|████████▉ | 180/202 [01:56<00:14,  1.50it/s, kl=11, loss=0.0398, speed=10.5]  
 90%|████████▉ | 181/202 [01:56<00:14,  1.48it/s, kl=11, loss=0.0398, speed=10.5]
 90%|█████████ | 182/202 [01:57<00:13,  1.49it/s, kl=11, loss=0.0398, speed=10.5]
 91%|█████████ | 183/202 [01:58<00:12,  1.49it/s, kl=11, loss=0.0398, speed=10.5]
 91%|█████████ | 184/202 [01:58<00:11,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 92%|█████████▏| 185/202 [01:59<00:11,  1.49it/s, kl=11, loss=0.0398, speed=10.5]
 92%|█████████▏| 186/202 [02:00<00:10,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 93%|█████████▎| 187/202 [02:00<00:09,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 93%|█████████▎| 188/202 [02:01<00:09,  1.49it/s, kl=11, loss=0.0398, speed=10.5]
 94%|█████████▎| 189/202 [02:02<00:08,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 94%|█████████▍| 190/202 [02:02<00:08,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 95%|█████████▍| 191/202 [02:03<00:07,  1.49it/s, kl=11, loss=0.0398, speed=10.5]
 95%|█████████▌| 192/202 [02:04<00:06,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 96%|█████████▌| 193/202 [02:04<00:05,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 96%|█████████▌| 194/202 [02:05<00:05,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 97%|█████████▋| 195/202 [02:06<00:04,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 97%|█████████▋| 196/202 [02:06<00:03,  1.50it/s, kl=11, loss=0.0398, speed=10.5]
 97%|█████████▋| 196/202 [02:07<00:03,  1.50it/s, kl=6.77, loss=0.0226, speed=10.5]
 98%|█████████▊| 197/202 [02:07<00:03,  1.48it/s, kl=6.77, loss=0.0226, speed=10.5]
 98%|█████████▊| 198/202 [02:08<00:02,  1.48it/s, kl=6.77, loss=0.0226, speed=10.5]
 99%|█████████▊| 199/202 [02:08<00:02,  1.49it/s, kl=6.77, loss=0.0226, speed=10.5]
 99%|█████████▉| 200/202 [02:09<00:01,  1.49it/s, kl=6.77, loss=0.0226, speed=10.5]
100%|█████████▉| 201/202 [02:10<00:00,  1.50it/s, kl=6.77, loss=0.0226, speed=10.5]
100%|██████████| 202/202 [02:10<00:00,  1.80it/s, kl=6.77, loss=0.0226, speed=10.5]
100%|██████████| 202/202 [02:10<00:00,  1.55it/s, kl=6.77, loss=0.0226, speed=10.5]

  0%|          | 0/202 [00:00<?, ?it/s]
  0%|          | 1/202 [00:00<02:12,  1.51it/s]
  1%|          | 2/202 [00:01<02:12,  1.51it/s]
  1%|▏         | 3/202 [00:02<02:12,  1.50it/s]
  2%|▏         | 4/202 [00:02<02:11,  1.50it/s]
  2%|▏         | 5/202 [00:03<02:10,  1.51it/s]
  3%|▎         | 6/202 [00:03<02:09,  1.51it/s]
  3%|▎         | 7/202 [00:04<02:09,  1.51it/s]
  4%|▍         | 8/202 [00:05<02:08,  1.51it/s]
  4%|▍         | 9/202 [00:05<02:07,  1.51it/s]
  5%|▍         | 10/202 [00:06<02:06,  1.52it/s]
  5%|▍         | 10/202 [00:07<02:06,  1.52it/s, kl=5.71, loss=0.0235, speed=10.9]
  5%|▌         | 11/202 [00:07<02:07,  1.49it/s, kl=5.71, loss=0.0235, speed=10.9]
  6%|▌         | 12/202 [00:07<02:06,  1.50it/s, kl=5.71, loss=0.0235, speed=10.9]
  6%|▋         | 13/202 [00:08<02:05,  1.51it/s, kl=5.71, loss=0.0235, speed=10.9]
  7%|▋         | 14/202 [00:09<02:04,  1.50it/s, kl=5.71, loss=0.0235, speed=10.9]
  7%|▋         | 15/202 [00:09<02:03,  1.51it/s, kl=5.71, loss=0.0235, speed=10.9]
  8%|▊         | 16/202 [00:10<02:03,  1.51it/s, kl=5.71, loss=0.0235, speed=10.9]
  8%|▊         | 17/202 [00:11<02:02,  1.51it/s, kl=5.71, loss=0.0235, speed=10.9]
  9%|▉         | 18/202 [00:11<02:01,  1.51it/s, kl=5.71, loss=0.0235, speed=10.9]
  9%|▉         | 19/202 [00:12<02:01,  1.51it/s, kl=5.71, loss=0.0235, speed=10.9]
 10%|▉         | 20/202 [00:13<02:01,  1.50it/s, kl=5.71, loss=0.0235, speed=10.9]
 10%|█         | 21/202 [00:13<02:00,  1.50it/s, kl=5.71, loss=0.0235, speed=10.9]
 11%|█         | 22/202 [00:14<02:00,  1.50it/s, kl=5.71, loss=0.0235, speed=10.9]
 11%|█▏        | 23/202 [00:15<01:59,  1.50it/s, kl=5.71, loss=0.0235, speed=10.9]
 12%|█▏        | 24/202 [00:15<01:58,  1.50it/s, kl=5.71, loss=0.0235, speed=10.9]
 12%|█▏        | 25/202 [00:16<01:57,  1.50it/s, kl=5.71, loss=0.0235, speed=10.9]
 13%|█▎        | 26/202 [00:17<01:56,  1.50it/s, kl=5.71, loss=0.0235, speed=10.9]
 13%|█▎        | 26/202 [00:17<01:56,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 13%|█▎        | 27/202 [00:17<01:58,  1.48it/s, kl=7.04, loss=0.0246, speed=10.5]
 14%|█▍        | 28/202 [00:18<01:56,  1.49it/s, kl=7.04, loss=0.0246, speed=10.5]
 14%|█▍        | 29/202 [00:19<01:56,  1.49it/s, kl=7.04, loss=0.0246, speed=10.5]
 15%|█▍        | 30/202 [00:19<01:55,  1.49it/s, kl=7.04, loss=0.0246, speed=10.5]
 15%|█▌        | 31/202 [00:20<01:54,  1.49it/s, kl=7.04, loss=0.0246, speed=10.5]
 16%|█▌        | 32/202 [00:21<01:53,  1.49it/s, kl=7.04, loss=0.0246, speed=10.5]
 16%|█▋        | 33/202 [00:21<01:53,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 17%|█▋        | 34/202 [00:22<01:52,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 17%|█▋        | 35/202 [00:23<01:51,  1.49it/s, kl=7.04, loss=0.0246, speed=10.5]
 18%|█▊        | 36/202 [00:23<01:50,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 18%|█▊        | 37/202 [00:24<01:50,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 19%|█▉        | 38/202 [00:25<01:49,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 19%|█▉        | 39/202 [00:25<01:48,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 20%|█▉        | 40/202 [00:26<01:47,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 20%|██        | 41/202 [00:27<01:47,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 21%|██        | 42/202 [00:27<01:46,  1.50it/s, kl=7.04, loss=0.0246, speed=10.5]
 21%|██        | 42/202 [00:28<01:46,  1.50it/s, kl=4.98, loss=0.0241, speed=10.5]
 21%|██▏       | 43/202 [00:28<01:47,  1.48it/s, kl=4.98, loss=0.0241, speed=10.5]
 22%|██▏       | 44/202 [00:29<01:46,  1.48it/s, kl=4.98, loss=0.0241, speed=10.5]
 22%|██▏       | 45/202 [00:30<01:45,  1.49it/s, kl=4.98, loss=0.0241, speed=10.5]
 23%|██▎       | 46/202 [00:30<01:45,  1.48it/s, kl=4.98, loss=0.0241, speed=10.5]
 23%|██▎       | 47/202 [00:31<01:44,  1.48it/s, kl=4.98, loss=0.0241, speed=10.5]
 24%|██▍       | 48/202 [00:32<01:43,  1.49it/s, kl=4.98, loss=0.0241, speed=10.5]
 24%|██▍       | 49/202 [00:32<01:42,  1.49it/s, kl=4.98, loss=0.0241, speed=10.5]
 25%|██▍       | 50/202 [00:33<01:41,  1.49it/s, kl=4.98, loss=0.0241, speed=10.5]
 25%|██▌       | 51/202 [00:34<01:40,  1.50it/s, kl=4.98, loss=0.0241, speed=10.5]
 26%|██▌       | 52/202 [00:34<01:39,  1.50it/s, kl=4.98, loss=0.0241, speed=10.5]
 26%|██▌       | 53/202 [00:35<01:39,  1.50it/s, kl=4.98, loss=0.0241, speed=10.5]
 27%|██▋       | 54/202 [00:36<01:38,  1.50it/s, kl=4.98, loss=0.0241, speed=10.5]
 27%|██▋       | 55/202 [00:36<01:37,  1.50it/s, kl=4.98, loss=0.0241, speed=10.5]
 28%|██▊       | 56/202 [00:37<01:37,  1.50it/s, kl=4.98, loss=0.0241, speed=10.5]
 28%|██▊       | 57/202 [00:38<01:36,  1.50it/s, kl=4.98, loss=0.0241, speed=10.5]
 29%|██▊       | 58/202 [00:38<01:35,  1.50it/s, kl=4.98, loss=0.0241, speed=10.5]
 29%|██▊       | 58/202 [00:39<01:35,  1.50it/s, kl=8.13, loss=0.0228, speed=10.4]
 29%|██▉       | 59/202 [00:39<01:37,  1.47it/s, kl=8.13, loss=0.0228, speed=10.4]
 30%|██▉       | 60/202 [00:40<01:38,  1.44it/s, kl=8.13, loss=0.0228, speed=10.4]
 30%|███       | 61/202 [00:40<01:35,  1.48it/s, kl=8.13, loss=0.0228, speed=10.4]
 31%|███       | 62/202 [00:41<01:33,  1.50it/s, kl=8.13, loss=0.0228, speed=10.4]
 31%|███       | 63/202 [00:42<01:31,  1.53it/s, kl=8.13, loss=0.0228, speed=10.4]
 32%|███▏      | 64/202 [00:42<01:28,  1.55it/s, kl=8.13, loss=0.0228, speed=10.4]
 32%|███▏      | 65/202 [00:43<01:28,  1.55it/s, kl=8.13, loss=0.0228, speed=10.4]
 33%|███▎      | 66/202 [00:43<01:28,  1.54it/s, kl=8.13, loss=0.0228, speed=10.4]
 33%|███▎      | 67/202 [00:44<01:26,  1.56it/s, kl=8.13, loss=0.0228, speed=10.4]
 34%|███▎      | 68/202 [00:45<01:25,  1.57it/s, kl=8.13, loss=0.0228, speed=10.4]
 34%|███▍      | 69/202 [00:45<01:24,  1.57it/s, kl=8.13, loss=0.0228, speed=10.4]
 35%|███▍      | 70/202 [00:46<01:24,  1.57it/s, kl=8.13, loss=0.0228, speed=10.4]
 35%|███▌      | 71/202 [00:47<01:23,  1.57it/s, kl=8.13, loss=0.0228, speed=10.4]
 36%|███▌      | 72/202 [00:47<01:22,  1.58it/s, kl=8.13, loss=0.0228, speed=10.4]
 36%|███▌      | 73/202 [00:48<01:22,  1.57it/s, kl=8.13, loss=0.0228, speed=10.4]
 37%|███▋      | 74/202 [00:49<01:21,  1.58it/s, kl=8.13, loss=0.0228, speed=10.4]
 37%|███▋      | 74/202 [00:49<01:21,  1.58it/s, kl=6.45, loss=0.0188, speed=10.9]
 37%|███▋      | 75/202 [00:49<01:21,  1.56it/s, kl=6.45, loss=0.0188, speed=10.9]
 38%|███▊      | 76/202 [00:50<01:19,  1.58it/s, kl=6.45, loss=0.0188, speed=10.9]
 38%|███▊      | 77/202 [00:50<01:19,  1.57it/s, kl=6.45, loss=0.0188, speed=10.9]
 39%|███▊      | 78/202 [00:51<01:18,  1.57it/s, kl=6.45, loss=0.0188, speed=10.9]
 39%|███▉      | 79/202 [00:52<01:17,  1.59it/s, kl=6.45, loss=0.0188, speed=10.9]
 40%|███▉      | 80/202 [00:52<01:16,  1.60it/s, kl=6.45, loss=0.0188, speed=10.9]
 40%|████      | 81/202 [00:53<01:15,  1.60it/s, kl=6.45, loss=0.0188, speed=10.9]
 41%|████      | 82/202 [00:54<01:14,  1.60it/s, kl=6.45, loss=0.0188, speed=10.9]
 41%|████      | 83/202 [00:54<01:13,  1.61it/s, kl=6.45, loss=0.0188, speed=10.9]
 42%|████▏     | 84/202 [00:55<01:13,  1.61it/s, kl=6.45, loss=0.0188, speed=10.9]
 42%|████▏     | 85/202 [00:55<01:12,  1.62it/s, kl=6.45, loss=0.0188, speed=10.9]
 43%|████▎     | 86/202 [00:56<01:11,  1.62it/s, kl=6.45, loss=0.0188, speed=10.9]
 43%|████▎     | 87/202 [00:57<01:10,  1.62it/s, kl=6.45, loss=0.0188, speed=10.9]
 44%|████▎     | 88/202 [00:57<01:10,  1.63it/s, kl=6.45, loss=0.0188, speed=10.9]
 44%|████▍     | 89/202 [00:58<01:09,  1.62it/s, kl=6.45, loss=0.0188, speed=10.9]
 45%|████▍     | 90/202 [00:58<01:08,  1.63it/s, kl=6.45, loss=0.0188, speed=10.9]
 45%|████▍     | 90/202 [00:59<01:08,  1.63it/s, kl=6.84, loss=0.0251, speed=11.3]
 45%|████▌     | 91/202 [00:59<01:09,  1.61it/s, kl=6.84, loss=0.0251, speed=11.3]
 46%|████▌     | 92/202 [01:00<01:08,  1.62it/s, kl=6.84, loss=0.0251, speed=11.3]
 46%|████▌     | 93/202 [01:00<01:07,  1.61it/s, kl=6.84, loss=0.0251, speed=11.3]
 47%|████▋     | 94/202 [01:01<01:06,  1.61it/s, kl=6.84, loss=0.0251, speed=11.3]
 47%|████▋     | 95/202 [01:02<01:06,  1.62it/s, kl=6.84, loss=0.0251, speed=11.3]
 48%|████▊     | 96/202 [01:02<01:05,  1.62it/s, kl=6.84, loss=0.0251, speed=11.3]
 48%|████▊     | 97/202 [01:03<01:04,  1.62it/s, kl=6.84, loss=0.0251, speed=11.3]
 49%|████▊     | 98/202 [01:03<01:05,  1.60it/s, kl=6.84, loss=0.0251, speed=11.3]
 49%|████▉     | 99/202 [01:04<01:06,  1.54it/s, kl=6.84, loss=0.0251, speed=11.3]
 50%|████▉     | 100/202 [01:05<01:06,  1.53it/s, kl=6.84, loss=0.0251, speed=11.3]
 50%|█████     | 101/202 [01:05<01:04,  1.56it/s, kl=6.84, loss=0.0251, speed=11.3]
 50%|█████     | 102/202 [01:06<01:03,  1.58it/s, kl=6.84, loss=0.0251, speed=11.3]
 51%|█████     | 103/202 [01:07<01:02,  1.58it/s, kl=6.84, loss=0.0251, speed=11.3]
 51%|█████▏    | 104/202 [01:07<01:01,  1.58it/s, kl=6.84, loss=0.0251, speed=11.3]
 52%|█████▏    | 105/202 [01:08<01:01,  1.57it/s, kl=6.84, loss=0.0251, speed=11.3]
 52%|█████▏    | 106/202 [01:09<01:01,  1.56it/s, kl=6.84, loss=0.0251, speed=11.3]
 52%|█████▏    | 106/202 [01:09<01:01,  1.56it/s, kl=5.94, loss=0.0205, speed=10.9]
 53%|█████▎    | 107/202 [01:09<01:03,  1.49it/s, kl=5.94, loss=0.0205, speed=10.9]
 53%|█████▎    | 108/202 [01:10<01:02,  1.49it/s, kl=5.94, loss=0.0205, speed=10.9]
 54%|█████▍    | 109/202 [01:11<01:02,  1.50it/s, kl=5.94, loss=0.0205, speed=10.9]
 54%|█████▍    | 110/202 [01:11<01:01,  1.49it/s, kl=5.94, loss=0.0205, speed=10.9]
 55%|█████▍    | 111/202 [01:12<01:00,  1.50it/s, kl=5.94, loss=0.0205, speed=10.9]
 55%|█████▌    | 112/202 [01:13<00:59,  1.50it/s, kl=5.94, loss=0.0205, speed=10.9]
 56%|█████▌    | 113/202 [01:13<00:59,  1.50it/s, kl=5.94, loss=0.0205, speed=10.9]
 56%|█████▋    | 114/202 [01:14<00:58,  1.50it/s, kl=5.94, loss=0.0205, speed=10.9]
 57%|█████▋    | 115/202 [01:15<00:57,  1.51it/s, kl=5.94, loss=0.0205, speed=10.9]
 57%|█████▋    | 116/202 [01:15<00:57,  1.51it/s, kl=5.94, loss=0.0205, speed=10.9]
 58%|█████▊    | 117/202 [01:16<00:56,  1.50it/s, kl=5.94, loss=0.0205, speed=10.9]
 58%|█████▊    | 118/202 [01:17<00:55,  1.51it/s, kl=5.94, loss=0.0205, speed=10.9]
 59%|█████▉    | 119/202 [01:17<00:55,  1.50it/s, kl=5.94, loss=0.0205, speed=10.9]
 59%|█████▉    | 120/202 [01:18<00:54,  1.50it/s, kl=5.94, loss=0.0205, speed=10.9]
 60%|█████▉    | 121/202 [01:19<00:54,  1.49it/s, kl=5.94, loss=0.0205, speed=10.9]
 60%|██████    | 122/202 [01:19<00:53,  1.50it/s, kl=5.94, loss=0.0205, speed=10.9]
 60%|██████    | 122/202 [01:20<00:53,  1.50it/s, kl=5.68, loss=0.0232, speed=10.5]
 61%|██████    | 123/202 [01:20<00:53,  1.48it/s, kl=5.68, loss=0.0232, speed=10.5]
 61%|██████▏   | 124/202 [01:21<00:52,  1.50it/s, kl=5.68, loss=0.0232, speed=10.5]
 62%|██████▏   | 125/202 [01:21<00:51,  1.50it/s, kl=5.68, loss=0.0232, speed=10.5]
 62%|██████▏   | 126/202 [01:22<00:50,  1.51it/s, kl=5.68, loss=0.0232, speed=10.5]
 63%|██████▎   | 127/202 [01:23<00:49,  1.51it/s, kl=5.68, loss=0.0232, speed=10.5]
 63%|██████▎   | 128/202 [01:23<00:48,  1.51it/s, kl=5.68, loss=0.0232, speed=10.5]
 64%|██████▍   | 129/202 [01:24<00:48,  1.51it/s, kl=5.68, loss=0.0232, speed=10.5]
 64%|██████▍   | 130/202 [01:25<00:47,  1.51it/s, kl=5.68, loss=0.0232, speed=10.5]
 65%|██████▍   | 131/202 [01:25<00:47,  1.50it/s, kl=5.68, loss=0.0232, speed=10.5]
 65%|██████▌   | 132/202 [01:26<00:46,  1.50it/s, kl=5.68, loss=0.0232, speed=10.5]
 66%|██████▌   | 133/202 [01:27<00:45,  1.50it/s, kl=5.68, loss=0.0232, speed=10.5]
 66%|██████▋   | 134/202 [01:27<00:45,  1.50it/s, kl=5.68, loss=0.0232, speed=10.5]
 67%|██████▋   | 135/202 [01:28<00:44,  1.51it/s, kl=5.68, loss=0.0232, speed=10.5]
 67%|██████▋   | 136/202 [01:29<00:43,  1.52it/s, kl=5.68, loss=0.0232, speed=10.5]
 68%|██████▊   | 137/202 [01:29<00:43,  1.51it/s, kl=5.68, loss=0.0232, speed=10.5]
 68%|██████▊   | 138/202 [01:30<00:42,  1.51it/s, kl=5.68, loss=0.0232, speed=10.5]
 68%|██████▊   | 138/202 [01:31<00:42,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 69%|██████▉   | 139/202 [01:31<00:42,  1.49it/s, kl=5.54, loss=0.0279, speed=10.6]
 69%|██████▉   | 140/202 [01:31<00:41,  1.50it/s, kl=5.54, loss=0.0279, speed=10.6]
 70%|██████▉   | 141/202 [01:32<00:40,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 70%|███████   | 142/202 [01:33<00:39,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 71%|███████   | 143/202 [01:33<00:39,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 71%|███████▏  | 144/202 [01:34<00:38,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 72%|███████▏  | 145/202 [01:35<00:37,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 72%|███████▏  | 146/202 [01:35<00:37,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 73%|███████▎  | 147/202 [01:36<00:36,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 73%|███████▎  | 148/202 [01:37<00:35,  1.50it/s, kl=5.54, loss=0.0279, speed=10.6]
 74%|███████▍  | 149/202 [01:37<00:35,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 74%|███████▍  | 150/202 [01:38<00:34,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 75%|███████▍  | 151/202 [01:39<00:33,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 75%|███████▌  | 152/202 [01:39<00:33,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 76%|███████▌  | 153/202 [01:40<00:32,  1.52it/s, kl=5.54, loss=0.0279, speed=10.6]
 76%|███████▌  | 154/202 [01:41<00:31,  1.51it/s, kl=5.54, loss=0.0279, speed=10.6]
 76%|███████▌  | 154/202 [01:41<00:31,  1.51it/s, kl=5.18, loss=0.0166, speed=10.6]
 77%|███████▋  | 155/202 [01:41<00:31,  1.49it/s, kl=5.18, loss=0.0166, speed=10.6]
 77%|███████▋  | 156/202 [01:42<00:30,  1.50it/s, kl=5.18, loss=0.0166, speed=10.6]
 78%|███████▊  | 157/202 [01:43<00:30,  1.50it/s, kl=5.18, loss=0.0166, speed=10.6]
 78%|███████▊  | 158/202 [01:43<00:29,  1.50it/s, kl=5.18, loss=0.0166, speed=10.6]
 79%|███████▊  | 159/202 [01:44<00:28,  1.50it/s, kl=5.18, loss=0.0166, speed=10.6]
 79%|███████▉  | 160/202 [01:45<00:27,  1.51it/s, kl=5.18, loss=0.0166, speed=10.6]
 80%|███████▉  | 161/202 [01:45<00:27,  1.50it/s, kl=5.18, loss=0.0166, speed=10.6]
 80%|████████  | 162/202 [01:46<00:26,  1.50it/s, kl=5.18, loss=0.0166, speed=10.6]
 81%|████████  | 163/202 [01:47<00:25,  1.51it/s, kl=5.18, loss=0.0166, speed=10.6]
 81%|████████  | 164/202 [01:47<00:25,  1.50it/s, kl=5.18, loss=0.0166, speed=10.6]
 82%|████████▏ | 165/202 [01:48<00:24,  1.51it/s, kl=5.18, loss=0.0166, speed=10.6]
 82%|████████▏ | 166/202 [01:49<00:23,  1.51it/s, kl=5.18, loss=0.0166, speed=10.6]
 83%|████████▎ | 167/202 [01:49<00:23,  1.51it/s, kl=5.18, loss=0.0166, speed=10.6]
 83%|████████▎ | 168/202 [01:50<00:22,  1.51it/s, kl=5.18, loss=0.0166, speed=10.6]
 84%|████████▎ | 169/202 [01:51<00:21,  1.51it/s, kl=5.18, loss=0.0166, speed=10.6]
 84%|████████▍ | 170/202 [01:51<00:21,  1.51it/s, kl=5.18, loss=0.0166, speed=10.6]
 84%|████████▍ | 170/202 [01:52<00:21,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 85%|████████▍ | 171/202 [01:52<00:20,  1.49it/s, kl=6.15, loss=0.0232, speed=10.5]
 85%|████████▌ | 172/202 [01:53<00:19,  1.50it/s, kl=6.15, loss=0.0232, speed=10.5]
 86%|████████▌ | 173/202 [01:53<00:19,  1.50it/s, kl=6.15, loss=0.0232, speed=10.5]
 86%|████████▌ | 174/202 [01:54<00:18,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 87%|████████▋ | 175/202 [01:55<00:17,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 87%|████████▋ | 176/202 [01:55<00:17,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 88%|████████▊ | 177/202 [01:56<00:16,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 88%|████████▊ | 178/202 [01:57<00:15,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 89%|████████▊ | 179/202 [01:57<00:15,  1.52it/s, kl=6.15, loss=0.0232, speed=10.5]
 89%|████████▉ | 180/202 [01:58<00:14,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 90%|████████▉ | 181/202 [01:58<00:13,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 90%|█████████ | 182/202 [01:59<00:13,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 91%|█████████ | 183/202 [02:00<00:12,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 91%|█████████ | 184/202 [02:00<00:11,  1.51it/s, kl=6.15, loss=0.0232, speed=10.5]
 92%|█████████▏| 185/202 [02:01<00:11,  1.50it/s, kl=6.15, loss=0.0232, speed=10.5]
 92%|█████████▏| 186/202 [02:02<00:10,  1.50it/s, kl=6.15, loss=0.0232, speed=10.5]
 92%|█████████▏| 186/202 [02:03<00:10,  1.50it/s, kl=8.2, loss=0.049, speed=10.5]  
 93%|█████████▎| 187/202 [02:03<00:10,  1.48it/s, kl=8.2, loss=0.049, speed=10.5]
 93%|█████████▎| 188/202 [02:03<00:09,  1.49it/s, kl=8.2, loss=0.049, speed=10.5]
 94%|█████████▎| 189/202 [02:04<00:08,  1.50it/s, kl=8.2, loss=0.049, speed=10.5]
 94%|█████████▍| 190/202 [02:05<00:08,  1.50it/s, kl=8.2, loss=0.049, speed=10.5]
 95%|█████████▍| 191/202 [02:05<00:07,  1.50it/s, kl=8.2, loss=0.049, speed=10.5]
 95%|█████████▌| 192/202 [02:06<00:06,  1.50it/s, kl=8.2, loss=0.049, speed=10.5]
 96%|█████████▌| 193/202 [02:07<00:06,  1.50it/s, kl=8.2, loss=0.049, speed=10.5]
 96%|█████████▌| 194/202 [02:07<00:05,  1.50it/s, kl=8.2, loss=0.049, speed=10.5]
 97%|█████████▋| 195/202 [02:08<00:04,  1.50it/s, kl=8.2, loss=0.049, speed=10.5]
 97%|█████████▋| 196/202 [02:09<00:03,  1.50it/s, kl=8.2, loss=0.049, speed=10.5]
 98%|█████████▊| 197/202 [02:09<00:03,  1.51it/s, kl=8.2, loss=0.049, speed=10.5]
 98%|█████████▊| 198/202 [02:10<00:02,  1.51it/s, kl=8.2, loss=0.049, speed=10.5]
 99%|█████████▊| 199/202 [02:10<00:01,  1.51it/s, kl=8.2, loss=0.049, speed=10.5]
 99%|█████████▉| 200/202 [02:11<00:01,  1.51it/s, kl=8.2, loss=0.049, speed=10.5]
100%|█████████▉| 201/202 [02:12<00:00,  1.51it/s, kl=8.2, loss=0.049, speed=10.5]
100%|██████████| 202/202 [02:12<00:00,  1.81it/s, kl=8.2, loss=0.049, speed=10.5]
100%|██████████| 202/202 [02:12<00:00,  1.52it/s, kl=8.2, loss=0.049, speed=10.5]

  0%|          | 0/202 [00:00<?, ?it/s]
  0%|          | 0/202 [00:00<?, ?it/s, kl=6.86, loss=0.02, speed=10.9]
  0%|          | 1/202 [00:00<02:17,  1.46it/s, kl=6.86, loss=0.02, speed=10.9]
  1%|          | 2/202 [00:01<02:15,  1.48it/s, kl=6.86, loss=0.02, speed=10.9]
  1%|▏         | 3/202 [00:02<02:14,  1.48it/s, kl=6.86, loss=0.02, speed=10.9]
  2%|▏         | 4/202 [00:02<02:12,  1.49it/s, kl=6.86, loss=0.02, speed=10.9]
  2%|▏         | 5/202 [00:03<02:11,  1.50it/s, kl=6.86, loss=0.02, speed=10.9]
  3%|▎         | 6/202 [00:03<02:10,  1.50it/s, kl=6.86, loss=0.02, speed=10.9]
  3%|▎         | 7/202 [00:04<02:09,  1.51it/s, kl=6.86, loss=0.02, speed=10.9]
  4%|▍         | 8/202 [00:05<02:08,  1.51it/s, kl=6.86, loss=0.02, speed=10.9]
  4%|▍         | 9/202 [00:05<02:07,  1.51it/s, kl=6.86, loss=0.02, speed=10.9]
  5%|▍         | 10/202 [00:06<02:07,  1.51it/s, kl=6.86, loss=0.02, speed=10.9]
  5%|▌         | 11/202 [00:07<02:06,  1.51it/s, kl=6.86, loss=0.02, speed=10.9]
  6%|▌         | 12/202 [00:07<02:05,  1.51it/s, kl=6.86, loss=0.02, speed=10.9]
  6%|▋         | 13/202 [00:08<02:05,  1.51it/s, kl=6.86, loss=0.02, speed=10.9]
  7%|▋         | 14/202 [00:09<02:04,  1.51it/s, kl=6.86, loss=0.02, speed=10.9]
  7%|▋         | 15/202 [00:09<02:04,  1.50it/s, kl=6.86, loss=0.02, speed=10.9]
  8%|▊         | 16/202 [00:10<02:03,  1.51it/s, kl=6.86, loss=0.02, speed=10.9]
  8%|▊         | 16/202 [00:11<02:03,  1.51it/s, kl=10.2, loss=0.0236, speed=10.5]
  8%|▊         | 17/202 [00:11<02:04,  1.49it/s, kl=10.2, loss=0.0236, speed=10.5]
  9%|▉         | 18/202 [00:11<02:03,  1.49it/s, kl=10.2, loss=0.0236, speed=10.5]
  9%|▉         | 19/202 [00:12<02:01,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 10%|▉         | 20/202 [00:13<02:01,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 10%|█         | 21/202 [00:13<02:00,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 11%|█         | 22/202 [00:14<01:59,  1.51it/s, kl=10.2, loss=0.0236, speed=10.5]
 11%|█▏        | 23/202 [00:15<01:59,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 12%|█▏        | 24/202 [00:15<01:58,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 12%|█▏        | 25/202 [00:16<01:58,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 13%|█▎        | 26/202 [00:17<01:57,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 13%|█▎        | 27/202 [00:17<01:55,  1.51it/s, kl=10.2, loss=0.0236, speed=10.5]
 14%|█▍        | 28/202 [00:18<01:55,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 14%|█▍        | 29/202 [00:19<01:54,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 15%|█▍        | 30/202 [00:19<01:54,  1.50it/s, kl=10.2, loss=0.0236, speed=10.5]
 15%|█▌        | 31/202 [00:20<01:53,  1.51it/s, kl=10.2, loss=0.0236, speed=10.5]
 16%|█▌        | 32/202 [00:21<01:52,  1.51it/s, kl=10.2, loss=0.0236, speed=10.5]
 16%|█▌        | 32/202 [00:21<01:52,  1.51it/s, kl=7.63, loss=0.0281, speed=10.5]
 16%|█▋        | 33/202 [00:21<01:53,  1.49it/s, kl=7.63, loss=0.0281, speed=10.5]
 17%|█▋        | 34/202 [00:22<01:53,  1.49it/s, kl=7.63, loss=0.0281, speed=10.5]
 17%|█▋        | 35/202 [00:23<01:52,  1.49it/s, kl=7.63, loss=0.0281, speed=10.5]
 18%|█▊        | 36/202 [00:23<01:51,  1.49it/s, kl=7.63, loss=0.0281, speed=10.5]
 18%|█▊        | 37/202 [00:24<01:50,  1.49it/s, kl=7.63, loss=0.0281, speed=10.5]
 19%|█▉        | 38/202 [00:25<01:49,  1.50it/s, kl=7.63, loss=0.0281, speed=10.5]
 19%|█▉        | 39/202 [00:25<01:48,  1.50it/s, kl=7.63, loss=0.0281, speed=10.5]
 20%|█▉        | 40/202 [00:26<01:48,  1.50it/s, kl=7.63, loss=0.0281, speed=10.5]
 20%|██        | 41/202 [00:27<01:47,  1.50it/s, kl=7.63, loss=0.0281, speed=10.5]
 21%|██        | 42/202 [00:27<01:46,  1.50it/s, kl=7.63, loss=0.0281, speed=10.5]
 21%|██▏       | 43/202 [00:28<01:45,  1.50it/s, kl=7.63, loss=0.0281, speed=10.5]
 22%|██▏       | 44/202 [00:29<01:45,  1.50it/s, kl=7.63, loss=0.0281, speed=10.5]
 22%|██▏       | 45/202 [00:29<01:44,  1.51it/s, kl=7.63, loss=0.0281, speed=10.5]
 23%|██▎       | 46/202 [00:30<01:43,  1.51it/s, kl=7.63, loss=0.0281, speed=10.5]
 23%|██▎       | 47/202 [00:31<01:43,  1.50it/s, kl=7.63, loss=0.0281, speed=10.5]
 24%|██▍       | 48/202 [00:31<01:42,  1.50it/s, kl=7.63, loss=0.0281, speed=10.5]
 24%|██▍       | 48/202 [00:32<01:42,  1.50it/s, kl=6.09, loss=0.0195, speed=10.5]
 24%|██▍       | 49/202 [00:32<01:43,  1.48it/s, kl=6.09, loss=0.0195, speed=10.5]
 25%|██▍       | 50/202 [00:33<01:41,  1.49it/s, kl=6.09, loss=0.0195, speed=10.5]
 25%|██▌       | 51/202 [00:33<01:40,  1.50it/s, kl=6.09, loss=0.0195, speed=10.5]
 26%|██▌       | 52/202 [00:34<01:39,  1.50it/s, kl=6.09, loss=0.0195, speed=10.5]
 26%|██▌       | 53/202 [00:35<01:39,  1.50it/s, kl=6.09, loss=0.0195, speed=10.5]
 27%|██▋       | 54/202 [00:35<01:38,  1.50it/s, kl=6.09, loss=0.0195, speed=10.5]
 27%|██▋       | 55/202 [00:36<01:38,  1.50it/s, kl=6.09, loss=0.0195, speed=10.5]
 28%|██▊       | 56/202 [00:37<01:37,  1.50it/s, kl=6.09, loss=0.0195, speed=10.5]
 28%|██▊       | 57/202 [00:37<01:36,  1.50it/s, kl=6.09, loss=0.0195, speed=10.5]
 29%|██▊       | 58/202 [00:38<01:35,  1.51it/s, kl=6.09, loss=0.0195, speed=10.5]
 29%|██▉       | 59/202 [00:39<01:34,  1.51it/s, kl=6.09, loss=0.0195, speed=10.5]
 30%|██▉       | 60/202 [00:39<01:33,  1.51it/s, kl=6.09, loss=0.0195, speed=10.5]
 30%|███       | 61/202 [00:40<01:33,  1.51it/s, kl=6.09, loss=0.0195, speed=10.5]
 31%|███       | 62/202 [00:41<01:32,  1.51it/s, kl=6.09, loss=0.0195, speed=10.5]
 31%|███       | 63/202 [00:41<01:31,  1.51it/s, kl=6.09, loss=0.0195, speed=10.5]
 32%|███▏      | 64/202 [00:42<01:31,  1.51it/s, kl=6.09, loss=0.0195, speed=10.5]
 32%|███▏      | 64/202 [00:43<01:31,  1.51it/s, kl=7.14, loss=0.0197, speed=10.5]
 32%|███▏      | 65/202 [00:43<01:31,  1.49it/s, kl=7.14, loss=0.0197, speed=10.5]
 33%|███▎      | 66/202 [00:43<01:30,  1.50it/s, kl=7.14, loss=0.0197, speed=10.5]
 33%|███▎      | 67/202 [00:44<01:30,  1.50it/s, kl=7.14, loss=0.0197, speed=10.5]
 34%|███▎      | 68/202 [00:45<01:29,  1.50it/s, kl=7.14, loss=0.0197, speed=10.5]
 34%|███▍      | 69/202 [00:45<01:28,  1.51it/s, kl=7.14, loss=0.0197, speed=10.5]
 35%|███▍      | 70/202 [00:46<01:27,  1.51it/s, kl=7.14, loss=0.0197, speed=10.5]
 35%|███▌      | 71/202 [00:47<01:27,  1.50it/s, kl=7.14, loss=0.0197, speed=10.5]
 36%|███▌      | 72/202 [00:47<01:26,  1.50it/s, kl=7.14, loss=0.0197, speed=10.5]
 36%|███▌      | 73/202 [00:48<01:26,  1.50it/s, kl=7.14, loss=0.0197, speed=10.5]
 37%|███▋      | 74/202 [00:49<01:25,  1.50it/s, kl=7.14, loss=0.0197, speed=10.5]
 37%|███▋      | 75/202 [00:49<01:24,  1.51it/s, kl=7.14, loss=0.0197, speed=10.5]
 38%|███▊      | 76/202 [00:50<01:23,  1.51it/s, kl=7.14, loss=0.0197, speed=10.5]
 38%|███▊      | 77/202 [00:51<01:22,  1.51it/s, kl=7.14, loss=0.0197, speed=10.5]
 39%|███▊      | 78/202 [00:51<01:22,  1.51it/s, kl=7.14, loss=0.0197, speed=10.5]
 39%|███▉      | 79/202 [00:52<01:21,  1.51it/s, kl=7.14, loss=0.0197, speed=10.5]
 40%|███▉      | 80/202 [00:53<01:20,  1.51it/s, kl=7.14, loss=0.0197, speed=10.5]
 40%|███▉      | 80/202 [00:53<01:20,  1.51it/s, kl=6.11, loss=0.0314, speed=10.5]
 40%|████      | 81/202 [00:53<01:21,  1.49it/s, kl=6.11, loss=0.0314, speed=10.5]
 41%|████      | 82/202 [00:54<01:20,  1.49it/s, kl=6.11, loss=0.0314, speed=10.5]
 41%|████      | 83/202 [00:55<01:19,  1.50it/s, kl=6.11, loss=0.0314, speed=10.5]
 42%|████▏     | 84/202 [00:55<01:18,  1.50it/s, kl=6.11, loss=0.0314, speed=10.5]
 42%|████▏     | 85/202 [00:56<01:17,  1.50it/s, kl=6.11, loss=0.0314, speed=10.5]
 43%|████▎     | 86/202 [00:57<01:17,  1.50it/s, kl=6.11, loss=0.0314, speed=10.5]
 43%|████▎     | 87/202 [00:57<01:16,  1.50it/s, kl=6.11, loss=0.0314, speed=10.5]
 44%|████▎     | 88/202 [00:58<01:15,  1.51it/s, kl=6.11, loss=0.0314, speed=10.5]
 44%|████▍     | 89/202 [00:59<01:15,  1.51it/s, kl=6.11, loss=0.0314, speed=10.5]
 45%|████▍     | 90/202 [00:59<01:14,  1.51it/s, kl=6.11, loss=0.0314, speed=10.5]
 45%|████▌     | 91/202 [01:00<01:13,  1.50it/s, kl=6.11, loss=0.0314, speed=10.5]
 46%|████▌     | 92/202 [01:01<01:13,  1.50it/s, kl=6.11, loss=0.0314, speed=10.5]
 46%|████▌     | 93/202 [01:01<01:12,  1.50it/s, kl=6.11, loss=0.0314, speed=10.5]
 47%|████▋     | 94/202 [01:02<01:11,  1.50it/s, kl=6.11, loss=0.0314, speed=10.5]
 47%|████▋     | 95/202 [01:03<01:10,  1.51it/s, kl=6.11, loss=0.0314, speed=10.5]
 48%|████▊     | 96/202 [01:03<01:10,  1.51it/s, kl=6.11, loss=0.0314, speed=10.5]
 48%|████▊     | 96/202 [01:04<01:10,  1.51it/s, kl=6.83, loss=0.0177, speed=10.5]
 48%|████▊     | 97/202 [01:04<01:10,  1.49it/s, kl=6.83, loss=0.0177, speed=10.5]
 49%|████▊     | 98/202 [01:05<01:09,  1.49it/s, kl=6.83, loss=0.0177, speed=10.5]
 49%|████▉     | 99/202 [01:05<01:08,  1.50it/s, kl=6.83, loss=0.0177, speed=10.5]
 50%|████▉     | 100/202 [01:06<01:07,  1.50it/s, kl=6.83, loss=0.0177, speed=10.5]
 50%|█████     | 101/202 [01:07<01:07,  1.50it/s, kl=6.83, loss=0.0177, speed=10.5]
 50%|█████     | 102/202 [01:07<01:06,  1.50it/s, kl=6.83, loss=0.0177, speed=10.5]
 51%|█████     | 103/202 [01:08<01:06,  1.50it/s, kl=6.83, loss=0.0177, speed=10.5]
 51%|█████▏    | 104/202 [01:09<01:05,  1.50it/s, kl=6.83, loss=0.0177, speed=10.5]
 52%|█████▏    | 105/202 [01:09<01:04,  1.50it/s, kl=6.83, loss=0.0177, speed=10.5]
 52%|█████▏    | 106/202 [01:10<01:03,  1.51it/s, kl=6.83, loss=0.0177, speed=10.5]
 53%|█████▎    | 107/202 [01:11<01:02,  1.51it/s, kl=6.83, loss=0.0177, speed=10.5]
 53%|█████▎    | 108/202 [01:11<01:02,  1.51it/s, kl=6.83, loss=0.0177, speed=10.5]
 54%|█████▍    | 109/202 [01:12<01:01,  1.50it/s, kl=6.83, loss=0.0177, speed=10.5]
 54%|█████▍    | 110/202 [01:13<01:01,  1.51it/s, kl=6.83, loss=0.0177, speed=10.5]
 55%|█████▍    | 111/202 [01:13<01:00,  1.50it/s, kl=6.83, loss=0.0177, speed=10.5]
 55%|█████▌    | 112/202 [01:14<00:59,  1.51it/s, kl=6.83, loss=0.0177, speed=10.5]
 55%|█████▌    | 112/202 [01:15<00:59,  1.51it/s, kl=7.91, loss=0.0253, speed=10.5]
 56%|█████▌    | 113/202 [01:15<00:59,  1.49it/s, kl=7.91, loss=0.0253, speed=10.5]
 56%|█████▋    | 114/202 [01:15<00:58,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 57%|█████▋    | 115/202 [01:16<00:58,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 57%|█████▋    | 116/202 [01:17<00:57,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 58%|█████▊    | 117/202 [01:17<00:56,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 58%|█████▊    | 118/202 [01:18<00:55,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 59%|█████▉    | 119/202 [01:19<00:55,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 59%|█████▉    | 120/202 [01:19<00:54,  1.51it/s, kl=7.91, loss=0.0253, speed=10.5]
 60%|█████▉    | 121/202 [01:20<00:53,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 60%|██████    | 122/202 [01:21<00:53,  1.51it/s, kl=7.91, loss=0.0253, speed=10.5]
 61%|██████    | 123/202 [01:21<00:52,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 61%|██████▏   | 124/202 [01:22<00:51,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 62%|██████▏   | 125/202 [01:23<00:51,  1.50it/s, kl=7.91, loss=0.0253, speed=10.5]
 62%|██████▏   | 126/202 [01:23<00:50,  1.51it/s, kl=7.91, loss=0.0253, speed=10.5]
 63%|██████▎   | 127/202 [01:24<00:49,  1.52it/s, kl=7.91, loss=0.0253, speed=10.5]
 63%|██████▎   | 128/202 [01:25<00:48,  1.51it/s, kl=7.91, loss=0.0253, speed=10.5]
 63%|██████▎   | 128/202 [01:25<00:48,  1.51it/s, kl=5.46, loss=0.0173, speed=10.5]
 64%|██████▍   | 129/202 [01:25<00:48,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 64%|██████▍   | 130/202 [01:26<00:48,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 65%|██████▍   | 131/202 [01:27<00:47,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 65%|██████▌   | 132/202 [01:27<00:46,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 66%|██████▌   | 133/202 [01:28<00:46,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 66%|██████▋   | 134/202 [01:29<00:45,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 67%|██████▋   | 135/202 [01:29<00:44,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 67%|██████▋   | 136/202 [01:30<00:44,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 68%|██████▊   | 137/202 [01:31<00:43,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 68%|██████▊   | 138/202 [01:31<00:42,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 69%|██████▉   | 139/202 [01:32<00:41,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 69%|██████▉   | 140/202 [01:33<00:41,  1.49it/s, kl=5.46, loss=0.0173, speed=10.5]
 70%|██████▉   | 141/202 [01:33<00:40,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 70%|███████   | 142/202 [01:34<00:39,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 71%|███████   | 143/202 [01:35<00:39,  1.50it/s, kl=5.46, loss=0.0173, speed=10.5]
 71%|███████▏  | 144/202 [01:35<00:38,  1.51it/s, kl=5.46, loss=0.0173, speed=10.5]
 71%|███████▏  | 144/202 [01:36<00:38,  1.51it/s, kl=8.37, loss=0.0317, speed=10.5]
 72%|███████▏  | 145/202 [01:36<00:38,  1.48it/s, kl=8.37, loss=0.0317, speed=10.5]
 72%|███████▏  | 146/202 [01:37<00:37,  1.49it/s, kl=8.37, loss=0.0317, speed=10.5]
 73%|███████▎  | 147/202 [01:37<00:36,  1.49it/s, kl=8.37, loss=0.0317, speed=10.5]
 73%|███████▎  | 148/202 [01:38<00:36,  1.49it/s, kl=8.37, loss=0.0317, speed=10.5]
 74%|███████▍  | 149/202 [01:39<00:35,  1.50it/s, kl=8.37, loss=0.0317, speed=10.5]
 74%|███████▍  | 150/202 [01:39<00:34,  1.51it/s, kl=8.37, loss=0.0317, speed=10.5]
 75%|███████▍  | 151/202 [01:40<00:33,  1.51it/s, kl=8.37, loss=0.0317, speed=10.5]
 75%|███████▌  | 152/202 [01:41<00:33,  1.51it/s, kl=8.37, loss=0.0317, speed=10.5]
 76%|███████▌  | 153/202 [01:41<00:32,  1.51it/s, kl=8.37, loss=0.0317, speed=10.5]
 76%|███████▌  | 154/202 [01:42<00:31,  1.51it/s, kl=8.37, loss=0.0317, speed=10.5]
 77%|███████▋  | 155/202 [01:43<00:31,  1.51it/s, kl=8.37, loss=0.0317, speed=10.5]
 77%|███████▋  | 156/202 [01:43<00:30,  1.52it/s, kl=8.37, loss=0.0317, speed=10.5]
 78%|███████▊  | 157/202 [01:44<00:29,  1.51it/s, kl=8.37, loss=0.0317, speed=10.5]
 78%|███████▊  | 158/202 [01:45<00:29,  1.51it/s, kl=8.37, loss=0.0317, speed=10.5]
 79%|███████▊  | 159/202 [01:45<00:28,  1.52it/s, kl=8.37, loss=0.0317, speed=10.5]
 79%|███████▉  | 160/202 [01:46<00:27,  1.52it/s, kl=8.37, loss=0.0317, speed=10.5]
 79%|███████▉  | 160/202 [01:47<00:27,  1.52it/s, kl=4.5, loss=0.0195, speed=10.6] 
 80%|███████▉  | 161/202 [01:47<00:27,  1.50it/s, kl=4.5, loss=0.0195, speed=10.6]
 80%|████████  | 162/202 [01:47<00:26,  1.50it/s, kl=4.5, loss=0.0195, speed=10.6]
 81%|████████  | 163/202 [01:48<00:25,  1.50it/s, kl=4.5, loss=0.0195, speed=10.6]
 81%|████████  | 164/202 [01:49<00:25,  1.50it/s, kl=4.5, loss=0.0195, speed=10.6]
 82%|████████▏ | 165/202 [01:49<00:24,  1.49it/s, kl=4.5, loss=0.0195, speed=10.6]
 82%|████████▏ | 166/202 [01:50<00:24,  1.50it/s, kl=4.5, loss=0.0195, speed=10.6]
 83%|████████▎ | 167/202 [01:51<00:23,  1.50it/s, kl=4.5, loss=0.0195, speed=10.6]
 83%|████████▎ | 168/202 [01:51<00:22,  1.50it/s, kl=4.5, loss=0.0195, speed=10.6]
 84%|████████▎ | 169/202 [01:52<00:21,  1.50it/s, kl=4.5, loss=0.0195, speed=10.6]
 84%|████████▍ | 170/202 [01:53<00:21,  1.51it/s, kl=4.5, loss=0.0195, speed=10.6]
 85%|████████▍ | 171/202 [01:53<00:20,  1.51it/s, kl=4.5, loss=0.0195, speed=10.6]
 85%|████████▌ | 172/202 [01:54<00:19,  1.51it/s, kl=4.5, loss=0.0195, speed=10.6]
 86%|████████▌ | 173/202 [01:55<00:19,  1.51it/s, kl=4.5, loss=0.0195, speed=10.6]
 86%|████████▌ | 174/202 [01:55<00:18,  1.51it/s, kl=4.5, loss=0.0195, speed=10.6]
 87%|████████▋ | 175/202 [01:56<00:17,  1.50it/s, kl=4.5, loss=0.0195, speed=10.6]
 87%|████████▋ | 176/202 [01:57<00:17,  1.51it/s, kl=4.5, loss=0.0195, speed=10.6]
 87%|████████▋ | 176/202 [01:57<00:17,  1.51it/s, kl=4.54, loss=0.0212, speed=10.5]
 88%|████████▊ | 177/202 [01:57<00:16,  1.48it/s, kl=4.54, loss=0.0212, speed=10.5]
 88%|████████▊ | 178/202 [01:58<00:16,  1.49it/s, kl=4.54, loss=0.0212, speed=10.5]
 89%|████████▊ | 179/202 [01:59<00:15,  1.49it/s, kl=4.54, loss=0.0212, speed=10.5]
 89%|████████▉ | 180/202 [01:59<00:14,  1.49it/s, kl=4.54, loss=0.0212, speed=10.5]
 90%|████████▉ | 181/202 [02:00<00:13,  1.50it/s, kl=4.54, loss=0.0212, speed=10.5]
 90%|█████████ | 182/202 [02:01<00:13,  1.50it/s, kl=4.54, loss=0.0212, speed=10.5]
 91%|█████████ | 183/202 [02:01<00:12,  1.50it/s, kl=4.54, loss=0.0212, speed=10.5]
 91%|█████████ | 184/202 [02:02<00:11,  1.51it/s, kl=4.54, loss=0.0212, speed=10.5]
 92%|█████████▏| 185/202 [02:03<00:11,  1.51it/s, kl=4.54, loss=0.0212, speed=10.5]
 92%|█████████▏| 186/202 [02:03<00:10,  1.51it/s, kl=4.54, loss=0.0212, speed=10.5]
 93%|█████████▎| 187/202 [02:04<00:09,  1.51it/s, kl=4.54, loss=0.0212, speed=10.5]
 93%|█████████▎| 188/202 [02:05<00:09,  1.52it/s, kl=4.54, loss=0.0212, speed=10.5]
 94%|█████████▎| 189/202 [02:05<00:08,  1.51it/s, kl=4.54, loss=0.0212, speed=10.5]
 94%|█████████▍| 190/202 [02:06<00:07,  1.51it/s, kl=4.54, loss=0.0212, speed=10.5]
 95%|█████████▍| 191/202 [02:07<00:07,  1.51it/s, kl=4.54, loss=0.0212, speed=10.5]
 95%|█████████▌| 192/202 [02:07<00:06,  1.52it/s, kl=4.54, loss=0.0212, speed=10.5]
 95%|█████████▌| 192/202 [02:08<00:06,  1.52it/s, kl=5.73, loss=0.0195, speed=10.5]
 96%|█████████▌| 193/202 [02:08<00:06,  1.49it/s, kl=5.73, loss=0.0195, speed=10.5]
 96%|█████████▌| 194/202 [02:09<00:05,  1.50it/s, kl=5.73, loss=0.0195, speed=10.5]
 97%|█████████▋| 195/202 [02:09<00:04,  1.50it/s, kl=5.73, loss=0.0195, speed=10.5]
 97%|█████████▋| 196/202 [02:10<00:04,  1.50it/s, kl=5.73, loss=0.0195, speed=10.5]
 98%|█████████▊| 197/202 [02:11<00:03,  1.50it/s, kl=5.73, loss=0.0195, speed=10.5]
 98%|█████████▊| 198/202 [02:11<00:02,  1.50it/s, kl=5.73, loss=0.0195, speed=10.5]
 99%|█████████▊| 199/202 [02:12<00:01,  1.51it/s, kl=5.73, loss=0.0195, speed=10.5]
 99%|█████████▉| 200/202 [02:13<00:01,  1.50it/s, kl=5.73, loss=0.0195, speed=10.5]
100%|█████████▉| 201/202 [02:13<00:00,  1.51it/s, kl=5.73, loss=0.0195, speed=10.5]
100%|██████████| 202/202 [02:14<00:00,  1.81it/s, kl=5.73, loss=0.0195, speed=10.5]
100%|██████████| 202/202 [02:14<00:00,  1.51it/s, kl=5.73, loss=0.0195, speed=10.5]

  0%|          | 0/202 [00:00<?, ?it/s]
  0%|          | 1/202 [00:00<02:13,  1.50it/s]
  1%|          | 2/202 [00:01<02:12,  1.50it/s]
  1%|▏         | 3/202 [00:01<02:12,  1.50it/s]
  2%|▏         | 4/202 [00:02<02:11,  1.51it/s]
  2%|▏         | 5/202 [00:03<02:10,  1.51it/s]
  3%|▎         | 6/202 [00:03<02:10,  1.50it/s]
  3%|▎         | 6/202 [00:04<02:10,  1.50it/s, kl=9.27, loss=0.0287, speed=10.9]
  3%|▎         | 7/202 [00:04<02:12,  1.47it/s, kl=9.27, loss=0.0287, speed=10.9]
  4%|▍         | 8/202 [00:05<02:10,  1.49it/s, kl=9.27, loss=0.0287, speed=10.9]
  4%|▍         | 9/202 [00:06<02:09,  1.49it/s, kl=9.27, loss=0.0287, speed=10.9]
  5%|▍         | 10/202 [00:06<02:07,  1.50it/s, kl=9.27, loss=0.0287, speed=10.9]
  5%|▌         | 11/202 [00:07<02:07,  1.50it/s, kl=9.27, loss=0.0287, speed=10.9]
  6%|▌         | 12/202 [00:08<02:06,  1.51it/s, kl=9.27, loss=0.0287, speed=10.9]
  6%|▋         | 13/202 [00:08<02:04,  1.51it/s, kl=9.27, loss=0.0287, speed=10.9]
  7%|▋         | 14/202 [00:09<02:04,  1.51it/s, kl=9.27, loss=0.0287, speed=10.9]
  7%|▋         | 15/202 [00:09<02:04,  1.51it/s, kl=9.27, loss=0.0287, speed=10.9]
  8%|▊         | 16/202 [00:10<02:03,  1.51it/s, kl=9.27, loss=0.0287, speed=10.9]
  8%|▊         | 17/202 [00:11<02:02,  1.50it/s, kl=9.27, loss=0.0287, speed=10.9]
  9%|▉         | 18/202 [00:11<02:02,  1.50it/s, kl=9.27, loss=0.0287, speed=10.9]
  9%|▉         | 19/202 [00:12<02:01,  1.50it/s, kl=9.27, loss=0.0287, speed=10.9]
 10%|▉         | 20/202 [00:13<02:00,  1.51it/s, kl=9.27, loss=0.0287, speed=10.9]
 10%|█         | 21/202 [00:13<02:00,  1.51it/s, kl=9.27, loss=0.0287, speed=10.9]
 11%|█         | 22/202 [00:14<01:59,  1.50it/s, kl=9.27, loss=0.0287, speed=10.9]
 11%|█         | 22/202 [00:15<01:59,  1.50it/s, kl=7.74, loss=0.0257, speed=10.5]
 11%|█▏        | 23/202 [00:15<02:00,  1.49it/s, kl=7.74, loss=0.0257, speed=10.5]
 12%|█▏        | 24/202 [00:16<01:59,  1.49it/s, kl=7.74, loss=0.0257, speed=10.5]
 12%|█▏        | 25/202 [00:16<01:58,  1.50it/s, kl=7.74, loss=0.0257, speed=10.5]
 13%|█▎        | 26/202 [00:17<01:57,  1.50it/s, kl=7.74, loss=0.0257, speed=10.5]
 13%|█▎        | 27/202 [00:17<01:56,  1.50it/s, kl=7.74, loss=0.0257, speed=10.5]
 14%|█▍        | 28/202 [00:18<01:55,  1.50it/s, kl=7.74, loss=0.0257, speed=10.5]
 14%|█▍        | 29/202 [00:19<01:55,  1.50it/s, kl=7.74, loss=0.0257, speed=10.5]
 15%|█▍        | 30/202 [00:19<01:54,  1.50it/s, kl=7.74, loss=0.0257, speed=10.5]
 15%|█▌        | 31/202 [00:20<01:53,  1.50it/s, kl=7.74, loss=0.0257, speed=10.5]
 16%|█▌        | 32/202 [00:21<01:52,  1.51it/s, kl=7.74, loss=0.0257, speed=10.5]
 16%|█▋        | 33/202 [00:21<01:51,  1.51it/s, kl=7.74, loss=0.0257, speed=10.5]
 17%|█▋        | 34/202 [00:22<01:51,  1.51it/s, kl=7.74, loss=0.0257, speed=10.5]
 17%|█▋        | 35/202 [00:23<01:50,  1.51it/s, kl=7.74, loss=0.0257, speed=10.5]
 18%|█▊        | 36/202 [00:23<01:49,  1.51it/s, kl=7.74, loss=0.0257, speed=10.5]
 18%|█▊        | 37/202 [00:24<01:49,  1.51it/s, kl=7.74, loss=0.0257, speed=10.5]
 19%|█▉        | 38/202 [00:25<01:48,  1.51it/s, kl=7.74, loss=0.0257, speed=10.5]
 19%|█▉        | 38/202 [00:25<01:48,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 19%|█▉        | 39/202 [00:25<01:49,  1.49it/s, kl=9.77, loss=0.0228, speed=10.5]
 20%|█▉        | 40/202 [00:26<01:48,  1.50it/s, kl=9.77, loss=0.0228, speed=10.5]
 20%|██        | 41/202 [00:27<01:47,  1.50it/s, kl=9.77, loss=0.0228, speed=10.5]
 21%|██        | 42/202 [00:27<01:46,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 21%|██▏       | 43/202 [00:28<01:45,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 22%|██▏       | 44/202 [00:29<01:44,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 22%|██▏       | 45/202 [00:29<01:44,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 23%|██▎       | 46/202 [00:30<01:43,  1.50it/s, kl=9.77, loss=0.0228, speed=10.5]
 23%|██▎       | 47/202 [00:31<01:43,  1.50it/s, kl=9.77, loss=0.0228, speed=10.5]
 24%|██▍       | 48/202 [00:31<01:41,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 24%|██▍       | 49/202 [00:32<01:41,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 25%|██▍       | 50/202 [00:33<01:40,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 25%|██▌       | 51/202 [00:33<01:40,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 26%|██▌       | 52/202 [00:34<01:39,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 26%|██▌       | 53/202 [00:35<01:38,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 27%|██▋       | 54/202 [00:35<01:37,  1.51it/s, kl=9.77, loss=0.0228, speed=10.5]
 27%|██▋       | 54/202 [00:36<01:37,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 27%|██▋       | 55/202 [00:36<01:38,  1.49it/s, kl=9.08, loss=0.0291, speed=10.5]
 28%|██▊       | 56/202 [00:37<01:37,  1.49it/s, kl=9.08, loss=0.0291, speed=10.5]
 28%|██▊       | 57/202 [00:37<01:36,  1.50it/s, kl=9.08, loss=0.0291, speed=10.5]
 29%|██▊       | 58/202 [00:38<01:35,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 29%|██▉       | 59/202 [00:39<01:34,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 30%|██▉       | 60/202 [00:39<01:34,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 30%|███       | 61/202 [00:40<01:33,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 31%|███       | 62/202 [00:41<01:32,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 31%|███       | 63/202 [00:41<01:32,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 32%|███▏      | 64/202 [00:42<01:31,  1.50it/s, kl=9.08, loss=0.0291, speed=10.5]
 32%|███▏      | 65/202 [00:43<01:30,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 33%|███▎      | 66/202 [00:43<01:29,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 33%|███▎      | 67/202 [00:44<01:29,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 34%|███▎      | 68/202 [00:45<01:28,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 34%|███▍      | 69/202 [00:45<01:28,  1.51it/s, kl=9.08, loss=0.0291, speed=10.5]
 35%|███▍      | 70/202 [00:46<01:27,  1.50it/s, kl=9.08, loss=0.0291, speed=10.5]
 35%|███▍      | 70/202 [00:47<01:27,  1.50it/s, kl=5.87, loss=0.0183, speed=10.5]
 35%|███▌      | 71/202 [00:47<01:28,  1.49it/s, kl=5.87, loss=0.0183, speed=10.5]
 36%|███▌      | 72/202 [00:47<01:26,  1.50it/s, kl=5.87, loss=0.0183, speed=10.5]
 36%|███▌      | 73/202 [00:48<01:25,  1.50it/s, kl=5.87, loss=0.0183, speed=10.5]
 37%|███▋      | 74/202 [00:49<01:24,  1.51it/s, kl=5.87, loss=0.0183, speed=10.5]
 37%|███▋      | 75/202 [00:49<01:24,  1.51it/s, kl=5.87, loss=0.0183, speed=10.5]
 38%|███▊      | 76/202 [00:50<01:23,  1.51it/s, kl=5.87, loss=0.0183, speed=10.5]
 38%|███▊      | 77/202 [00:51<01:23,  1.50it/s, kl=5.87, loss=0.0183, speed=10.5]
 39%|███▊      | 78/202 [00:51<01:22,  1.50it/s, kl=5.87, loss=0.0183, speed=10.5]
 39%|███▉      | 79/202 [00:52<01:21,  1.51it/s, kl=5.87, loss=0.0183, speed=10.5]
 40%|███▉      | 80/202 [00:53<01:21,  1.50it/s, kl=5.87, loss=0.0183, speed=10.5]
 40%|████      | 81/202 [00:53<01:20,  1.50it/s, kl=5.87, loss=0.0183, speed=10.5]
 41%|████      | 82/202 [00:54<01:19,  1.51it/s, kl=5.87, loss=0.0183, speed=10.5]
 41%|████      | 83/202 [00:55<01:18,  1.51it/s, kl=5.87, loss=0.0183, speed=10.5]
 42%|████▏     | 84/202 [00:55<01:18,  1.50it/s, kl=5.87, loss=0.0183, speed=10.5]
 42%|████▏     | 85/202 [00:56<01:17,  1.51it/s, kl=5.87, loss=0.0183, speed=10.5]
 43%|████▎     | 86/202 [00:57<01:16,  1.51it/s, kl=5.87, loss=0.0183, speed=10.5]
 43%|████▎     | 86/202 [00:57<01:16,  1.51it/s, kl=8.72, loss=0.0228, speed=10.5]
 43%|████▎     | 87/202 [00:57<01:16,  1.49it/s, kl=8.72, loss=0.0228, speed=10.5]
 44%|████▎     | 88/202 [00:58<01:15,  1.50it/s, kl=8.72, loss=0.0228, speed=10.5]
 44%|████▍     | 89/202 [00:59<01:15,  1.50it/s, kl=8.72, loss=0.0228, speed=10.5]
 45%|████▍     | 90/202 [00:59<01:14,  1.50it/s, kl=8.72, loss=0.0228, speed=10.5]
 45%|████▌     | 91/202 [01:00<01:13,  1.50it/s, kl=8.72, loss=0.0228, speed=10.5]
 46%|████▌     | 92/202 [01:01<01:13,  1.51it/s, kl=8.72, loss=0.0228, speed=10.5]
 46%|████▌     | 93/202 [01:01<01:12,  1.51it/s, kl=8.72, loss=0.0228, speed=10.5]
 47%|████▋     | 94/202 [01:02<01:11,  1.51it/s, kl=8.72, loss=0.0228, speed=10.5]
 47%|████▋     | 95/202 [01:03<01:10,  1.51it/s, kl=8.72, loss=0.0228, speed=10.5]
 48%|████▊     | 96/202 [01:03<01:10,  1.50it/s, kl=8.72, loss=0.0228, speed=10.5]
 48%|████▊     | 97/202 [01:04<01:09,  1.50it/s, kl=8.72, loss=0.0228, speed=10.5]
 49%|████▊     | 98/202 [01:05<01:09,  1.50it/s, kl=8.72, loss=0.0228, speed=10.5]
 49%|████▉     | 99/202 [01:05<01:08,  1.50it/s, kl=8.72, loss=0.0228, speed=10.5]
 50%|████▉     | 100/202 [01:06<01:07,  1.51it/s, kl=8.72, loss=0.0228, speed=10.5]
 50%|█████     | 101/202 [01:07<01:06,  1.51it/s, kl=8.72, loss=0.0228, speed=10.5]
 50%|█████     | 102/202 [01:07<01:05,  1.52it/s, kl=8.72, loss=0.0228, speed=10.5]
 50%|█████     | 102/202 [01:08<01:05,  1.52it/s, kl=7.71, loss=0.0274, speed=10.5]
 51%|█████     | 103/202 [01:08<01:06,  1.49it/s, kl=7.71, loss=0.0274, speed=10.5]
 51%|█████▏    | 104/202 [01:09<01:05,  1.50it/s, kl=7.71, loss=0.0274, speed=10.5]
 52%|█████▏    | 105/202 [01:09<01:04,  1.50it/s, kl=7.71, loss=0.0274, speed=10.5]
 52%|█████▏    | 106/202 [01:10<01:03,  1.51it/s, kl=7.71, loss=0.0274, speed=10.5]
 53%|█████▎    | 107/202 [01:11<01:03,  1.51it/s, kl=7.71, loss=0.0274, speed=10.5]
 53%|█████▎    | 108/202 [01:11<01:02,  1.51it/s, kl=7.71, loss=0.0274, speed=10.5]
 54%|█████▍    | 109/202 [01:12<01:01,  1.51it/s, kl=7.71, loss=0.0274, speed=10.5]
 54%|█████▍    | 110/202 [01:13<01:00,  1.51it/s, kl=7.71, loss=0.0274, speed=10.5]
 55%|█████▍    | 111/202 [01:13<01:00,  1.52it/s, kl=7.71, loss=0.0274, speed=10.5]
 55%|█████▌    | 112/202 [01:14<00:59,  1.51it/s, kl=7.71, loss=0.0274, speed=10.5]
 56%|█████▌    | 113/202 [01:15<00:58,  1.52it/s, kl=7.71, loss=0.0274, speed=10.5]
 56%|█████▋    | 114/202 [01:15<00:57,  1.52it/s, kl=7.71, loss=0.0274, speed=10.5]
 57%|█████▋    | 115/202 [01:16<00:57,  1.52it/s, kl=7.71, loss=0.0274, speed=10.5]
 57%|█████▋    | 116/202 [01:17<00:56,  1.52it/s, kl=7.71, loss=0.0274, speed=10.5]
 58%|█████▊    | 117/202 [01:17<00:56,  1.52it/s, kl=7.71, loss=0.0274, speed=10.5]
 58%|█████▊    | 118/202 [01:18<00:55,  1.51it/s, kl=7.71, loss=0.0274, speed=10.5]
 58%|█████▊    | 118/202 [01:19<00:55,  1.51it/s, kl=5.95, loss=0.0132, speed=10.6]
 59%|█████▉    | 119/202 [01:19<00:55,  1.50it/s, kl=5.95, loss=0.0132, speed=10.6]
 59%|█████▉    | 120/202 [01:19<00:54,  1.51it/s, kl=5.95, loss=0.0132, speed=10.6]
 60%|█████▉    | 121/202 [01:20<00:53,  1.51it/s, kl=5.95, loss=0.0132, speed=10.6]
 60%|██████    | 122/202 [01:21<00:52,  1.51it/s, kl=5.95, loss=0.0132, speed=10.6]
 61%|██████    | 123/202 [01:21<00:52,  1.51it/s, kl=5.95, loss=0.0132, speed=10.6]
 61%|██████▏   | 124/202 [01:22<00:51,  1.50it/s, kl=5.95, loss=0.0132, speed=10.6]
 62%|██████▏   | 125/202 [01:23<00:51,  1.50it/s, kl=5.95, loss=0.0132, speed=10.6]
 62%|██████▏   | 126/202 [01:23<00:51,  1.49it/s, kl=5.95, loss=0.0132, speed=10.6]
 63%|██████▎   | 127/202 [01:24<00:50,  1.48it/s, kl=5.95, loss=0.0132, speed=10.6]
 63%|██████▎   | 128/202 [01:25<00:49,  1.49it/s, kl=5.95, loss=0.0132, speed=10.6]
 64%|██████▍   | 129/202 [01:25<00:48,  1.49it/s, kl=5.95, loss=0.0132, speed=10.6]
 64%|██████▍   | 130/202 [01:26<00:48,  1.49it/s, kl=5.95, loss=0.0132, speed=10.6]
 65%|██████▍   | 131/202 [01:27<00:48,  1.47it/s, kl=5.95, loss=0.0132, speed=10.6]
 65%|██████▌   | 132/202 [01:27<00:47,  1.48it/s, kl=5.95, loss=0.0132, speed=10.6]
 66%|██████▌   | 133/202 [01:28<00:46,  1.48it/s, kl=5.95, loss=0.0132, speed=10.6]
 66%|██████▋   | 134/202 [01:29<00:45,  1.48it/s, kl=5.95, loss=0.0132, speed=10.6]
 66%|██████▋   | 134/202 [01:29<00:45,  1.48it/s, kl=9.57, loss=0.0224, speed=10.4]
 67%|██████▋   | 135/202 [01:29<00:45,  1.47it/s, kl=9.57, loss=0.0224, speed=10.4]
 67%|██████▋   | 136/202 [01:30<00:44,  1.47it/s, kl=9.57, loss=0.0224, speed=10.4]
 68%|██████▊   | 137/202 [01:31<00:43,  1.49it/s, kl=9.57, loss=0.0224, speed=10.4]
 68%|██████▊   | 138/202 [01:31<00:42,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 69%|██████▉   | 139/202 [01:32<00:42,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 69%|██████▉   | 140/202 [01:33<00:41,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 70%|██████▉   | 141/202 [01:33<00:40,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 70%|███████   | 142/202 [01:34<00:39,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 71%|███████   | 143/202 [01:35<00:39,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 71%|███████▏  | 144/202 [01:35<00:38,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 72%|███████▏  | 145/202 [01:36<00:38,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 72%|███████▏  | 146/202 [01:37<00:37,  1.49it/s, kl=9.57, loss=0.0224, speed=10.4]
 73%|███████▎  | 147/202 [01:37<00:36,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 73%|███████▎  | 148/202 [01:38<00:35,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 74%|███████▍  | 149/202 [01:39<00:35,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 74%|███████▍  | 150/202 [01:39<00:34,  1.50it/s, kl=9.57, loss=0.0224, speed=10.4]
 74%|███████▍  | 150/202 [01:40<00:34,  1.50it/s, kl=7.46, loss=0.0224, speed=10.5]
 75%|███████▍  | 151/202 [01:40<00:34,  1.48it/s, kl=7.46, loss=0.0224, speed=10.5]
 75%|███████▌  | 152/202 [01:41<00:33,  1.48it/s, kl=7.46, loss=0.0224, speed=10.5]
 76%|███████▌  | 153/202 [01:41<00:32,  1.49it/s, kl=7.46, loss=0.0224, speed=10.5]
 76%|███████▌  | 154/202 [01:42<00:32,  1.50it/s, kl=7.46, loss=0.0224, speed=10.5]
 77%|███████▋  | 155/202 [01:43<00:31,  1.50it/s, kl=7.46, loss=0.0224, speed=10.5]
 77%|███████▋  | 156/202 [01:43<00:30,  1.51it/s, kl=7.46, loss=0.0224, speed=10.5]
 78%|███████▊  | 157/202 [01:44<00:29,  1.51it/s, kl=7.46, loss=0.0224, speed=10.5]
 78%|███████▊  | 158/202 [01:45<00:29,  1.51it/s, kl=7.46, loss=0.0224, speed=10.5]
 79%|███████▊  | 159/202 [01:45<00:28,  1.51it/s, kl=7.46, loss=0.0224, speed=10.5]
 79%|███████▉  | 160/202 [01:46<00:27,  1.50it/s, kl=7.46, loss=0.0224, speed=10.5]
 80%|███████▉  | 161/202 [01:47<00:27,  1.50it/s, kl=7.46, loss=0.0224, speed=10.5]
 80%|████████  | 162/202 [01:47<00:26,  1.51it/s, kl=7.46, loss=0.0224, speed=10.5]
 81%|████████  | 163/202 [01:48<00:25,  1.51it/s, kl=7.46, loss=0.0224, speed=10.5]
 81%|████████  | 164/202 [01:49<00:25,  1.51it/s, kl=7.46, loss=0.0224, speed=10.5]
 82%|████████▏ | 165/202 [01:49<00:24,  1.51it/s, kl=7.46, loss=0.0224, speed=10.5]
 82%|████████▏ | 166/202 [01:50<00:23,  1.50it/s, kl=7.46, loss=0.0224, speed=10.5]
 82%|████████▏ | 166/202 [01:51<00:23,  1.50it/s, kl=4.92, loss=0.0161, speed=10.5]
 83%|████████▎ | 167/202 [01:51<00:23,  1.49it/s, kl=4.92, loss=0.0161, speed=10.5]
 83%|████████▎ | 168/202 [01:51<00:22,  1.49it/s, kl=4.92, loss=0.0161, speed=10.5]
 84%|████████▎ | 169/202 [01:52<00:22,  1.50it/s, kl=4.92, loss=0.0161, speed=10.5]
 84%|████████▍ | 170/202 [01:53<00:21,  1.50it/s, kl=4.92, loss=0.0161, speed=10.5]
 85%|████████▍ | 171/202 [01:53<00:20,  1.51it/s, kl=4.92, loss=0.0161, speed=10.5]
 85%|████████▌ | 172/202 [01:54<00:19,  1.51it/s, kl=4.92, loss=0.0161, speed=10.5]
 86%|████████▌ | 173/202 [01:55<00:19,  1.51it/s, kl=4.92, loss=0.0161, speed=10.5]
 86%|████████▌ | 174/202 [01:55<00:18,  1.51it/s, kl=4.92, loss=0.0161, speed=10.5]
 87%|████████▋ | 175/202 [01:56<00:17,  1.51it/s, kl=4.92, loss=0.0161, speed=10.5]
 87%|████████▋ | 176/202 [01:57<00:17,  1.51it/s, kl=4.92, loss=0.0161, speed=10.5]
 88%|████████▊ | 177/202 [01:57<00:16,  1.51it/s, kl=4.92, loss=0.0161, speed=10.5]
 88%|████████▊ | 178/202 [01:58<00:15,  1.50it/s, kl=4.92, loss=0.0161, speed=10.5]
 89%|████████▊ | 179/202 [01:59<00:15,  1.51it/s, kl=4.92, loss=0.0161, speed=10.5]
 89%|████████▉ | 180/202 [01:59<00:14,  1.50it/s, kl=4.92, loss=0.0161, speed=10.5]
 90%|████████▉ | 181/202 [02:00<00:13,  1.50it/s, kl=4.92, loss=0.0161, speed=10.5]
 90%|█████████ | 182/202 [02:01<00:13,  1.51it/s, kl=4.92, loss=0.0161, speed=10.5]
 90%|█████████ | 182/202 [02:01<00:13,  1.51it/s, kl=8.87, loss=0.0177, speed=10.5]
 91%|█████████ | 183/202 [02:01<00:12,  1.49it/s, kl=8.87, loss=0.0177, speed=10.5]
 91%|█████████ | 184/202 [02:02<00:12,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 92%|█████████▏| 185/202 [02:03<00:11,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 92%|█████████▏| 186/202 [02:03<00:10,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 93%|█████████▎| 187/202 [02:04<00:09,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 93%|█████████▎| 188/202 [02:05<00:09,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 94%|█████████▎| 189/202 [02:05<00:08,  1.51it/s, kl=8.87, loss=0.0177, speed=10.5]
 94%|█████████▍| 190/202 [02:06<00:07,  1.51it/s, kl=8.87, loss=0.0177, speed=10.5]
 95%|█████████▍| 191/202 [02:07<00:07,  1.51it/s, kl=8.87, loss=0.0177, speed=10.5]
 95%|█████████▌| 192/202 [02:07<00:06,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 96%|█████████▌| 193/202 [02:08<00:05,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 96%|█████████▌| 194/202 [02:09<00:05,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 97%|█████████▋| 195/202 [02:09<00:04,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 97%|█████████▋| 196/202 [02:10<00:03,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 98%|█████████▊| 197/202 [02:11<00:03,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 98%|█████████▊| 198/202 [02:11<00:02,  1.50it/s, kl=8.87, loss=0.0177, speed=10.5]
 98%|█████████▊| 198/202 [02:12<00:02,  1.50it/s, kl=9.91, loss=0.023, speed=10.5] 
 99%|█████████▊| 199/202 [02:12<00:02,  1.48it/s, kl=9.91, loss=0.023, speed=10.5]
 99%|█████████▉| 200/202 [02:13<00:01,  1.49it/s, kl=9.91, loss=0.023, speed=10.5]
100%|█████████▉| 201/202 [02:13<00:00,  1.50it/s, kl=9.91, loss=0.023, speed=10.5]
100%|██████████| 202/202 [02:14<00:00,  1.79it/s, kl=9.91, loss=0.023, speed=10.5]
100%|██████████| 202/202 [02:14<00:00,  1.51it/s, kl=9.91, loss=0.023, speed=10.5]

  0%|          | 0/202 [00:00<?, ?it/s]
  0%|          | 1/202 [00:00<02:11,  1.53it/s]
  1%|          | 2/202 [00:01<02:11,  1.52it/s]
  1%|▏         | 3/202 [00:01<02:11,  1.52it/s]
  2%|▏         | 4/202 [00:02<02:11,  1.51it/s]
  2%|▏         | 5/202 [00:03<02:10,  1.51it/s]
  3%|▎         | 6/202 [00:03<02:09,  1.51it/s]
  3%|▎         | 7/202 [00:04<02:08,  1.51it/s]
  4%|▍         | 8/202 [00:05<02:08,  1.51it/s]
  4%|▍         | 9/202 [00:05<02:07,  1.51it/s]
  5%|▍         | 10/202 [00:06<02:06,  1.52it/s]
  5%|▌         | 11/202 [00:07<02:05,  1.52it/s]
  6%|▌         | 12/202 [00:07<02:05,  1.51it/s]
  6%|▌         | 12/202 [00:08<02:05,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
  6%|▋         | 13/202 [00:08<02:06,  1.49it/s, kl=7.28, loss=0.0239, speed=10.9]
  7%|▋         | 14/202 [00:09<02:05,  1.49it/s, kl=7.28, loss=0.0239, speed=10.9]
  7%|▋         | 15/202 [00:09<02:04,  1.50it/s, kl=7.28, loss=0.0239, speed=10.9]
  8%|▊         | 16/202 [00:10<02:04,  1.50it/s, kl=7.28, loss=0.0239, speed=10.9]
  8%|▊         | 17/202 [00:11<02:02,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
  9%|▉         | 18/202 [00:11<02:01,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
  9%|▉         | 19/202 [00:12<02:01,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
 10%|▉         | 20/202 [00:13<02:00,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
 10%|█         | 21/202 [00:13<01:59,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
 11%|█         | 22/202 [00:14<01:59,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
 11%|█▏        | 23/202 [00:15<01:58,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
 12%|█▏        | 24/202 [00:15<01:57,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
 12%|█▏        | 25/202 [00:16<01:56,  1.52it/s, kl=7.28, loss=0.0239, speed=10.9]
 13%|█▎        | 26/202 [00:17<01:56,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
 13%|█▎        | 27/202 [00:17<01:55,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
 14%|█▍        | 28/202 [00:18<01:55,  1.51it/s, kl=7.28, loss=0.0239, speed=10.9]
 14%|█▍        | 28/202 [00:19<01:55,  1.51it/s, kl=9.5, loss=0.033, speed=10.6]  
 14%|█▍        | 29/202 [00:19<01:56,  1.49it/s, kl=9.5, loss=0.033, speed=10.6]
 15%|█▍        | 30/202 [00:19<01:55,  1.49it/s, kl=9.5, loss=0.033, speed=10.6]
 15%|█▌        | 31/202 [00:20<01:54,  1.50it/s, kl=9.5, loss=0.033, speed=10.6]
 16%|█▌        | 32/202 [00:21<01:53,  1.50it/s, kl=9.5, loss=0.033, speed=10.6]
 16%|█▋        | 33/202 [00:21<01:52,  1.50it/s, kl=9.5, loss=0.033, speed=10.6]
 17%|█▋        | 34/202 [00:22<01:51,  1.50it/s, kl=9.5, loss=0.033, speed=10.6]
 17%|█▋        | 35/202 [00:23<01:50,  1.50it/s, kl=9.5, loss=0.033, speed=10.6]
 18%|█▊        | 36/202 [00:23<01:49,  1.51it/s, kl=9.5, loss=0.033, speed=10.6]
 18%|█▊        | 37/202 [00:24<01:49,  1.51it/s, kl=9.5, loss=0.033, speed=10.6]
 19%|█▉        | 38/202 [00:25<01:48,  1.51it/s, kl=9.5, loss=0.033, speed=10.6]
 19%|█▉        | 39/202 [00:25<01:48,  1.50it/s, kl=9.5, loss=0.033, speed=10.6]
 20%|█▉        | 40/202 [00:26<01:47,  1.51it/s, kl=9.5, loss=0.033, speed=10.6]
 20%|██        | 41/202 [00:27<01:46,  1.51it/s, kl=9.5, loss=0.033, speed=10.6]
 21%|██        | 42/202 [00:27<01:46,  1.51it/s, kl=9.5, loss=0.033, speed=10.6]
 21%|██▏       | 43/202 [00:28<01:45,  1.51it/s, kl=9.5, loss=0.033, speed=10.6]
 22%|██▏       | 44/202 [00:29<01:44,  1.51it/s, kl=9.5, loss=0.033, speed=10.6]
 22%|██▏       | 44/202 [00:29<01:44,  1.51it/s, kl=6.98, loss=0.017, speed=10.5]
 22%|██▏       | 45/202 [00:29<01:45,  1.49it/s, kl=6.98, loss=0.017, speed=10.5]
 23%|██▎       | 46/202 [00:30<01:44,  1.49it/s, kl=6.98, loss=0.017, speed=10.5]
 23%|██▎       | 47/202 [00:31<01:43,  1.50it/s, kl=6.98, loss=0.017, speed=10.5]
 24%|██▍       | 48/202 [00:31<01:43,  1.49it/s, kl=6.98, loss=0.017, speed=10.5]
 24%|██▍       | 49/202 [00:32<01:42,  1.50it/s, kl=6.98, loss=0.017, speed=10.5]
 25%|██▍       | 50/202 [00:33<01:41,  1.50it/s, kl=6.98, loss=0.017, speed=10.5]
 25%|██▌       | 51/202 [00:33<01:40,  1.50it/s, kl=6.98, loss=0.017, speed=10.5]
 26%|██▌       | 52/202 [00:34<01:39,  1.51it/s, kl=6.98, loss=0.017, speed=10.5]
 26%|██▌       | 53/202 [00:35<01:39,  1.50it/s, kl=6.98, loss=0.017, speed=10.5]
 27%|██▋       | 54/202 [00:35<01:37,  1.51it/s, kl=6.98, loss=0.017, speed=10.5]
 27%|██▋       | 55/202 [00:36<01:37,  1.50it/s, kl=6.98, loss=0.017, speed=10.5]
 28%|██▊       | 56/202 [00:37<01:37,  1.50it/s, kl=6.98, loss=0.017, speed=10.5]
 28%|██▊       | 57/202 [00:37<01:36,  1.51it/s, kl=6.98, loss=0.017, speed=10.5]
 29%|██▊       | 58/202 [00:38<01:35,  1.51it/s, kl=6.98, loss=0.017, speed=10.5]
 29%|██▉       | 59/202 [00:39<01:34,  1.51it/s, kl=6.98, loss=0.017, speed=10.5]
 30%|██▉       | 60/202 [00:39<01:33,  1.51it/s, kl=6.98, loss=0.017, speed=10.5]
 30%|██▉       | 60/202 [00:40<01:33,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 30%|███       | 61/202 [00:40<01:34,  1.50it/s, kl=4.64, loss=0.0201, speed=10.5]
 31%|███       | 62/202 [00:41<01:33,  1.50it/s, kl=4.64, loss=0.0201, speed=10.5]
 31%|███       | 63/202 [00:41<01:32,  1.50it/s, kl=4.64, loss=0.0201, speed=10.5]
 32%|███▏      | 64/202 [00:42<01:31,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 32%|███▏      | 65/202 [00:43<01:31,  1.50it/s, kl=4.64, loss=0.0201, speed=10.5]
 33%|███▎      | 66/202 [00:43<01:30,  1.50it/s, kl=4.64, loss=0.0201, speed=10.5]
 33%|███▎      | 67/202 [00:44<01:29,  1.50it/s, kl=4.64, loss=0.0201, speed=10.5]
 34%|███▎      | 68/202 [00:45<01:28,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 34%|███▍      | 69/202 [00:45<01:28,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 35%|███▍      | 70/202 [00:46<01:27,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 35%|███▌      | 71/202 [00:47<01:27,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 36%|███▌      | 72/202 [00:47<01:26,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 36%|███▌      | 73/202 [00:48<01:25,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 37%|███▋      | 74/202 [00:49<01:24,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 37%|███▋      | 75/202 [00:49<01:23,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 38%|███▊      | 76/202 [00:50<01:23,  1.51it/s, kl=4.64, loss=0.0201, speed=10.5]
 38%|███▊      | 76/202 [00:51<01:23,  1.51it/s, kl=6.08, loss=0.0209, speed=10.5]
 38%|███▊      | 77/202 [00:51<01:24,  1.48it/s, kl=6.08, loss=0.0209, speed=10.5]
 39%|███▊      | 78/202 [00:51<01:23,  1.49it/s, kl=6.08, loss=0.0209, speed=10.5]
 39%|███▉      | 79/202 [00:52<01:22,  1.49it/s, kl=6.08, loss=0.0209, speed=10.5]
 40%|███▉      | 80/202 [00:53<01:21,  1.50it/s, kl=6.08, loss=0.0209, speed=10.5]
 40%|████      | 81/202 [00:53<01:20,  1.50it/s, kl=6.08, loss=0.0209, speed=10.5]
 41%|████      | 82/202 [00:54<01:19,  1.50it/s, kl=6.08, loss=0.0209, speed=10.5]
 41%|████      | 83/202 [00:55<01:18,  1.51it/s, kl=6.08, loss=0.0209, speed=10.5]
 42%|████▏     | 84/202 [00:55<01:18,  1.51it/s, kl=6.08, loss=0.0209, speed=10.5]
 42%|████▏     | 85/202 [00:56<01:17,  1.51it/s, kl=6.08, loss=0.0209, speed=10.5]
 43%|████▎     | 86/202 [00:57<01:17,  1.51it/s, kl=6.08, loss=0.0209, speed=10.5]
 43%|████▎     | 87/202 [00:57<01:16,  1.51it/s, kl=6.08, loss=0.0209, speed=10.5]
 44%|████▎     | 88/202 [00:58<01:16,  1.50it/s, kl=6.08, loss=0.0209, speed=10.5]
 44%|████▍     | 89/202 [00:59<01:16,  1.48it/s, kl=6.08, loss=0.0209, speed=10.5]
 45%|████▍     | 90/202 [00:59<01:14,  1.49it/s, kl=6.08, loss=0.0209, speed=10.5]
 45%|████▌     | 91/202 [01:00<01:14,  1.49it/s, kl=6.08, loss=0.0209, speed=10.5]
 46%|████▌     | 92/202 [01:01<01:13,  1.49it/s, kl=6.08, loss=0.0209, speed=10.5]
 46%|████▌     | 92/202 [01:01<01:13,  1.49it/s, kl=5.18, loss=0.0179, speed=10.5]
 46%|████▌     | 93/202 [01:01<01:13,  1.47it/s, kl=5.18, loss=0.0179, speed=10.5]
 47%|████▋     | 94/202 [01:02<01:12,  1.49it/s, kl=5.18, loss=0.0179, speed=10.5]
 47%|████▋     | 95/202 [01:03<01:11,  1.49it/s, kl=5.18, loss=0.0179, speed=10.5]
 48%|████▊     | 96/202 [01:03<01:10,  1.50it/s, kl=5.18, loss=0.0179, speed=10.5]
 48%|████▊     | 97/202 [01:04<01:10,  1.49it/s, kl=5.18, loss=0.0179, speed=10.5]
 49%|████▊     | 98/202 [01:05<01:09,  1.50it/s, kl=5.18, loss=0.0179, speed=10.5]
 49%|████▉     | 99/202 [01:05<01:08,  1.50it/s, kl=5.18, loss=0.0179, speed=10.5]
 50%|████▉     | 100/202 [01:06<01:08,  1.50it/s, kl=5.18, loss=0.0179, speed=10.5]
 50%|█████     | 101/202 [01:07<01:07,  1.50it/s, kl=5.18, loss=0.0179, speed=10.5]
 50%|█████     | 102/202 [01:07<01:06,  1.51it/s, kl=5.18, loss=0.0179, speed=10.5]
 51%|█████     | 103/202 [01:08<01:06,  1.50it/s, kl=5.18, loss=0.0179, speed=10.5]
 51%|█████▏    | 104/202 [01:09<01:05,  1.51it/s, kl=5.18, loss=0.0179, speed=10.5]
 52%|█████▏    | 105/202 [01:09<01:04,  1.51it/s, kl=5.18, loss=0.0179, speed=10.5]
 52%|█████▏    | 106/202 [01:10<01:03,  1.51it/s, kl=5.18, loss=0.0179, speed=10.5]
 53%|█████▎    | 107/202 [01:11<01:02,  1.51it/s, kl=5.18, loss=0.0179, speed=10.5]
 53%|█████▎    | 108/202 [01:11<01:02,  1.50it/s, kl=5.18, loss=0.0179, speed=10.5]
 53%|█████▎    | 108/202 [01:12<01:02,  1.50it/s, kl=8.38, loss=0.0198, speed=10.5]
 54%|█████▍    | 109/202 [01:12<01:03,  1.48it/s, kl=8.38, loss=0.0198, speed=10.5]
 54%|█████▍    | 110/202 [01:13<01:02,  1.48it/s, kl=8.38, loss=0.0198, speed=10.5]
 55%|█████▍    | 111/202 [01:13<01:01,  1.49it/s, kl=8.38, loss=0.0198, speed=10.5]
 55%|█████▌    | 112/202 [01:14<01:00,  1.49it/s, kl=8.38, loss=0.0198, speed=10.5]
 56%|█████▌    | 113/202 [01:15<00:59,  1.49it/s, kl=8.38, loss=0.0198, speed=10.5]
 56%|█████▋    | 114/202 [01:15<00:58,  1.50it/s, kl=8.38, loss=0.0198, speed=10.5]
 57%|█████▋    | 115/202 [01:16<00:58,  1.50it/s, kl=8.38, loss=0.0198, speed=10.5]
 57%|█████▋    | 116/202 [01:17<00:57,  1.50it/s, kl=8.38, loss=0.0198, speed=10.5]
 58%|█████▊    | 117/202 [01:17<00:56,  1.50it/s, kl=8.38, loss=0.0198, speed=10.5]
 58%|█████▊    | 118/202 [01:18<00:55,  1.50it/s, kl=8.38, loss=0.0198, speed=10.5]
 59%|█████▉    | 119/202 [01:19<00:55,  1.51it/s, kl=8.38, loss=0.0198, speed=10.5]
 59%|█████▉    | 120/202 [01:19<00:54,  1.50it/s, kl=8.38, loss=0.0198, speed=10.5]
 60%|█████▉    | 121/202 [01:20<00:53,  1.51it/s, kl=8.38, loss=0.0198, speed=10.5]
 60%|██████    | 122/202 [01:21<00:52,  1.51it/s, kl=8.38, loss=0.0198, speed=10.5]
 61%|██████    | 123/202 [01:21<00:52,  1.51it/s, kl=8.38, loss=0.0198, speed=10.5]
 61%|██████▏   | 124/202 [01:22<00:51,  1.51it/s, kl=8.38, loss=0.0198, speed=10.5]
 61%|██████▏   | 124/202 [01:23<00:51,  1.51it/s, kl=5.82, loss=0.0286, speed=10.5]
 62%|██████▏   | 125/202 [01:23<00:51,  1.49it/s, kl=5.82, loss=0.0286, speed=10.5]
 62%|██████▏   | 126/202 [01:23<00:50,  1.49it/s, kl=5.82, loss=0.0286, speed=10.5]
 63%|██████▎   | 127/202 [01:24<00:50,  1.49it/s, kl=5.82, loss=0.0286, speed=10.5]
 63%|██████▎   | 128/202 [01:25<00:49,  1.50it/s, kl=5.82, loss=0.0286, speed=10.5]
 64%|██████▍   | 129/202 [01:25<00:48,  1.50it/s, kl=5.82, loss=0.0286, speed=10.5]
 64%|██████▍   | 130/202 [01:26<00:47,  1.51it/s, kl=5.82, loss=0.0286, speed=10.5]
 65%|██████▍   | 131/202 [01:27<00:47,  1.51it/s, kl=5.82, loss=0.0286, speed=10.5]
 65%|██████▌   | 132/202 [01:27<00:46,  1.50it/s, kl=5.82, loss=0.0286, speed=10.5]
 66%|██████▌   | 133/202 [01:28<00:45,  1.50it/s, kl=5.82, loss=0.0286, speed=10.5]
 66%|██████▋   | 134/202 [01:29<00:45,  1.51it/s, kl=5.82, loss=0.0286, speed=10.5]
 67%|██████▋   | 135/202 [01:29<00:44,  1.50it/s, kl=5.82, loss=0.0286, speed=10.5]
 67%|██████▋   | 136/202 [01:30<00:43,  1.51it/s, kl=5.82, loss=0.0286, speed=10.5]
 68%|██████▊   | 137/202 [01:31<00:43,  1.51it/s, kl=5.82, loss=0.0286, speed=10.5]
 68%|██████▊   | 138/202 [01:31<00:42,  1.50it/s, kl=5.82, loss=0.0286, speed=10.5]
 69%|██████▉   | 139/202 [01:32<00:41,  1.50it/s, kl=5.82, loss=0.0286, speed=10.5]
 69%|██████▉   | 140/202 [01:33<00:41,  1.50it/s, kl=5.82, loss=0.0286, speed=10.5]
 69%|██████▉   | 140/202 [01:33<00:41,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 70%|██████▉   | 141/202 [01:33<00:41,  1.48it/s, kl=6.46, loss=0.0128, speed=10.5]
 70%|███████   | 142/202 [01:34<00:40,  1.49it/s, kl=6.46, loss=0.0128, speed=10.5]
 71%|███████   | 143/202 [01:35<00:39,  1.49it/s, kl=6.46, loss=0.0128, speed=10.5]
 71%|███████▏  | 144/202 [01:35<00:38,  1.49it/s, kl=6.46, loss=0.0128, speed=10.5]
 72%|███████▏  | 145/202 [01:36<00:38,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 72%|███████▏  | 146/202 [01:37<00:37,  1.49it/s, kl=6.46, loss=0.0128, speed=10.5]
 73%|███████▎  | 147/202 [01:37<00:36,  1.49it/s, kl=6.46, loss=0.0128, speed=10.5]
 73%|███████▎  | 148/202 [01:38<00:36,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 74%|███████▍  | 149/202 [01:39<00:35,  1.49it/s, kl=6.46, loss=0.0128, speed=10.5]
 74%|███████▍  | 150/202 [01:39<00:34,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 75%|███████▍  | 151/202 [01:40<00:34,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 75%|███████▌  | 152/202 [01:41<00:33,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 76%|███████▌  | 153/202 [01:41<00:32,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 76%|███████▌  | 154/202 [01:42<00:32,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 77%|███████▋  | 155/202 [01:43<00:31,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 77%|███████▋  | 156/202 [01:43<00:30,  1.50it/s, kl=6.46, loss=0.0128, speed=10.5]
 77%|███████▋  | 156/202 [01:44<00:30,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5] 
 78%|███████▊  | 157/202 [01:44<00:30,  1.48it/s, kl=8.2, loss=0.0204, speed=10.5]
 78%|███████▊  | 158/202 [01:45<00:29,  1.49it/s, kl=8.2, loss=0.0204, speed=10.5]
 79%|███████▊  | 159/202 [01:45<00:28,  1.49it/s, kl=8.2, loss=0.0204, speed=10.5]
 79%|███████▉  | 160/202 [01:46<00:28,  1.49it/s, kl=8.2, loss=0.0204, speed=10.5]
 80%|███████▉  | 161/202 [01:47<00:27,  1.49it/s, kl=8.2, loss=0.0204, speed=10.5]
 80%|████████  | 162/202 [01:47<00:26,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 81%|████████  | 163/202 [01:48<00:26,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 81%|████████  | 164/202 [01:49<00:25,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 82%|████████▏ | 165/202 [01:49<00:24,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 82%|████████▏ | 166/202 [01:50<00:23,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 83%|████████▎ | 167/202 [01:51<00:23,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 83%|████████▎ | 168/202 [01:51<00:22,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 84%|████████▎ | 169/202 [01:52<00:22,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 84%|████████▍ | 170/202 [01:53<00:21,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 85%|████████▍ | 171/202 [01:53<00:20,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 85%|████████▌ | 172/202 [01:54<00:19,  1.50it/s, kl=8.2, loss=0.0204, speed=10.5]
 85%|████████▌ | 172/202 [01:55<00:19,  1.50it/s, kl=6.08, loss=0.0161, speed=10.5]
 86%|████████▌ | 173/202 [01:55<00:19,  1.48it/s, kl=6.08, loss=0.0161, speed=10.5]
 86%|████████▌ | 174/202 [01:55<00:18,  1.48it/s, kl=6.08, loss=0.0161, speed=10.5]
 87%|████████▋ | 175/202 [01:56<00:18,  1.49it/s, kl=6.08, loss=0.0161, speed=10.5]
 87%|████████▋ | 176/202 [01:57<00:17,  1.49it/s, kl=6.08, loss=0.0161, speed=10.5]
 88%|████████▊ | 177/202 [01:57<00:16,  1.49it/s, kl=6.08, loss=0.0161, speed=10.5]
 88%|████████▊ | 178/202 [01:58<00:16,  1.49it/s, kl=6.08, loss=0.0161, speed=10.5]
 89%|████████▊ | 179/202 [01:59<00:15,  1.50it/s, kl=6.08, loss=0.0161, speed=10.5]
 89%|████████▉ | 180/202 [01:59<00:14,  1.50it/s, kl=6.08, loss=0.0161, speed=10.5]
 90%|████████▉ | 181/202 [02:00<00:13,  1.51it/s, kl=6.08, loss=0.0161, speed=10.5]
 90%|█████████ | 182/202 [02:01<00:13,  1.51it/s, kl=6.08, loss=0.0161, speed=10.5]
 91%|█████████ | 183/202 [02:01<00:12,  1.51it/s, kl=6.08, loss=0.0161, speed=10.5]
 91%|█████████ | 184/202 [02:02<00:11,  1.50it/s, kl=6.08, loss=0.0161, speed=10.5]
 92%|█████████▏| 185/202 [02:03<00:11,  1.50it/s, kl=6.08, loss=0.0161, speed=10.5]
 92%|█████████▏| 186/202 [02:03<00:10,  1.50it/s, kl=6.08, loss=0.0161, speed=10.5]
 93%|█████████▎| 187/202 [02:04<00:09,  1.51it/s, kl=6.08, loss=0.0161, speed=10.5]
 93%|█████████▎| 188/202 [02:05<00:09,  1.51it/s, kl=6.08, loss=0.0161, speed=10.5]
 93%|█████████▎| 188/202 [02:05<00:09,  1.51it/s, kl=4.21, loss=0.0129, speed=10.5]
 94%|█████████▎| 189/202 [02:05<00:08,  1.49it/s, kl=4.21, loss=0.0129, speed=10.5]
 94%|█████████▍| 190/202 [02:06<00:08,  1.50it/s, kl=4.21, loss=0.0129, speed=10.5]
 95%|█████████▍| 191/202 [02:07<00:07,  1.51it/s, kl=4.21, loss=0.0129, speed=10.5]
 95%|█████████▌| 192/202 [02:07<00:06,  1.50it/s, kl=4.21, loss=0.0129, speed=10.5]
 96%|█████████▌| 193/202 [02:08<00:05,  1.50it/s, kl=4.21, loss=0.0129, speed=10.5]
 96%|█████████▌| 194/202 [02:09<00:05,  1.51it/s, kl=4.21, loss=0.0129, speed=10.5]
 97%|█████████▋| 195/202 [02:09<00:04,  1.50it/s, kl=4.21, loss=0.0129, speed=10.5]
 97%|█████████▋| 196/202 [02:10<00:03,  1.51it/s, kl=4.21, loss=0.0129, speed=10.5]
 98%|█████████▊| 197/202 [02:11<00:03,  1.51it/s, kl=4.21, loss=0.0129, speed=10.5]
 98%|█████████▊| 198/202 [02:11<00:02,  1.51it/s, kl=4.21, loss=0.0129, speed=10.5]
 99%|█████████▊| 199/202 [02:12<00:01,  1.51it/s, kl=4.21, loss=0.0129, speed=10.5]
 99%|█████████▉| 200/202 [02:13<00:01,  1.50it/s, kl=4.21, loss=0.0129, speed=10.5]
100%|█████████▉| 201/202 [02:13<00:00,  1.50it/s, kl=4.21, loss=0.0129, speed=10.5]
100%|██████████| 202/202 [02:14<00:00,  1.80it/s, kl=4.21, loss=0.0129, speed=10.5]
100%|██████████| 202/202 [02:14<00:00,  1.51it/s, kl=4.21, loss=0.0129, speed=10.5]