2e6e934564
val loss 1.24 → 0.80, val perplexity 3.47 → 2.22. Best epoch 50 (no early stop); convergence epoch 30. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2.1 KiB
2.1 KiB
| 1 | epoch | train_loss | val_loss | val_ppl | lr | elapsed_s |
|---|---|---|---|---|---|---|
| 2 | 1 | 1.185128 | 1.244704 | 3.47 | 8.000000e-06 | 9.9 |
| 3 | 2 | 1.129786 | 1.168368 | 3.22 | 9.994161e-06 | 9.2 |
| 4 | 3 | 1.074786 | 1.102074 | 3.01 | 9.968238e-06 | 8.8 |
| 5 | 4 | 1.004364 | 1.045185 | 2.84 | 9.921690e-06 | 8.5 |
| 6 | 5 | 0.963113 | 0.995150 | 2.71 | 9.854709e-06 | 9.2 |
| 7 | 6 | 0.903885 | 0.953348 | 2.59 | 9.767574e-06 | 9.1 |
| 8 | 7 | 0.867560 | 0.927149 | 2.53 | 9.660647e-06 | 8.1 |
| 9 | 8 | 0.848291 | 0.911215 | 2.49 | 9.534372e-06 | 9.1 |
| 10 | 9 | 0.817798 | 0.897135 | 2.45 | 9.389272e-06 | 9.2 |
| 11 | 10 | 0.815333 | 0.885900 | 2.43 | 9.225950e-06 | 8.2 |
| 12 | 11 | 0.804101 | 0.876820 | 2.40 | 9.045085e-06 | 9.7 |
| 13 | 12 | 0.791397 | 0.868702 | 2.38 | 8.847427e-06 | 9.2 |
| 14 | 13 | 0.778087 | 0.860407 | 2.36 | 8.633796e-06 | 8.5 |
| 15 | 14 | 0.771410 | 0.853698 | 2.35 | 8.405079e-06 | 10.7 |
| 16 | 15 | 0.768661 | 0.848427 | 2.34 | 8.162227e-06 | 10.7 |
| 17 | 16 | 0.762623 | 0.842908 | 2.32 | 7.906247e-06 | 9.4 |
| 18 | 17 | 0.749388 | 0.837927 | 2.31 | 7.638201e-06 | 8.2 |
| 19 | 18 | 0.745191 | 0.833950 | 2.30 | 7.359203e-06 | 9.1 |
| 20 | 19 | 0.745993 | 0.830711 | 2.29 | 7.070412e-06 | 9.2 |
| 21 | 20 | 0.726599 | 0.827279 | 2.29 | 6.773024e-06 | 9.0 |
| 22 | 21 | 0.722057 | 0.824505 | 2.28 | 6.468277e-06 | 8.4 |
| 23 | 22 | 0.723956 | 0.822224 | 2.28 | 6.157433e-06 | 9.2 |
| 24 | 23 | 0.721438 | 0.819970 | 2.27 | 5.841785e-06 | 9.2 |
| 25 | 24 | 0.717564 | 0.817087 | 2.26 | 5.522642e-06 | 8.1 |
| 26 | 25 | 0.711637 | 0.814592 | 2.26 | 5.201330e-06 | 9.2 |
| 27 | 26 | 0.712329 | 0.812606 | 2.25 | 4.879181e-06 | 9.2 |
| 28 | 27 | 0.705078 | 0.810716 | 2.25 | 4.557534e-06 | 8.1 |
| 29 | 28 | 0.697062 | 0.808805 | 2.25 | 4.237724e-06 | 9.2 |
| 30 | 29 | 0.700164 | 0.807415 | 2.24 | 3.921079e-06 | 10.2 |
| 31 | 30 | 0.695335 | 0.806321 | 2.24 | 3.608913e-06 | 8.7 |
| 32 | 31 | 0.687925 | 0.804961 | 2.24 | 3.302521e-06 | 8.9 |
| 33 | 32 | 0.691783 | 0.803864 | 2.23 | 3.003177e-06 | 9.3 |
| 34 | 33 | 0.690663 | 0.802969 | 2.23 | 2.712123e-06 | 9.3 |
| 35 | 34 | 0.692106 | 0.801836 | 2.23 | 2.430566e-06 | 8.1 |
| 36 | 35 | 0.691675 | 0.801080 | 2.23 | 2.159676e-06 | 9.2 |
| 37 | 36 | 0.678919 | 0.800619 | 2.23 | 1.900578e-06 | 9.2 |
| 38 | 37 | 0.682140 | 0.800421 | 2.23 | 1.654347e-06 | 8.2 |
| 39 | 38 | 0.689051 | 0.800192 | 2.23 | 1.422005e-06 | 9.2 |
| 40 | 39 | 0.686498 | 0.799934 | 2.23 | 1.204517e-06 | 9.3 |
| 41 | 40 | 0.690576 | 0.799613 | 2.22 | 1.002786e-06 | 8.2 |
| 42 | 41 | 0.684055 | 0.799269 | 2.22 | 8.176493e-07 | 9.5 |
| 43 | 42 | 0.685102 | 0.799062 | 2.22 | 6.498753e-07 | 9.3 |
| 44 | 43 | 0.689241 | 0.798999 | 2.22 | 5.001606e-07 | 8.6 |
| 45 | 44 | 0.689855 | 0.798879 | 2.22 | 3.691268e-07 | 8.7 |
| 46 | 45 | 0.679218 | 0.798795 | 2.22 | 2.573178e-07 | 9.1 |
| 47 | 46 | 0.680892 | 0.798748 | 2.22 | 1.651979e-07 | 9.1 |
| 48 | 47 | 0.688506 | 0.798713 | 2.22 | 9.314937e-08 | 8.3 |
| 49 | 48 | 0.684029 | 0.798699 | 2.22 | 4.147145e-08 | 9.2 |
| 50 | 49 | 0.685409 | 0.798693 | 2.22 | 1.037863e-08 | 9.2 |
| 51 | 50 | 0.684188 | 0.798692 | 2.22 | 0.000000e+00 | 8.1 |