41 lines
1.8 KiB
Plaintext
41 lines
1.8 KiB
Plaintext
[jev] device=cuda base=xlm-roberta-base
|
|
Some weights of XLMRobertaForSequenceClassification were not initialized from the model checkpoint at xlm-roberta-base and are newly initialized: ['classifier.dense.bias', 'classifier.dense.weight', 'classifier.out_proj.bias', 'classifier.out_proj.weight']
|
|
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
|
|
[jev] train=35848 calib=5291
|
|
[jev] ep0 step100/3360 loss=0.2693
|
|
[jev] ep0 step200/3360 loss=0.1835
|
|
[jev] ep0 step300/3360 loss=0.3982
|
|
[jev] ep0 step400/3360 loss=0.6066
|
|
[jev] ep0 step500/3360 loss=0.1670
|
|
[jev] ep0 step600/3360 loss=0.2391
|
|
[jev] ep0 step700/3360 loss=0.2325
|
|
[jev] ep0 step800/3360 loss=0.2099
|
|
[jev] ep0 step900/3360 loss=0.1652
|
|
[jev] ep0 step1000/3360 loss=0.1945
|
|
[jev] ep0 step1100/3360 loss=0.3984
|
|
[jev] epoch 0 calibration: {'auc': 0.9931, 'ece': 0.0136, 'n': 5291}
|
|
[jev] ep1 step1200/3360 loss=0.0956
|
|
[jev] ep1 step1300/3360 loss=0.0914
|
|
[jev] ep1 step1400/3360 loss=0.1300
|
|
[jev] ep1 step1500/3360 loss=0.2934
|
|
[jev] ep1 step1600/3360 loss=0.1928
|
|
[jev] ep1 step1700/3360 loss=0.1637
|
|
[jev] ep1 step1800/3360 loss=0.3047
|
|
[jev] ep1 step1900/3360 loss=0.0942
|
|
[jev] ep1 step2000/3360 loss=0.2673
|
|
[jev] ep1 step2100/3360 loss=0.1928
|
|
[jev] ep1 step2200/3360 loss=0.1661
|
|
[jev] epoch 1 calibration: {'auc': 0.9947, 'ece': 0.0192, 'n': 5291}
|
|
[jev] ep2 step2300/3360 loss=0.2623
|
|
[jev] ep2 step2400/3360 loss=0.1711
|
|
[jev] ep2 step2500/3360 loss=0.0956
|
|
[jev] ep2 step2600/3360 loss=0.0973
|
|
[jev] ep2 step2700/3360 loss=0.2210
|
|
[jev] ep2 step2800/3360 loss=0.1071
|
|
[jev] ep2 step2900/3360 loss=0.1232
|
|
[jev] ep2 step3000/3360 loss=0.0794
|
|
[jev] ep2 step3100/3360 loss=0.1606
|
|
[jev] ep2 step3200/3360 loss=0.0512
|
|
[jev] ep2 step3300/3360 loss=0.2397
|
|
[jev] epoch 2 calibration: {'auc': 0.9949, 'ece': 0.0212, 'n': 5291}
|