14 lines
780 B
Plaintext
14 lines
780 B
Plaintext
[jev] device=cuda base=/tmp/base
|
|
Some weights of XLMRobertaForSequenceClassification were not initialized from the model checkpoint at /tmp/base and are newly initialized: ['classifier.dense.bias', 'classifier.dense.weight', 'classifier.out_proj.bias', 'classifier.out_proj.weight']
|
|
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
|
|
trainable params: 1,476,097 || all params: 279,520,514 || trainable%: 0.5281
|
|
[jev] train=35848 calib=5291
|
|
[jev] ep0 step100/2240 loss=0.3442
|
|
[jev] ep0 step200/2240 loss=0.1200
|
|
[jev] ep0 step300/2240 loss=0.3088
|
|
[jev] ep0 step400/2240 loss=0.3102
|
|
[jev] ep0 step500/2240 loss=0.0746
|
|
[jev] ep0 step600/2240 loss=0.1947
|
|
[jev] ep0 step700/2240 loss=0.2139
|
|
[jev] ep0 step800/2240 loss=0.2837
|