15 lines
815 B
Plaintext
15 lines
815 B
Plaintext
[jev] device=cuda base=/tmp/base
|
|
Some weights of XLMRobertaForSequenceClassification were not initialized from the model checkpoint at /tmp/base and are newly initialized: ['classifier.dense.bias', 'classifier.dense.weight', 'classifier.out_proj.bias', 'classifier.out_proj.weight']
|
|
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
|
|
trainable params: 1,476,097 || all params: 279,520,514 || trainable%: 0.5281
|
|
[jev] train=37182 calib=5291
|
|
[jev] ep0 step100/2322 loss=0.2847
|
|
[jev] ep0 step200/2322 loss=0.1989
|
|
[jev] ep0 step300/2322 loss=0.2504
|
|
[jev] ep0 step400/2322 loss=0.3098
|
|
[jev] ep0 step500/2322 loss=0.1724
|
|
[jev] ep0 step600/2322 loss=0.2330
|
|
[jev] ep0 step700/2322 loss=0.2886
|
|
[jev] ep0 step800/2322 loss=0.2370
|
|
[jev] ep0 step900/2322 loss=0.3038
|