ai-champ / README.md
Albertmade's picture
Upload README.md with huggingface_hub
c7e09a3 verified
metadata
pipeline_tag: text-classification
tags:
  - encoder
  - binary-classification
  - routing
  - ai-champs
base_model: intfloat/multilingual-e5-base

ai-champ: Question โ†’ A/B ๋ผ์šฐํŒ… ๋ถ„๋ฅ˜๊ธฐ

  • ์ž…๋ ฅ: question + [MODEL] {model_name}
  • ๋ผ๋ฒจ: score โ‰ฅ 4 โ†’ B(1), else A(0)
  • ํ•™์Šต ๋ฐ์ดํ„ฐ: HAERAE-HUB/ai-champs-train์˜ train/test ๊ฐ๊ฐ 10% ์ƒ˜ํ”Œ
  • ํ…Œ์ŠคํŠธ ๋ฉ”ํŠธ๋ฆญ: {'eval_loss': 0.5179986953735352, 'eval_accuracy': 0.7566917950398776, 'eval_f1': 0.7842681391068488, 'eval_roc_auc': 0.8158790589102392, 'eval_runtime': 19.1572, 'eval_samples_per_second': 955.569, 'eval_steps_per_second': 7.517, 'epoch': 3.0}