Update README.md
Browse files
README.md
CHANGED
|
@@ -1,124 +1 @@
|
|
| 1 |
-
|
| 2 |
-
base: Text-Corrector-T5-base backbone model
|
| 3 |
-
|
| 4 |
-
v1.0: fine-finetune
|
| 5 |
-
|
| 6 |
-
v1.1: ํ๊ตญ์ด ์ปค์คํ
๋ฐ์ดํฐ์
+ ์์ด ๋ง์ถค๋ฒ ๊ต์ ๋ฐ์ดํฐ์
|
| 7 |
-
|
| 8 |
-
# ์ฌ์ฉ๋ ๋ฐ์ดํฐ์
|
| 9 |
-
- 2021๋
๋ง๋ญ์น ๊ต์
|
| 10 |
-
- 2022๋
๋ง๋ญ์น ๊ต์
|
| 11 |
-
- Standard_Korean_GEC
|
| 12 |
-
- ์์ฐ์ด ๋ถ์ ํ์ฒ๋ฆฌ์ฉ ๊ณผ๊ต์ ๊ฒ์ฆ ๋ฐ์ดํฐ
|
| 13 |
-
- ๋ค์ด๋ฒ ๋ง์ถค๋ฒ ํด์ฆ + ์์ฒด QC ๋ฐ์ดํฐ์
|
| 14 |
-
- <b>๋ชจ๋ ๋ฐ์ดํฐ์
ํฉ์น ํ ์ ์ฒ๋ฆฌ ์งํ</b>
|
| 15 |
-
|
| 16 |
-
# ํ์ต์ ์ฌ์ฉ๋ ๋ฐ์ดํฐ์
ํฌ๊ธฐ
|
| 17 |
-
- 2,652,241 ๋ฌธ์ฅ ์ (๊ตฌ์ถ ๋ฐ์ดํฐ์
85%)
|
| 18 |
-
|
| 19 |
-
# ๊ฒ์ฆ 468,011 ๋ฌธ์ฅ ์
|
| 20 |
-
## ์ ๋ ํ๊ฐ
|
| 21 |
-
<table>
|
| 22 |
-
<tr>
|
| 23 |
-
<th>Model</th>
|
| 24 |
-
<th>BLEU Score</th>
|
| 25 |
-
<th>EM Score</th>
|
| 26 |
-
</tr>
|
| 27 |
-
<tr>
|
| 28 |
-
<td>LDCC/Text-Corrector-T5-base</td>
|
| 29 |
-
<td>52.03</td>
|
| 30 |
-
<td>21.84</td>
|
| 31 |
-
</tr>
|
| 32 |
-
<tr>
|
| 33 |
-
<td>LDCC/Text-Corrector-T5-base-finetune</td>
|
| 34 |
-
<td>66.64</td>
|
| 35 |
-
<td>39.65</td>
|
| 36 |
-
</tr>
|
| 37 |
-
</table>
|
| 38 |
-
## ์ ์ฑํ๊ฐ ๋ค์ด๋ฒ ๋ง์ถค๋ฒ ํด์ฆ ๊ธฐ์ค 100 ๋ฌธ์ฅ ์
|
| 39 |
-
|
| 40 |
-
<table>
|
| 41 |
-
<tr>
|
| 42 |
-
<th>Model</th>
|
| 43 |
-
<th>Correct Answers</th>
|
| 44 |
-
<th>Incorrect Answers</th>
|
| 45 |
-
</tr>
|
| 46 |
-
<tr>
|
| 47 |
-
<td>LDCC/Text-Corrector-T5-base</td>
|
| 48 |
-
<td>30</td>
|
| 49 |
-
<td>70</td>
|
| 50 |
-
</tr>
|
| 51 |
-
<tr>
|
| 52 |
-
<td>LDCC/Text-Corrector-T5-base-finetune</td>
|
| 53 |
-
<td>58</td>
|
| 54 |
-
<td>42</td>
|
| 55 |
-
</tr>
|
| 56 |
-
</table>
|
| 57 |
-
<table>
|
| 58 |
-
<tr>
|
| 59 |
-
<th>Input</th>
|
| 60 |
-
<th>Original</th>
|
| 61 |
-
<th>Finetune</th>
|
| 62 |
-
<th>Answer</th>
|
| 63 |
-
</tr>
|
| 64 |
-
<tr>
|
| 65 |
-
<td>๋ด๊ฐ ๋์ ๋ค์น๋ฅ๊ฑฐ๋ฆฌ๋ง ํ๋ ๊ฒ ๊ฐ๋ค.</td>
|
| 66 |
-
<td><b>๋ด๊ฐ ๋์ ๋ค์น๋ค๊บผ๋ฆฌ๋ง ํ๋ ๊ฒ ๊ฐ๋ค.</b></td>
|
| 67 |
-
<td><b>๋ด๊ฐ ๋์ ๋ค์น๋ค๊บผ๋ฆฌ๋ง ํ๋ ๊ฒ ๊ฐ๋ค.</b></td>
|
| 68 |
-
<td><b>๋ด๊ฐ ๋์ ๋ค์น๋ค๊บผ๋ฆฌ๋ง ํ๋ ๊ฒ ๊ฐ๋ค.</b></td>
|
| 69 |
-
</tr>
|
| 70 |
-
<tr>
|
| 71 |
-
<td>๊ต์ค์ด ๋๋ฐ๊ธฐ์์ฅ์ฒ๋ผ ์๋๋ฝ๋ค.</td>
|
| 72 |
-
<td>๊ต์ค์ด ๋๋ฐ๊ธฐ ์์ฅ์ฒ๋ผ ์๋๋ฝ๋ค.</td>
|
| 73 |
-
<td><b>๊ต์ค์ด ๋๋ผ๊ธฐ์์ฅ์ฒ๋ผ ์๋๋ฝ๋ค.</b></td>
|
| 74 |
-
<td>๊ต์ค์ด ๋๋ผ๊ธฐ์์ฅ์ฒ๋ผ ์๋๋ฝ๋ค.</td>
|
| 75 |
-
</tr>
|
| 76 |
-
<tr>
|
| 77 |
-
<td>์น๊ตฌ๊ฐ ๋ชจ๋ฅด๋ ๋ฌธ์ ๋ฅผ ๊ฐ์ผ ์ฃผ๋ค.</td>
|
| 78 |
-
<td>์น๊ตฌ๊ฐ ๋ชจ๋ฅด๋ ๋ฌธ์ ๋ฅผ ๊ฐ๋ฅด์ณ ์ค๋ค.</td>
|
| 79 |
-
<td><b>์น๊ตฌ๊ฐ ๋ชจ๋ฅด๋ ๋ฌธ์ ๋ฅผ ๊ฐ๋ฅด์ณ ์ฃผ๋ค.</b></td>
|
| 80 |
-
<td>์น๊ตฌ๊ฐ ๋ชจ๋ฅด๋ ๋ฌธ์ ๋ฅผ ๊ฐ๋ฅด์ณ ์ฃผ๋ค.</td>
|
| 81 |
-
</tr>
|
| 82 |
-
<tr>
|
| 83 |
-
<td>๋ค๋ฆฌ๊ฐ ์ ๋ ค์ ๋ค๋ฆฌ๋ฅผ ๋ปฃ์๋ค.</td>
|
| 84 |
-
<td>๋ค๋ฆฌ๊ฐ ์ ๋ ค์ ๋ค๋ฆฌ๋ฅผ ๋ปฃ์๋ค.</td>
|
| 85 |
-
<td><b>๋ค๋ฆฌ๊ฐ ์ ๋ ค์ ๋ค๋ฆฌ๋ฅผ ๋ป์๋ค.</b></td>
|
| 86 |
-
<td>๋ค๋ฆฌ๊ฐ ์ ๋ ค์ ๋ค๋ฆฌ๋ฅผ ๋ป์๋ค.</td>
|
| 87 |
-
</tr>
|
| 88 |
-
<tr>
|
| 89 |
-
<td>์ซ๊ฟฉ๊ณผ ๊ฐ์ ์๋ฏธ๋ฅผ ์ง๋ ๋ง์ '์ฅ๋ผ'๋ค.</td>
|
| 90 |
-
<td>์ซ์์ ๊ฐ์ ์๋ฏธ๋ฅผ ์ง๋ ๋ง์ '์ฅ๋ผ'๋ค.</td>
|
| 91 |
-
<td>์ซ๊ฟฉ๊ณผ ๊ฐ์ ์๋ฏธ๋ฅผ ์ง๋ ๋ง์ '์ฅ๋ผ'๋ค.</td>
|
| 92 |
-
<td><b>์๊ฟฉ๊ณผ ๊ฐ์ ์๋ฏธ๋ฅผ ์ง๋ ๋ง์ '์ฅ๋ผ'๋ค.</b></td>
|
| 93 |
-
</tr>
|
| 94 |
-
<tr>
|
| 95 |
-
<td>๋ด๊ฐ ๋๋ํ ๋งํ๋ค.</td>
|
| 96 |
-
<td><b>๋ด๊ฐ ๋๋์ด ๋งํ๋ค.</b></td>
|
| 97 |
-
<td><b>๋ด๊ฐ ๋๋์ด ๋งํ๋ค.</b></td>
|
| 98 |
-
<td>๋ด๊ฐ ๋๋์ด ๋งํ๋ค.</td>
|
| 99 |
-
</tr>
|
| 100 |
-
<tr>
|
| 101 |
-
<td>๊ทธ ๋ณ์ฌ๋ค์ ์ด์๋ฐ๊ธฐ๋ ๋ค๋ฆ์๋ ์ด๋ช
์ด์๋ค.</td>
|
| 102 |
-
<td>๊ทธ ๋ณ์ฌ๋ค์ ์ด์ ๋ฐ๊ธฐ๋ ๋ค๋ฆ์๋ ์ด๋ช
์ด์๋ค.</td>
|
| 103 |
-
<td>๊ทธ ๋ณ์ฌ๋ค์ ์ด์ ๋ฐ๊ธฐ๋ ๋ค๋ฆ์๋ ์ด๋ช
์ด์๋ค.</td>
|
| 104 |
-
<td><b>๊ทธ ๋ณ์ฌ๋ค์ ์ด์๋ฐ์ด๋ ๋ค๋ฆ์๋ ์ด๋ช
์ด์๋ค.</b></td>
|
| 105 |
-
</tr>
|
| 106 |
-
<tr>
|
| 107 |
-
<td>์ด์๋์ด ๋ถ๋ฆฌ๋์๋ค.</td>
|
| 108 |
-
<td>์ด์๋์ด ๋ถ๋ฆฌ๋์๋ค.</td>
|
| 109 |
-
<td>์ด์๋์ด ๋ถ๋ฆฌ๋์๋ค.</td>
|
| 110 |
-
<td><b>์ด์๋์ด ๋ถ๋ฆฌ๋์๋ค.</b></td>
|
| 111 |
-
</tr>
|
| 112 |
-
<tr>
|
| 113 |
-
<td>์ด์ ์๋ ๊ด์ธ๋ฅผ ๋ฐ์๋ค.</td>
|
| 114 |
-
<td>์ด์ ์๋ ๊ด์ธ๋ฅผ ๋ฐ์๋ค.</td>
|
| 115 |
-
<td>์ด์ ์๋ ๊ด์ธ๋ฅผ ๋ฐ์๋ค.</td>
|
| 116 |
-
<td><b>์ด์ ์๋ ๊ด์๋ฅผ ๋ฐ์๋ค.</b></td>
|
| 117 |
-
</tr>
|
| 118 |
-
<tr>
|
| 119 |
-
<td>๋๋ฌผ์ด ์ฃผ๋ฃจ๋ฃฉ ํ๋ ๋ค.</td>
|
| 120 |
-
<td>๋๋ฌผ์ด ์ฃผ๋ฃฉ ํ๋ ๋ค.</td>
|
| 121 |
-
<td><b>๋๋ฌผ์ด ์ฃผ๋ฅด๋ฅต ํ๋ ๋ค.</b></td>
|
| 122 |
-
<td>๋๋ฌผ์ด ์ฃผ๋ฅด๋ฅต ํ๋ ๋ค.</td>
|
| 123 |
-
</tr>
|
| 124 |
-
</table>
|
|
|
|
| 1 |
+
dd
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|