Skip to content

Commit 8bb927c

Browse files
committed
Merge remote-tracking branch 'origin/master'
2 parents 1692c0d + 8bbfa0e commit 8bb927c

File tree

1 file changed

+49
-0
lines changed

1 file changed

+49
-0
lines changed

README.md

Lines changed: 49 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,6 +31,55 @@ python train.py
3131
python eval.py --model_path=latest_model.pt
3232
```
3333
34+
## Result
35+
36+
### Performance
37+
38+
<table>
39+
<tr>
40+
<th rowspan="2">Method</th>
41+
<th colspan="3">Trigger Classification (%)</th>
42+
<th colspan="3">Argument Classification (%)</th>
43+
</tr>
44+
<tr>
45+
<td>Precision</td>
46+
<td>Recall</td>
47+
<td>F1</td>
48+
<td>Precision</td>
49+
<td>Recall</td>
50+
<td>F1</td>
51+
</tr>
52+
<tr>
53+
<td>JRNN</td>
54+
<td>66.0</td>
55+
<td>73.0</td>
56+
<td>69.3</td>
57+
<td>54.2</td>
58+
<td>56.7</td>
59+
<td>55.5</td>
60+
</tr>
61+
<tr>
62+
<td>JMEE</td>
63+
<td>76.3</td>
64+
<td>71.3</td>
65+
<td>73.7</td>
66+
<td>66.8</td>
67+
<td>54.9</td>
68+
<td>60.3</td>
69+
</tr>
70+
<tr>
71+
<td>This model (BERT base)</td>
72+
<td>63.4</td>
73+
<td>71.1</td>
74+
<td>67.7</td>
75+
<td>48.5</td>
76+
<td>34.1</td>
77+
<td>40.0</td>
78+
</tr>
79+
</table>
80+
81+
The performance of this model is low in argument classification even though pretrained BERT model was used. The model is currently being updated to improve the performance.
82+
3483
## Reference
3584
* Jointly Multiple Events Extraction via Attention-based Graph Information Aggregation (EMNLP 2018), Liu et al. [[paper]](https://arxiv.org/abs/1809.09078)
3685
* lx865712528's EMNLP2018-JMEE repository [[github]](https://github.com/lx865712528/EMNLP2018-JMEE)

0 commit comments

Comments
 (0)