-
Notifications
You must be signed in to change notification settings - Fork 25
/
Copy pathresults_conll03.txt
245 lines (219 loc) · 12.4 KB
/
results_conll03.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
===========
ENGLISH NER
===========
Averagend Perceptron
********************
RR09-Shuf-unbiased-E65
----------------------
test.iob2
processed 46435 tokens with 5648 phrases; found: 5566 phrases; correct: 4633.
accuracy: 96.35%; precision: 83.24%; recall: 82.03%; FB1: 82.63
LOC: precision: 86.06%; recall: 87.35%; FB1: 86.70 1693
MISC: precision: 77.39%; recall: 75.07%; FB1: 76.21 681
ORG: precision: 80.23%; recall: 74.29%; FB1: 77.15 1538
PER: precision: 85.55%; recall: 87.51%; FB1: 86.52 1654
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5831 phrases; correct: 5241.
accuracy: 97.85%; precision: 89.88%; recall: 88.20%; FB1: 89.03
LOC: precision: 92.54%; recall: 92.49%; FB1: 92.51 1836
MISC: precision: 89.06%; recall: 82.10%; FB1: 85.44 850
ORG: precision: 84.21%; recall: 81.51%; FB1: 82.83 1298
PER: precision: 91.61%; recall: 91.86%; FB1: 91.73 1847
RR09-Seq-unbiased
-----------------
test.iob2
processed 46435 tokens with 5648 phrases; found: 5569 phrases; correct: 4607.
accuracy: 96.22%; precision: 82.73%; recall: 81.57%; FB1: 82.14
LOC: precision: 86.64%; recall: 86.69%; FB1: 86.66 1669
MISC: precision: 76.13%; recall: 74.50%; FB1: 75.31 687
ORG: precision: 79.19%; recall: 73.99%; FB1: 76.50 1552
PER: precision: 84.83%; recall: 87.14%; FB1: 85.97 1661
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5819 phrases; correct: 5231.
accuracy: 97.81%; precision: 89.90%; recall: 88.03%; FB1: 88.96
LOC: precision: 92.84%; recall: 92.43%; FB1: 92.64 1829
MISC: precision: 89.14%; recall: 81.89%; FB1: 85.36 847
ORG: precision: 84.41%; recall: 81.58%; FB1: 82.97 1296
PER: precision: 91.17%; recall: 91.42%; FB1: 91.30 1847
RR09-Shuffled-biased
--------------------
test.iob2
accuracy: 96.22%; precision: 82.73%; recall: 81.57%; FB1: 82.14
LOC: precision: 86.64%; recall: 86.69%; FB1: 86.66 1669
MISC: precision: 76.13%; recall: 74.50%; FB1: 75.31 687
ORG: precision: 79.19%; recall: 73.99%; FB1: 76.50 1552
PER: precision: 84.83%; recall: 87.14%; FB1: 85.97 1661
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5837 phrases; correct: 5231.
accuracy: 97.78%; precision: 89.62%; recall: 88.03%; FB1: 88.82
LOC: precision: 92.45%; recall: 92.00%; FB1: 92.22 1828
MISC: precision: 88.80%; recall: 82.54%; FB1: 85.55 857
ORG: precision: 84.18%; recall: 81.73%; FB1: 82.94 1302
PER: precision: 91.03%; recall: 91.42%; FB1: 91.22 1850
RR09-Shuffled-unbiased-nopos
----------------------------
test.iob2
processed 46435 tokens with 5648 phrases; found: 5529 phrases; correct: 4631.
accuracy: 96.39%; precision: 83.76%; recall: 81.99%; FB1: 82.87
LOC: precision: 87.18%; recall: 87.23%; FB1: 87.20 1669
MISC: precision: 76.88%; recall: 75.78%; FB1: 76.33 692
ORG: precision: 81.18%; recall: 74.53%; FB1: 77.72 1525
PER: precision: 85.58%; recall: 86.95%; FB1: 86.26 1643
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5789 phrases; correct: 5203.
accuracy: 97.80%; precision: 89.88%; recall: 87.56%; FB1: 88.71
LOC: precision: 93.14%; recall: 91.62%; FB1: 92.37 1807
MISC: precision: 89.14%; recall: 81.89%; FB1: 85.36 847
ORG: precision: 84.85%; recall: 81.43%; FB1: 83.11 1287
PER: precision: 90.53%; recall: 90.83%; FB1: 90.68 1848
RR09-Shuffled-unbiased-nopos
----------------------------
test.iob2
processed 46435 tokens with 5648 phrases; found: 5589 phrases; correct: 4656.
accuracy: 96.38%; precision: 83.31%; recall: 82.44%; FB1: 82.87
LOC: precision: 87.17%; recall: 87.95%; FB1: 87.56 1683
MISC: precision: 77.49%; recall: 75.50%; FB1: 76.48 684
ORG: precision: 79.56%; recall: 74.53%; FB1: 76.97 1556
PER: precision: 85.29%; recall: 87.88%; FB1: 86.57 1666
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5827 phrases; correct: 5221.
accuracy: 97.76%; precision: 89.60%; recall: 87.87%; FB1: 88.72
LOC: precision: 92.87%; recall: 91.51%; FB1: 92.19 1810
MISC: precision: 89.63%; recall: 81.56%; FB1: 85.41 839
ORG: precision: 83.93%; recall: 82.18%; FB1: 83.04 1313
PER: precision: 90.40%; recall: 91.53%; FB1: 90.96 1865
ZJ03-Sequential-biased-E80
--------------------------
test.iob2
processed 46435 tokens with 5648 phrases; found: 5558 phrases; correct: 4611.
accuracy: 96.25%; precision: 82.96%; recall: 81.64%; FB1: 82.30
LOC: precision: 87.21%; recall: 87.11%; FB1: 87.16 1666
MISC: precision: 77.09%; recall: 74.79%; FB1: 75.92 681
ORG: precision: 79.33%; recall: 73.93%; FB1: 76.53 1548
PER: precision: 84.49%; recall: 86.89%; FB1: 85.67 1663
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5822 phrases; correct: 5231.
accuracy: 97.76%; precision: 89.85%; recall: 88.03%; FB1: 88.93
LOC: precision: 92.37%; recall: 92.27%; FB1: 92.32 1835
MISC: precision: 88.98%; recall: 82.32%; FB1: 85.52 853
ORG: precision: 85.05%; recall: 81.43%; FB1: 83.20 1284
PER: precision: 91.08%; recall: 91.48%; FB1: 91.28 1850
ZJ03-Sequential-biased-E70
--------------------------
processed 46435 tokens with 5648 phrases; found: 5561 phrases; correct: 4608.
accuracy: 96.24%; precision: 82.86%; recall: 81.59%; FB1: 82.22
LOC: precision: 86.94%; recall: 86.99%; FB1: 86.96 1669
MISC: precision: 77.27%; recall: 75.07%; FB1: 76.16 682
ORG: precision: 79.51%; recall: 73.81%; FB1: 76.55 1542
PER: precision: 84.17%; recall: 86.83%; FB1: 85.48 1668
processed 51362 tokens with 5942 phrases; found: 5825 phrases; correct: 5234.
accuracy: 97.77%; precision: 89.85%; recall: 88.08%; FB1: 88.96
LOC: precision: 92.42%; recall: 92.27%; FB1: 92.35 1834
MISC: precision: 88.46%; recall: 82.32%; FB1: 85.28 858
ORG: precision: 85.43%; recall: 81.36%; FB1: 83.35 1277
PER: precision: 91.00%; recall: 91.69%; FB1: 91.35 1856
Greedy SVM
**********
ZJ03-Permute-biased-E100-R1e-5-EPH
----------------------------------
test.iob2
processed 46435 tokens with 5648 phrases; found: 5601 phrases; correct: 4741.
accuracy: 96.55%; precision: 84.65%; recall: 83.94%; FB1: 84.29
LOC: precision: 85.46%; recall: 88.43%; FB1: 86.92 1726
MISC: precision: 76.37%; recall: 75.50%; FB1: 75.93 694
ORG: precision: 82.19%; recall: 75.86%; FB1: 78.90 1533
PER: precision: 89.56%; recall: 91.28%; FB1: 90.41 1648
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5860 phrases; correct: 5360.
accuracy: 98.03%; precision: 91.47%; recall: 90.21%; FB1: 90.83
LOC: precision: 91.98%; recall: 94.28%; FB1: 93.12 1883
MISC: precision: 88.49%; recall: 83.41%; FB1: 85.87 869
ORG: precision: 88.02%; recall: 83.30%; FB1: 85.59 1269
PER: precision: 94.73%; recall: 94.57%; FB1: 94.65 1839
RR09-Shuffle-unbiased-E100-R1e-5-EPH
------------------------------------
test.iob2
processed 46435 tokens with 5648 phrases; found: 5622 phrases; correct: 4793.
accuracy: 96.71%; precision: 85.25%; recall: 84.86%; FB1: 85.06
LOC: precision: 86.17%; recall: 88.91%; FB1: 87.52 1721
MISC: precision: 79.46%; recall: 74.93%; FB1: 77.13 662
ORG: precision: 81.98%; recall: 78.87%; FB1: 80.39 1598
PER: precision: 89.82%; recall: 91.16%; FB1: 90.48 1641
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5856 phrases; correct: 5361.
accuracy: 98.03%; precision: 91.55%; recall: 90.22%; FB1: 90.88
LOC: precision: 93.33%; recall: 93.74%; FB1: 93.54 1845
MISC: precision: 89.91%; recall: 83.08%; FB1: 86.36 852
ORG: precision: 86.86%; recall: 84.27%; FB1: 85.54 1301
PER: precision: 93.81%; recall: 94.63%; FB1: 94.22 1858
---------------
repreated run to see the randomization effect of shuffling.
processed 46435 tokens with 5648 phrases; found: 5606 phrases; correct: 4802.
accuracy: 96.69%; precision: 85.66%; recall: 85.02%; FB1: 85.34
LOC: precision: 87.87%; recall: 88.61%; FB1: 88.24 1682
MISC: precision: 77.68%; recall: 75.36%; FB1: 76.50 681
ORG: precision: 81.98%; recall: 79.17%; FB1: 80.55 1604
PER: precision: 90.30%; recall: 91.53%; FB1: 90.91 1639
processed 51362 tokens with 5942 phrases; found: 5864 phrases; correct: 5372.
accuracy: 98.06%; precision: 91.61%; recall: 90.41%; FB1: 91.00
LOC: precision: 93.92%; recall: 93.36%; FB1: 93.64 1826
MISC: precision: 88.98%; recall: 83.19%; FB1: 85.99 862
ORG: precision: 86.79%; recall: 85.23%; FB1: 86.00 1317
PER: precision: 93.98%; recall: 94.84%; FB1: 94.41 1859
RR09-Shuffle-unbiased-E100-R1e-5-EPH
------------------------------------
+ datify
test.iob2
processed 46435 tokens with 5648 phrases; found: 5608 phrases; correct: 4784.
accuracy: 96.66%; precision: 85.31%; recall: 84.70%; FB1: 85.00
LOC: precision: 86.71%; recall: 89.21%; FB1: 87.94 1716
MISC: precision: 78.31%; recall: 75.07%; FB1: 76.65 673
ORG: precision: 82.55%; recall: 78.03%; FB1: 80.22 1570
PER: precision: 89.33%; recall: 91.09%; FB1: 90.20 1649
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5851 phrases; correct: 5350.
accuracy: 98.01%; precision: 91.44%; recall: 90.04%; FB1: 90.73
LOC: precision: 93.59%; recall: 93.74%; FB1: 93.66 1840
MISC: precision: 89.71%; recall: 83.19%; FB1: 86.33 855
ORG: precision: 86.55%; recall: 83.52%; FB1: 85.01 1294
PER: precision: 93.50%; recall: 94.52%; FB1: 94.01 1862
RR09-Shuffle-unbiased-E100-R1e-5-EPH
------------------------------------
- datify
+ higher order bigrams (words and pos)
test.iob2
processed 46435 tokens with 5648 phrases; found: 5615 phrases; correct: 4800.
accuracy: 96.75%; precision: 85.49%; recall: 84.99%; FB1: 85.23
LOC: precision: 86.46%; recall: 89.21%; FB1: 87.81 1721
MISC: precision: 79.25%; recall: 75.07%; FB1: 77.10 665
ORG: precision: 82.37%; recall: 79.05%; FB1: 80.68 1594
PER: precision: 90.03%; recall: 91.03%; FB1: 90.53 1635
dev.iob2
processed 51362 tokens with 5942 phrases; found: 5840 phrases; correct: 5370.
accuracy: 98.07%; precision: 91.95%; recall: 90.37%; FB1: 91.16
LOC: precision: 93.02%; recall: 94.28%; FB1: 93.65 1862
MISC: precision: 90.13%; recall: 82.21%; FB1: 85.99 841
ORG: precision: 87.81%; recall: 84.86%; FB1: 86.31 1296
PER: precision: 94.62%; recall: 94.57%; FB1: 94.60 1841
RR09-Shuffle-unbiased-E100-R1e-5-EPH
------------------------------------
- datify
- higher order bigrams (words and pos)
test.iob2
processed 46435 tokens with 5648 phrases; found: 5599 phrases; correct: 4798.
accuracy: 96.76%; precision: 85.69%; recall: 84.95%; FB1: 85.32
LOC: precision: 86.70%; recall: 89.51%; FB1: 88.08 1722
MISC: precision: 78.54%; recall: 75.07%; FB1: 76.77 671
ORG: precision: 82.55%; recall: 78.03%; FB1: 80.22 1570
PER: precision: 90.59%; recall: 91.65%; FB1: 91.12 1636
dev.iob2
processed input in 12.1059s sec.
processed 51362 tokens with 5942 phrases; found: 5844 phrases; correct: 5362.
accuracy: 98.03%; precision: 91.75%; recall: 90.24%; FB1: 90.99
LOC: precision: 93.45%; recall: 93.90%; FB1: 93.67 1846
MISC: precision: 89.45%; recall: 82.75%; FB1: 85.97 853
ORG: precision: 87.71%; recall: 84.64%; FB1: 86.15 1294
PER: precision: 93.95%; recall: 94.41%; FB1: 94.18 1851
==========
GERMAN NER
==========