Grammatical Error Correction (GEC) is the task of correcting grammatical mistakes in a sentence.
| Error | Corrected |
|---|---|
| She see Tom is catched by policeman in park at last night. | She saw Tom caught by a policeman in the park last night. |
CoNLL-14 benchmark is done on the test split of NUS Corpus of Learner English/NUCLE dataset. CoNLL-2014 test set contains 1,312 english sentences with grammatical error correction annotations by 2 annotators. Models are evaluated with F-score with β=0.5 which weighs precision twice as recall.
{% include table.html results=site.data.grammatical_error_correction.CoNLL_2014 scores='F0.5' %}
{% include chart.html results=site.data.grammatical_error_correction.CoNLL_2014 score='F0.5' %}
Bryant and Ng 2015 used 10 annotators to do grammatical error correction on CoNll-14's 1312 sentences.
{% include table.html results=site.data.grammatical_error_correction.CoNLL_2014_10_Annotators scores='F0.5' %}
{% include chart.html results=site.data.grammatical_error_correction.CoNLL_2014_10_Annotators score='F0.5' %}
JFLEG corpus by Napoles et al., 2017 consists of 1,511 english sentences with annotations. Models are evaluated with GLEU metric.
{% include table.html results=site.data.grammatical_error_correction.JFLEG scores='GLEU' %}
{% include chart.html results=site.data.grammatical_error_correction.JFLEG score='GLEU' %}