Hysen Labs
Open-source project
dialogue-evaluation/morphoRuEval-2017 avatar
dialogue-evaluation

morphoRuEval-2017

morphoRuEval-2017

50 stars11 forksPythonNOASSERTION
01
DEEP OPEN-SOURCE ANALYSIS

morphoRuEval-2017: everything from a shared task

A single page collecting the tools, papers, and presentations from the 2017 Russian morphology evaluation, plus corpus releases such as RNC and OpenCorpora in UD form.

02
DEEP OPEN-SOURCE ANALYSIS

Team tools

The top of the README lists open source tools from the participating teams, each with a repository link: team K's XMorphy, team B's MorphoRuEval2017, team I's MorphoRuEval, team F's MorphoRuEval2017, team M's MorphoBabushka, team O's morphoRuEval, and team E's rnnmorph, the last one flagged as an open source variant with changes. It is effectively a directory of who shipped what for the shared task, and because each entry carries its own repo link, following up on any one of them is straightforward.

03
DEEP OPEN-SOURCE ANALYSIS

Papers and talks

A papers section links the organizers' paper and the system papers, including Morphobabushka, ABBYY, iqmen, and Sagteam, all hosted on the dialog-21 conference site, with the Sagteam paper also on the fruct.org publications page. A separate presentations section covers the talks from Iqmen, Sagteam, MSU-1, ABBYY, and Morphobabushka as hosted PDF files. Between the two lists, the published record of the evaluation is easy to trace, which is useful if you want to see both the task writeup and each system's own explanation.

04
DEEP OPEN-SOURCE ANALYSIS

Corpora

Two corpus resources round out the page. The Russian National Corpus is available in a universal dependency version, with a license to sign before use, and OpenCorpora ships as a UD archive. The license step for the RNC version is called out explicitly, so the page is honest about what you need to accept before using that data. Together with the tools and papers, the repository assembles the shared task's public artifacts in one place, which is more than most evaluation pages bother to do.

06
DEEP OPEN-SOURCE ANALYSIS

Official sources

07
Community notes

Community notes