1.1 Sub-corpora

Based on the annotation of the languages per chat, different sub-corpora were created.

The following basic considerations were applied when creating the sub-corpora:

Definitions for sub-corpora

• Each chat was to be assigned to only one language-sub-corpus.
• Additionally, we differentiate between chats where we have demographic information for all participants and those where we do not. In the former case, the sub-corpus gets the extension _DEMOG.
• Where additional tasks were performed on individual chats (e.g. normalization or part-of-speech tagging) we created additional sub-corpora per language.

Main sub-corpora

• WUS: All data, i.e. the whole corpus
• WUS_DEU: All data where non-dialectal German provides the most messages
• WUS_DEU_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
• WUS_FRA: All data where French provides the most messages
• WUS_FRA_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
• WUS_GSW: All data where dialectal German provides the most messages
• WUS_GSW_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
• WUS_ITA: All data where Italian provides the most messages
• WUS_ITA_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
• WUS_ROH: All data where Romansh provides the most messages
• WUS_ROH_DEMOG: A subgroup thereof where we have demographic information from all communication partners.

Additionally to these corpora, you also see corpora with lowercase letters in the browser (e.g. deu-rftagged, ita-tagged, roh etc.). These corpora contain data from our .

Smaller corpora

Next to these main sub-corpora, there are some smaller sub-corpora:

• WUS_SMALL: Chats that are either smaller than 100 messages or where the majority of messages are not in a national language.
• WUS_SMALL_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
• WUSdemographics: Only demographic data per person. This sub-corpus is much faster if you want to look up demographic data only.
• WUS_ARGDROP and WUS_ARGDROP_language: Sub-corpora for which argument drop has been manually annotated. For the architecture of the annotations and scientific considerations behind it see

Other corpora in the browsing tool

Additionally to these corpora, you also see corpora with lowercase letters in the browser (e.g. deu-rftagged, ita-tagged, roh etc.). These corpora contain data from our .

More information about the subcorpora

The individual sub-corpora are well documented in terms of size etc. within the browsing tool. Check the according for more information.