1.1 Sub-corpora

1.1 Sub-corpora

Based on the annotation of the languages per chat, different sub-corpora were created.

The following basic considerations were applied when creating the sub-corpora:

Definitions for sub-corpora

Each chat was to be assigned to only one language-sub-corpus.
Additionally, we differentiate between chats where we have demographic information for all participants and those where we do not. In the former case, the sub-corpus gets the extension _DEMOG.
Where additional tasks were performed on individual chats (e.g. normalization or part-of-speech tagging) we created additional sub-corpora per language.

Main sub-corpora

WUS: All data, i.e. the whole corpus
WUS_DEU: All data where non-dialectal German provides the most messages
WUS_DEU_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
WUS_FRA: All data where French provides the most messages
WUS_FRA_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
WUS_GSW: All data where dialectal German provides the most messages
WUS_GSW_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
WUS_ITA: All data where Italian provides the most messages
WUS_ITA_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
WUS_ROH: All data where Romansh provides the most messages
WUS_ROH_DEMOG: A subgroup thereof where we have demographic information from all communication partners.

Additionally to these corpora, you also see corpora with lowercase letters in the browser (e.g. deu-rftagged, ita-tagged, roh etc.). These corpora contain data from our SMS project.

Smaller corpora

Next to these main sub-corpora, there are some smaller sub-corpora:

WUS_SMALL: Chats that are either smaller than 100 messages or where the majority of messages are not in a national language.
WUS_SMALL_DEMOG: A subgroup thereof where we have demographic information from all communication partners.
WUSdemographics: Only demographic data per person. This sub-corpus is much faster if you want to look up demographic data only.
WUS_ARGDROP and WUS_ARGDROP_language: Sub-corpora for which argument drop has been manually annotated. For the architecture of the annotations and scientific considerations behind it see Stuntebeck, Franziska (2018): "Annotating Argument Drop in the Swiss WhatsApp Corpus". In: Generative Grammar in Geneva (GG@G) XI, 175-187.

Other corpora in the browsing tool