LORELEI Somali Representative Language Pack - Monolingual and Parallel Text

Resource

URL

https://dss2.princeton.edu/data/305/

Blurb

Comprised of approximately 13 million words of monolingual Somali text, approximately 800,000 of which are translated into English. Another 100,000 words are also translated from English into Somali.  Data was collected in the following genres: discussion forums, news, reference, social network and weblog. Both monolingual text collection and parallel text creation involved a combination of manual and automatic methods, which are detailed in the included documentation. All harvested content was initially converted from its original HTML form into a relatively uniform XML format.  XML data is presented in two formats: a "homogenized" XML format that preserves the minimum set of tags needed to represent the structure of the relevant text as seen by the human web-page reader and a fully segmented and tokenized version of the text. All text data is encoded as UTF-8. Also included in this release are two tools: one to recreate original source data from the processed XML material and the other to condition text data users download from Twitter.

Link time

2020-05-22 18:35:00 UTC

Sample

Principal investigator

Producer

Distributor

Version

More detail URL

Resource type

Single study

Subjects

• Art & Culture

Regions

• Africa

Countries

• Somalia