Skip to content

Latest commit

 

History

History
165 lines (118 loc) · 12.3 KB

File metadata and controls

165 lines (118 loc) · 12.3 KB

awesome-ukrainian-nlp

Curated list of Ukrainian natural language processing (NLP) resources (corpora, pretrained models, libriaries, etc.)

News

1. Datasets / Corpora

Monolingual

  • Kobza — around 1.3TB of uncompressed text, 60 billion tokens across 97 million documents, deduplicated compilation of CulturaX, Fineweb 2, HPLT 2.0, Ukrainian News and UberText 2.0.
  • Malyuk — 113GB of text, compilation of UberText 2.0, OSCAR, Ukrainian News.
  • Brown-UK — carefully curated corpus of modern Ukrainian language with dismabiguated tokens, 1 million words
  • UberText 2.0 — over 5 GB of news, Wikipedia, social, fiction, and legal texts
  • Wikipedia
  • OSCAR — shuffled sentences extracted from Common Crawl and classified with a language detection model. Ukrainian portion of it is 28GB deduplicated.
  • CC-100 — documents extracted from Common Crawl, automatically classified and filtered. Ukrainian part is 200M sentences or 10GB of deduplicated text.
  • mC4 — filtered CommonCrawl again, 196GB of Ukrainian text.
  • Ukrainian Twitter corpus - Ukrainian Twitter corpus for toxic text detection.
  • Ukrainian forums — 250k sentences scraped from forums.
  • Ukrainain news headlines — 3.98M news headlines.
  • STQ-UA — 100k Ukrainian search queries.

Parallel

See Helsinki-NLP/UkrainianLT for more data and machine translation resources links.

Labeled

Dictionaries

Prompts

  • Aya — crowd-sourced prompts and reference outputs. Ukrainian part is ~500 prompts.

2. Tools

  • tree_stem — stemmer
  • pymorphy2 + pymorphy2-dicts-uk — POS tagger and lemmatizer
  • LanguageTool — grammar, style and spell checker
  • Stanza — Python package for tokenization, multi-word-tokenization, lemmatization, POS, dependency parsing, NER
  • nlp-uk — Tools for cleaning and normalizing texts, tokenization, lemmatization, POS, disambiguation
  • NLP-Cube - Python package for tokenization, sentence splitting, multi-word-tokenization, lemmatization, part-of-speech tagging and dependency parsing.

3. Pretrained models

Language models

Autoregressive:

  • Lapa — Gemma-3-12B-based Ukrainian LLM, along with training datasets

  • MamayLM v0.1 - Ukrainian-focused Gemma 2 based 9B model, pre-trained and fine-tuned on large Ukrainian/English corpora (blog in Ukrainian and English)

  • MamayLM v1.0 - Ukrainian-focused Gemma 3 based 4B and 12B multimodal models, pre-trained and fine-tuned on large Ukrainian/English corpora (blog)

  • aya-101 — massively multilingual LM, 13B parameters

  • pythia-uk — mT5 finetuned on wiki and oasst1 for chats in Ukrainian.

  • UAlpaca — Llama fine-tuned for instruction following on the machine-translated Alpaca dataset.

  • XGLM — multilingual autoregressive LM, the 4.5B checkpoint includes Ukrainian.

  • Tereveni-AI/GPT-2

  • uk4b and haloop inference toolkit - GPT-2 small, medium and large-style models trained on UberText 2.0 wikipedia, news and books.

Masked:

Mixed:

Machine translation

See Helsinki-NLP/ UkrainianLT for more.

Sequence-to-sequence models

Named-entity recognition (NER)

Part-of-speech tagging (POS)

Word embeddings

Other

4. Paid

5. Other resources and links

6. Workshops and conferences