persian nlp

IHUBERT: Vector-Based Semantic Deduplication and Domain-Balanced Pretraining for Persian Resources

Researchers present IHUBERT, a monolingual Persian language model pretrained on a 45GB curated subset of the Sepahr-Danesh collection using a multi-stage pipeline that includes vector-database-based semantic deduplication and domain-balanced pretraining. IHUBERT achieves top scores on extractive QA benchmarks PQuAD and ParsiNLU-RC, and best results on FarsTail NLI, while remaining competitive on NER and topic classification.