MTEB: Massive Text Embedding Benchmark

Crosslingual Generalization through Multitask Finetuning

EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural language processing. Stay updated on the latest in machine learning, deep learning, and natural language processing with code included. ⭐ support NLP!

Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023

[EMNLP 2023] The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation

This repo supports various cross-lingual transfer learning & multilingual NLP models.

Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".

This repository contains the code, data, and models of the paper titled "CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs" published in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), July 9-14, 2023.

TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages

Code for "Preference Tuning For Toxicity Mitigation Generalizes Across Languages." Paper accepted at Findings of EMNLP 2024

Official codebase for the ACL 2025 Findings paper: Optimized Text Embedding Models and Benchmarks for Amharic Passage Retrieval.

Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.

🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment

On Bilingual Lexicon Induction with Large Language Models (EMNLP 2023). Keywords: Bilingual Lexicon Induction, Word Translation, Large Language Models, LLMs.

Cross Lingual Language models for making search engines for Holy Quran and Sahih Hadiths

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

[EMNLP 2022] Discovering Language-neutral Sub-networks in Multilingual Language Models.

Winning Solution for the Bangla Complex Named Entity Recognition Challenge - BDOSN NLP Hackathon 2023

M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis

MaLA-500: Massive Language Adaptation of Large Language Models