Also known as: Typologically Diverse Question Answering (TyDi QA) · TyDi QA · Typologically Diverse Question Answering TyDi QA
Typologically Diverse Question Answering (TyDi QA) — это benchmark для оценки question-answering systems на лингвистически разнообразных языках. Он предназначен для проверки того, способны ли модели работать с разнообразными языковыми структурами за пределами English-centric datasets.
A large dataset for evaluating an LLM's proficiency in answering questions. The dataset contains question and answer pairs in many languages. For details, see TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages.