Caesar AI Atlas

SQuAD

Caesar AI Atlas Definition

SQuAD, Stanford Question Answering Dataset, — benchmark dataset для машинного понимания прочитанного и ответов на вопросы. Он содержит вопросы на основе фрагментов Wikipedia и включает как вопросы с ответами, так и, в более поздних версиях, намеренно неотвечаемые вопросы.

Other Definitions

SQuAD Source

Acronym for Stanford Question Answering Dataset , introduced in the paper SQuAD: 100,000+ Questions for Machine Comprehension of Text. The questions in this dataset come from people posing questions about Wikipedia articles. Some of the questions in SQuAD have answers, but other questions intentionally don't have answers. Therefore, you can use SQuAD to evaluate an LLM's ability to do both of the following: - Answer questions that can be answered. - Identify questions that cannot be answered. Exact match in combination with F~1~ are the most common metrics for evaluating LLMs against SQuAD.

Related Terms