Caesar AI Atlas

SQuAD

Caesar AI Atlas Definition

SQuAD, the Stanford Question Answering Dataset, is a benchmark dataset for machine reading comprehension and question answering. It contains questions based on Wikipedia passages and includes both answerable and, in later versions, intentionally unanswerable questions.

Other Definitions

SQuAD Source

Acronym for Stanford Question Answering Dataset , introduced in the paper SQuAD: 100,000+ Questions for Machine Comprehension of Text. The questions in this dataset come from people posing questions about Wikipedia articles. Some of the questions in SQuAD have answers, but other questions intentionally don't have answers. Therefore, you can use SQuAD to evaluate an LLM's ability to do both of the following: - Answer questions that can be answered. - Identify questions that cannot be answered. Exact match in combination with F~1~ are the most common metrics for evaluating LLMs against SQuAD.

Related Terms