Also known as: Boolean Questions (BoolQ) Β· Boolean Questions BoolQ
Boolean Questions, or BoolQ, is a dataset used to evaluate a language model's ability to answer yes-or-no questions. Each example typically includes a question, a supporting passage, and a Boolean answer. It is used in benchmarks for reading comprehension and natural language understanding.
A dataset for evaluating an LLM's proficiency in answering yes-or-no questions. Each of the challenges in the dataset has three components: - A query - A passage implying the answer to the query. - The correct answer, which is either yes or no. For example: - Query: Are there any nuclear power plants in Michigan? - Passage: ...three nuclear power plants supply Michigan with about 30% of its electricity. - Correct answer: Yes Researchers gathered the questions from anonymized, aggregated Google Search queries and then used Wikipedia pages to ground the information. For more information, see BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions. BoolQ is a component of the SuperGLUE ensemble.