Also known as: RTE
Recognizing Textual Entailment (RTE) — benchmark-задача и dataset для оценки того, можно ли логически вывести гипотезу из passage. Каждый пример обычно содержит passage, гипотезу и label, показывающий, выполняется ли entailment.
A dataset for evaluating an LLM's ability to determine whether a hypothesis can be entailed (logically drawn) from a text passage. Each example in an RTE evaluation consists of three parts: - A passage, typically from news or Wikipedia articles - A hypothesis - The correct answer, which is either: - True, meaning the hypothesis can be entailed from the passage - False, meaning the hypothesis can't be entailed from the passage For example: - Passage: The Euro is the currency of the European Union. - Hypothesis: France uses the Euro as currency. - Entailment: True, because France is part of the European Union. RTE is a component of the SuperGLUE ensemble.