Also known as: WikiLingua (wiki_lingua) Β· wiki_lingua Β· WikiLingua wiki_lingua
WikiLingua is a benchmark dataset used to evaluate a large language model's ability to summarize short instructional articles. It is derived from WikiHow-style articles and pairs longer article content with summaries based on the opening sentences of the original steps.
A dataset for evaluating an LLM's ability to summarize short articles. WikiHow, an encyclopedia of articles explaining how to do various tasks, is the human-authored source for both the articles and the summaries. Each entry in the dataset consists of: - An article, which is created by appending each step of the prose (paragraph) version of the numbered list, minus the opening sentence of each step. - A summary of that article, consisting of the opening sentence of each step in the numbered list. For details, see WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization.