Also known as: Precision At K (precision@k) · precision@k · Precision At K precision@k
Precision@k измеряет долю первых k элементов ранжированного списка, которые являются релевантными. Она широко используется для оценки систем поиска, рекомендаций, retrieval и ранжирования.
A metric for evaluating a ranked (ordered) list of items. Precision at k identifies the fraction of the first k items in that list that are "relevant." That is: \\\\\\[\\\\precision at k\ = \\\\\\\\relevant items in first k items of the list\\ \\\\\k\\\\\\\\] The value of k must be less than or equal to the length of the returned list. Note that the length of the returned list is not part of the calculation. Relevance is often subjective; even expert human evaluators often disagree on which items are relevant. Compare with: - average precision at k - mean average precision at k Suppose a large language model is given the following query: And the large language model returns the list shown in the first two columns of the following table: Movie --- The General Mean Girls Platoon Bridesmaids Citizen Kane This is Spinal Tap Two of the first three movies are relevant, so precision at 3 is: Three of the first five movies are very funny, so precision at 5 is: