Outline

1. Precision, recall, and the F-measure (see Section 8.3 – “Evaluation of unranked retrieval sets” in the course book)
2. Precision-recall curve, and the mean average precision (MAP) (see Section 8.4 – “Evaluation of ranked retrieval results” in the course book)
3. Interjudge agreement, and the kappa statistic (see Section 8.5 – “Assessing relevance” in the course book)

Exercises