subtopic

Retrieval score, correctness, faithfulness and refusals

Run all 50 questions and score in two parts so you know where problems come from: Retrieval — was the correct page in the top 5 (hit@5)? Generation — is the answer correct (LLM judge comparing with your answer), is every sentence supported by the retrieved text (faithfulness), and did it refuse the 5 unanswerable ones? Check 15 judge decisions yourself.

Builds on: 4.7 Evaluate