Evaluation of IR system
IR is also one of the applications of Natural Language Processing.
Following are the aspects that can be considered while performing the evaluation of the IR system:
- Resources required
- Presentation of documents
- Market evaluation or appealing to the user
- Retrieval speed
- Assistance in constituting queries
- Ability to find required documents
Evaluation is usually done by comparing one system with another.
IR systems can be compared on the basis of a set of documents, set of queries, techniques used, and so on. Metrics used for performance evaluation are Precision, Recall, and F-Measure. Let's learn a bit more about them:
- Precision: It is defined as the proportion of a retrieved set that is relevant.
Precision = |relevant ∩ retrieved| ...
Get Natural Language Processing: Python and NLTK now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
