Assessor - is a person performing on assignmentdevelopers of the search engine an estimation of how much the document found corresponds to the query. Most often assessors are not familiar with information retrieval professionally. Their qualifications are close to the knowledge of average Internet users. One of the first work of the assessors began to use Google in 2003. The Yandex Assessors appeared in 2006.
The order of work of the assessor
Initially, an automatic search is performed, andThe search engine generates a sequence of sites according to their relevance, calculated by the robot. Then the assessor, who at this moment can be located anywhere in the world using a special program and ordinary logic, evaluates the result. A rating scale is developed by each search engine independently. It often contains six or more items. The work of the assessors differs by an error of approximately 5%.
The result of his activity the assessor sends to the headquarterssearch engine, where on the basis of a joint analysis of the data of the search robot and information of the assessor, the final rating of the document is calculated. The result, helped by the assessor, is a significant increase in the objectivity of the evaluation of documents, exclusion from the rating of resources erroneously included in the rating list on the basis of formal characteristics.
All search engines have their own staffassessors who subject to constant rotation. The most suitable assessor is a user who has an average level of knowledge of the Internet. The purpose of the work that he performs is to improve the functioning of search engines so that they answer the questions of the user as accurately as possible.
The assessor must decide whethera keyword to a certain action taken by the user (making a purchase, watching a movie, listening to music) or some data that interests him.
Types of assessments assessor in "Yandex"
The Yandex assessors consistently give two types of evaluations:
1. Preliminary assessment. Does this document refer to pornography and does it contain malicious code. If the answer is "yes," the evaluation of the document is terminated.
2. Relevance assessment. This estimate is non-quantitative. The assessor gives his assessment by assigning a document to any category:
- "Vital" - if it's an official website or an official answer to a question.
- "Useful" is a document containing data that exactly matches the search query.
- "Relevant +" - a document that meets the search query.
- "Relevant" - a document that does not exactly match the search query.
- "Irrelevant" is a document that does not match the search query.
- "Spam" - a document with signs of black optimization (attempts to deceive the search engine).
- "Not about that" - the category that is designedSeparate similar for a robot, but fundamentally different for a person concepts. So, on the search query "Leo Tolstoy", the search engine should not produce documents about complete people and animals as results.
The value of assessor assessments
The work of assessors helps in assessing the degree of accuracy of search and training of the search robot. The assessors are not able to influence the positions occupied by a particular site.
Assessor sites in their work are guided by clear instructions. It has become a rather large and complex document and is constantly updated with new requirements.