Anda di halaman 1dari 8

Relevance Name Address

Analyst Market Task Type Pin Accuracy


Rating Accuracy Accuracy
43705-114 en_IN Search 2.0 Good Partially CorreIncorrect Perfect
43705-114 en_IN Search 2.0 Excellent Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Good Flag Flag Flag
43705-114 en_IN Search 2.0 Acceptable Correct Incorrect Wrong
43705-114 en_IN Search 2.0 Excellent Partially CorreCorrect Perfect
43705-114 en_IN Search 2.0 Bad Flag Flag Flag
43705-114 en_IN Search 2.0 Bad Flag Flag Flag
43705-114 en_IN Search 2.0 Bad n/a Correct Perfect
43705-114 en_IN Search 2.0 Good Correct Correct Perfect
43705-114 en_IN Search 2.0 Navigational Partially CorreIncorrect Perfect
43705-114 en_IN Search 2.0 Excellent Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Acceptable Flag Flag Flag
43705-114 en_IN Search 2.0 Bad Flag Flag Flag
43705-114 en_IN Search 2.0 Good Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Bad n/a Correct Perfect
43705-114 en_IN Search 2.0 Navigational Correct Incorrect Wrong
43705-114 en_IN Search 2.0 Bad Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Bad Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Bad Correct Correct Perfect
43705-114 en_IN Search 2.0 Bad Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Bad Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Navigational Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Bad n/a Correct Perfect
43705-114 en_IN Search 2.0 Bad Correct Correct Wrong
43705-114 en_IN Search 2.0 Bad Correct Correct Perfect
43705-114 en_IN Search 2.0 Bad Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Bad Partially CorreIncorrect Wrong
43705-114 en_IN Search 2.0 Bad Correct Correct Wrong
43705-114 en_IN Search 2.0 Bad Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Bad Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Navigational n/a Correct Perfect
43705-114 en_IN Search 2.0 Bad Flag Flag Flag
43705-114 en_IN Search 2.0 Excellent Correct Incorrect Perfect
43705-114 en_IN Search 2.0 Bad Correct Incorrect Wrong
43705-114 en_IN Search 2.0 Bad Correct Incorrect Next Door
43705-114 en_IN Search 2.0 Acceptable Flag Flag Flag
43705-114 en_IN Search 2.0 Bad n/a Correct Perfect
43705-114 en_IN Search 2.0 Bad n/a Correct Perfect
43705-114 en_IN Search 2.0 Navigational n/a Correct Perfect
43705-114 en_IN Search 2.0 Bad n/a Incorrect Perfect
Comment Comment Comment
Analyst Comment Required? Missing? Length Comment Rating
Result is excellent match to qu Yes OK 233 fail
Result is an ATM and saitsfy u Yes OK 164 fail
Research shows that there is no Yes OK 122 n/a
Relevance is demoted for distan Yes OK 227 fail
Result is a shoe shop and excell Yes OK 149 fail
Official site shows that there i Yes OK 172 n/a
Official website shows that ther Yes OK 171 n/a
Result is an address and bad ma Yes OK 51 fail
Result satisfy user's transit inte Yes OK 64 pass
Result is the required train sta Yes OK 142 fail
Result is a match to query and Yes OK 140 fail
Research shows that there is no Yes OK 120 n/a
Research shows that there is no s Yes OK 127 n/a
Result is a match to query. Rel Yes OK 129 fail
Result is bad match to query int Yes OK 36 fail
Result is excellent match to que Yes OK 358 fail
Result is not the requested hos Yes OK 117
Result is not the requested hosp Yes OK 86
Result is not the requested hosp Yes OK 37
Result is not the requested hos Yes OK 318
Result is not the requested hosp Yes OK 69
Result is the request POI and sa Yes OK 205
Result is a village and bad matc Yes OK 43
Result is not the required hotel Yes OK 92
Result is not the required hotel. Yes OK 33
Result is not the required hotel Yes OK 158
Result is not the required hote Yes OK 104
Result is not the required hotel Yes OK 91
Result is not the required toll Yes OK 135
Result is not the required toll Yes OK 144
Result is the required city. No OK 28
There is no proof that this busin Yes OK 111
Result is excellent match to pos Yes OK 241
Result is bad match to query. C Yes OK 145
Result is bad match to query. C Yes OK 95
Research shows that there is no s Yes OK 123
Result is a locality and bad matc Yes OK 67
Result is the street and it doesn' Yes OK 87
Result is the capital of state Ma No OK 71
Result is bad match to a transit Yes OK 59
Notes
Details of the user intent is missing.
Details of incorrect address components

Details of the location intent and real world results are missing. Details of incorrect address components are pres
The comments state the correct name in case of data inaccuracy but no sources were added to support your ratin

The comment neither states the user intent nor does it explain the demotion.

Details of incorrect address components are present but source URL to support the ratings is missing. Also pin de
Details of incorrect address components are present but source URL to support the ratings is missing.

Details of the location intent and real world results are missing. Details of incorrect address components are pres
Details of the user intent is missing. Also the demotion wasn’t explained. The analyst didn’t state why the result d
Details of incorrect address components are present but source URL to support the ratings is missing. Also pin de
Please review 10-15 comments in total
For each task, please rate the quality of the comment
For each task, please leave a short note to support your rating (e.g. highlight what is missing, why it is a good com
and real world results are missing. Details of incorrect address components are present but source URL to support the ratin
ect name in case of data inaccuracy but no sources were added to support your ratings. Also the name demotion wasn’t exp

the user intent nor does it explain the demotion.

components are present but source URL to support the ratings is missing. Also pin demotion wasn’t explained.
components are present but source URL to support the ratings is missing.

and real world results are missing. Details of incorrect address components are present but source URL to support the ratin
missing. Also the demotion wasn’t explained. The analyst didn’t state why the result doesn’t matches the query.
components are present but source URL to support the ratings is missing. Also pin demotion wasn’t explained.
Category Relevance
pass 1
minor issue 0
fail 10
n/a 5

Score 9%
Summary:

The comments provided by the analyst are not meeting the requirements.
For relevance, most of the times, the details of the user intent was missing. When results
are demoted for distance, the analyst didn’t provide details of the location intent and
real world results.
For data accuracy ratings like name and address, the analyst mentions details of the
correct name and address components but doesn’t links research/sources to support
their ratings.
Correct pin co-ordinates were added but pin demotions weren’t explained.

Feedback for analyst:


Dear,

During a recent review of your work on the Map Analyst Program, we came across a few
mistakes that we would like to share with you in order to help you improve the quality of
your work. Please review this feedback carefully and come back to us with any questions
you may have.

Please see below the findings of our review:


Comments:
Thank you so much for your hard work on this program. We appreciate your efforts.
However, there are some issue with your comments which we’d like to bring to your
attention.

For relevance, most of the times, the details of the user intent was missing. The user
intent should always be clear by reading your comments. Also in some of the cases you
did not explain your demotions.
Whenever the results were demoted for distance, you did not provided details of the
location intent and real world results.

For data accuracy ratings like name and address, you seem to be providing information
like correct name and details of Incorrect/missing address components but you didn’t
add sources to support your ratings.
Please keep in mind that in the absence of an official source, you need at-least two
secondary sources to verify data accuracy. Please make sure to leave sources in your
comments so that a reviewer won’t have to re-do your research.

Also pin demotions need to be explained whenever pin is rated anything less than
perfect.
Was it rated approximate because the pin was falling on the shared parking lot? Was it
due to Half n Half rule? Please remember to state your reasoning for any demotions.

Please refer to this document in order to understand how to write helpful comments:
https://tinyurl.com/yy4c4s44
0

Anda mungkin juga menyukai