Check Question Answer Pairs of Images

Instructions

In this task, you are asked to verify 50 question answer pairs for images by clicking on good and bad buttons. For each question answer pair, you need to look at the corresponding image to make sure the question answer pair is not irrelavant to image, unnatural question, wrong answer or vague answer. You may refer to the following examples.

Rule: We have labeled six out of the 50 pairs in each HIT. In order to be accepted, your judgments should match at least four out of six with ours. You won't be able to submit your results until your judgments meet this standard. You can improve your results by going back and update your judgments.

Please contact us if you have any questions about the HITs. Thank you in advance!

Irrelevant to image: Questions that can be answered without the image are Bad.

Unnatural questions: Questions that sounds unnatural are Bad.

Wrong answers: Questions with wrong answers are Bad.

Vague answers: Vague and handwavy answers such as "I don't know.", "Cannot tell.", "Several.", "Maybe it's a dog." and "Somebody." are Bad.

Good answers are correct and clear.

Okay, let's start!

---- Rule of Thumb ----

An average human with good eyesight

should be able to tell a good answer apart from incorrect answers

when shown the question and the image.


What is striped?

Beach umbrella.

Irrelavant to image, unnatural question, wrong answer or vague answer are Bad

Hint: Press z on the keyboard for good Q&A pair and x for bad ones

20%
{% include "simpleamt.html" %}