Dear All,

For those who took the time out to answer 'Akin [Qualification Test] 'assignment yesterday, thank you very much.

We had stated a Turker needed to answer 20 questions before being awarded a qualification. But most of you couldn't get to 20 HITs before they were taken up by someone else. Our apologies - we should have designed the HIT better. We are working on fixing it - so you are likely to see a similar qualification test but with 20 questions in the same HIT rather than individual ones.

We are grateful that quite a few of you took the time out to reach out to us and we responded via email to each one of you.

We wish to make it clear that we never intended to approve/reject workers within MTurk based on the responses and affect their history on MTurk. As a matter of fact, all the results have been approved and each one of you should have received a notification confirming such. We will award a custom qualification though based on the accuracy for all those workers who answered >15 HITs in the same category. If the accuracy of someone’s test is high, those workers can take up our future assignments which will be paid ones. For those who couldn't, there will be a new one up as soon as we have fixed the layout.

Hope this clarifies the confusion our qualification test created.

We appreciate the efforts of the Turker community and look forward to working together.

Best,
Akin Team

 

:wave: thanks for reaching out.

Most definitely will. A lot of terminology can get mixed up between requesters/workers, I remember seeing someone discussing these HITs wondering if they'd get rejected for not getting to 20 (which, as y'all figured out, can be kinda difficult for workers to do on such a competitive platform haha) so definitely appreciate y'all dropping by to clarify :)

 

Like me seeing it paid $0.00 and wondering about rejection. sorry I had a bad experience with some requester posting $0.00. glad you are here to clarify about rejection.

 

Thanks for posting. I tried to do one of your quals yesterday and was only able to catch 11 of them. I did not think you would reject, but I figured there was no point in trying to qualify on the other characteristics since I had no way of knowing whether I'd manage to do 20 of them. I am looking forward to seeing the redesigned HIT when it is posted.
I did not email you because I knew of at least 3 people who were doing so, and I figured you would be swamped in emails. Thanks for being so responsive.

 

wrong thread, whoops!

 

Thank you very much all. We have just posted a new HIT where all 20 questions are on the same screen. Let us know, should you face any problems.

 

I looked it up, and went to click on it and it said there were no more left. Now I don't see any when I search. Guess they got snatched up really quickly?

 

Potentially, yes. But we will post 3 more , similar to the one for a different trait, over the next 24 hours. Wanted to make sure that people didn't face any challenges with this one.

 

That's good to know.

 

Thanks :)

 

Thank you to all those who responded. Appreciate it!

 

Yeah, I definitely lost mine to the timer.

 

Keen to know why that might be the case. Did going through the instructions take time or did you get distracted with something etc etc?

 

Oh, I caught it but didn't realize the timer was 10 minutes, and I went to finish something I was working on before doing the qual.

 

Okay

 

I may be too late on this one, but I'm certainly going to try to catch the other three.

 

More qualification tests posted.

 

Yesterday, IIRC, you said we needed 80% correct to receive the qual. This time, the HIT said the qual would be granted to people who finish in the top 20%. Have the criteria changed, or do I remember yesterday's incorrectly?