1/27 - My Toes are Freezing Thursday!

New ash hole to block: Human-Centered-Computing Research Group

I got this email:

Thank you for your request regarding the recent rejection of your participation in our experiment. We value your feedback and those of other requesters, as we are constantly striving to improve our procedures in conducting a study on Mechanical Turk. We recently started to use MTurk in our research and value the platform's opportunities and its workers as you provide.

We have reviewed your case again. We are very sorry that we are not able to change our decision. Our study investigates the effects of certain stimuli on the decision process of individuals. We included the comprehension questions to ensure that participants' answers reflected their actual decision-making. We assumed that only if participants understand the details of the scenario, study results are valid.

Before posting the study, we reviewed the extensive recommendations about using Mechanical Turk as a research platform. Thus, we incorporated many best practices to minimize adverse effects for participants.

In your case, unfortunately, the comprehension questions were not correct. Therefore, we could not take your submission into account in our study. Still, we distinguished between participants with minor comprehension mistakes and people who answered all questions wrongly.

You participated in the whole study; thus, we decided on a reduced compensation. Unfortunately, Amazon does not offer a way to accept an assignment without paying the full compensation; therefore, we decided for a bonus payment. We understand that the bonus payment with a rejection is unusual. However, we are also aware of the importance of acceptance rates on the platform.

We are very sorry for the inconvenience we might have caused, but, again, we could not realize our payment policy in any other way.

We appreciate your feedback. We hope our answer was somehow helpful in explaining our reasoning. In the future, we will emphasize the upcoming comprehension questions more clearly and explain our procedure of rejections in more detail.

If you have any additional ideas on making our studies better, please share your thoughts. Your support is very much appreciated.

Best regards,
Peter Sörries


Alright, gang, what we gonna do?

 

Shi Jia [A2LXH4KRQ79RE5] 2-3 minute Academic Study on Public Opinion, 0.25 - $0.25 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Underpaid[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $4.64 / hour
00:03:14 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]


Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs > 0; HIT approval rate (%) >= 95; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read Shi Jia's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1350561" data-reviewerId="6894" |[/div]

 

You've received a bonus from Maya Balakrishnan for work related to 309D674SI8HSV1FBOVIS2D0O17XBCY.

The value of your bonus is: $4.96 USD

The Requester included this note:
For demand forecasting performance

 

Sam [A3HOXGDFSFPE3Z] 5-8 minutes survey comparing human and algorithms for a recruitment task. - $1.30 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Unrated[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $35.73 / hour
00:02:11 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]


Catchability: Okay (HIT Last Seen: 8 minutes ago)
Qualifications: Total approved HITs > 500; HIT approval rate (%) > 98; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read Sam's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1350565" data-reviewerId="37373" |[/div]

 

Sam [A3HOXGDFSFPE3Z] 5-8 minutes survey comparing human and algorithms for a recruitment task. - $1.30 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $45.44 / hour
00:01:43 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]


Catchability: Okay (HIT Last Seen: 11 minutes ago)
Qualifications: Total approved HITs > 500; HIT approval rate (%) > 98; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read Sam's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1350566" data-reviewerId="239" |[/div]

 

Yphtach Lelkes [A3QABKQPGF9OKF] Quick Survey about Attitudes(~ 7 minutes) - $1.50 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Good[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
<24 hours[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $17.31 / hour
00:05:12 / completion time[/div]
[/div]

Approved! ​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]


Catchability: Great (HIT Last Seen: 53 seconds ago)
Qualifications: Exc: [979605637-343119] DoesNotExist ; Total approved HITs >= 1000; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;
[div] style="margin-top: 5px;" |

To read Yphtach Lelkes's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1350568" data-reviewerId="6894" |[/div]

 

You've received a bonus from Maya Balakrishnan for work related to 309D674SI8HSV1FBOVIS2D0O17XBCY.
The value of your bonus is: $5.98 USD

 

Morning randoms. Hope your day will find your pockets filled with at least some mturk pennies lol.

 

I got another boiler plate email in reply to my response. Looks like these douches were planning to do this.

 

Morning!!

 

Title: 5-8 minutes survey comparing human and algorithms for a recruitment task. | PANDA
Requester: Sam [A3HOXGDFSFPE3Z]
TurkerView: [ $22.34 / hour ]
Description: This is a short survey - around 5-8 minutes - comparing preferences between humans and AI for recruitment.
Duration: 30 Min
Available: 1
Reward: $1.30
Qualifications:

• Total approved HITs GreaterThan 500
• HIT approval rate (%) GreaterThan 98
• Location EqualTo US

[3C2UN3Y7UJLRF8HXUVZJMHHMP0PFMC]​

 

PickFu [AI2HRFAYYSAW7] Compare 2 options, 1 written response - $0.13 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Low[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $6.78 / hour
00:01:09 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]


Catchability: Okay (HIT Last Seen: 2 minutes ago)
Qualifications: PickFu NDA EqualTo 1; TWL >= 10; Location EqualTo US; Amazon Prime Membership In 1;
[div] style="margin-top: 5px;" |

To read PickFu's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1350570" data-reviewerId="12043" |[/div]

 

UMD Linguistics Research Group [A2DK3VTMC9CF32] "Slub": Judge English sentences as good or bad! - $2.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Unrated[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $13.31 / hour
00:09:01 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]


Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Prevent retake (AS) DoesNotExist ; Test for native proficiency in American English, v2.0 >= 7; HIT approval rate (%) >= 95; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read UMD Linguistics Research Group's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1350572" data-reviewerId="1439" |[/div]

 

AMPP Lab [A1I3K30RNQV106] Personality, Thoughts, and Mental Health (~ 60 minutes) - $2.50 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Underpaid[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $7.75 / hour
00:19:21 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]


Catchability: Great (HIT Last Seen: 2 minutes ago)
Qualifications: Total approved HITs >= 50; Exc: [1919574841-342901] DoesNotExist ; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;
[div] style="margin-top: 5px;" |

To read AMPP Lab's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1350574" data-reviewerId="35309" |[/div]

 

Raghunath Rao [A3F5WBEGP46X5Y] Second Part of a two part study on consumer attitudes (UP-2)(~ 10 minutes) - $0.65 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $55.71 / hour
00:00:42 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]


Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Inc: [343555-342980] Exists ; HIT approval rate (%) >= 95; Exc: [343569-342980] DoesNotExist ; Location In US;
[div] style="margin-top: 5px;" |

To read Raghunath Rao's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1350575" data-reviewerId="35309" |[/div]

 

When you don't want your cat's toes to freeze.

 

They paid me, but I spent 13.5 minutes on the HIT. Maybe it was due to time?

 

Greetings from Amazon Mechanical Turk,

You've received a bonus from National University of Singapore for work related to 3SCKNODZ17N334314Q5OXA7Z82QN74.
The value of your bonus is: $10.90 USD

The Requester included this note:
Thank you for your careful work on our HIT.

Greetings from Amazon Mechanical Turk,

You've received a bonus from Maya Balakrishnan for work related to 309D674SI8HSV1FBOVIS2D0O17XBCY.
The value of your bonus is: $4.57 USD

The Requester included this note:
For demand forecasting performance

 

Title: survey for los angeles dodgers fans only (~ 5 minutes) | PANDA
Requester: Joseph [A1RUWGBC9JVTM7]
TurkerView: [ $19.63 / hour ]
Description: Please only participate if you are a dodgers fan
Duration: 30 Min
Available: 2
Reward: $1.00
Qualifications:

• Exc: [340860352-343208] DoesNotExist
• HIT approval rate (%) GreaterThanOrEqualTo 94
• CR Research Group #1 GreaterThanOrEqualTo 100
• Location In US

[34VDM42TQZOFDRMIQDNKPDJ1NWS9IC]​

 

Johanna Staehler [A2K79FE14INFA4] Personality and Sports(~ 10 minutes) - $1.50 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $23.79 / hour
00:03:47 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]


Catchability: Great (HIT Last Seen: one minute ago)
Qualifications: Total approved HITs >= 100; Exc: [10921153-343209] DoesNotExist ; HIT approval rate (%) >= 90; CR Research Group #1 >= 100; SurveyGroup [5957] DoesNotExist ;
[div] style="margin-top: 5px;" |

To read Johanna Staehler's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1350578" data-reviewerId="35309" |[/div]