01/24 - Thwomp Thursday!

Pinterest [AURHK491L2LH6] Pinterest - Pinterest Ad Relevance in Search - $0.40 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $18.23 / hour
00:01:19 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Qualifications: sofia_accuracy DoesNotExist ; Scammers DoesNotExist ;
[div] style="margin-top: 5px;" |

To read Pinterest's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196408" data-reviewerId="5612" |[/div]

 

Stephen J. Tonks [A1YLG3BNTSUFK2] Reading Motivation(~ 1 minutes) - $0.10 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Fair[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $9.00 / hour
00:00:40 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Qualifications: Exc: [-1279088119-119104] DoesNotExist ; Location In US;
[div] style="margin-top: 5px;" |

To read Stephen J. Tonks's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196411" data-reviewerId="5612" |[/div]

 

Elisa Kreiss [A2O23Q58W1CO9A] Read a story and answer questions about it - $0.60 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Fair[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $8.93 / hour
00:04:02 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
Fair pay[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Qualifications: HIT approval rate (%) >= 95; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read Elisa Kreiss's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196414" data-reviewerId="3452" |[/div]

 

last half an hour

Today's Assigned HITs 24 $20.00
Today's Submitted HITs 2 $1.50

 

Juliana [AQGZAPJ1BO9XS] Rating Conversations Survey(~ 12 minutes) - $1.20 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Good[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $11.61 / hour
00:06:12 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
Simple task for good pay[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
None[/div]
[/div]

Qualifications: Exc: [3734000-125135] DoesNotExist ; Total approved HITs >= 500; HIT approval rate (%) >= 95; Location In US;
[div] style="margin-top: 5px;" |

To read Juliana's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196416" data-reviewerId="2841" |[/div]

 

Survey Research [AQHH4IOCZMFO3] 10-Minute Scenario Survey - $1.50 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $35.53 / hour
00:02:32 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Qualifications: Total approved HITs >= 1; HIT approval rate (%) >= 90; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read Survey Research's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196420" data-reviewerId="53" |[/div]

 

Juliana [AQGZAPJ1BO9XS] Word Search HIT(~ 6 minutes) - $0.60 $0.60 bonus | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $20.47 / hour
00:03:31 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
- Performance-based bonus
- Progress bar
- Could be completed slightly faster if you don't have a bird on your keyboard attacking your fingers when you try to type[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
- Writing[/div]
[/div]

Qualifications: Total approved HITs >= 500; Exc: [125816-125227] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;
[div] style="margin-top: 5px;" |

To read Juliana's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196423" data-reviewerId="2832" |[/div]

 

NOTE 1: This HIT requires a considerable amount of reading and writing.

 

John Stanton [A2ATPYB1Q9ZDX7] 10 minutes simple survey about food products' preferences - $1.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Low[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $8.61 / hour
00:06:58 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Qualifications: Total approved HITs > 10000; HIT approval rate (%) >= 98; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read John Stanton's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196424" data-reviewerId="2529" |[/div]

 

elisa s [A3PEEBFTVESGEG] Answer a survey about your opinions - $1.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $18.00 / hour
00:03:20 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Qualifications: HIT approval rate (%) > 95; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read elisa s's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196425" data-reviewerId="2739" |[/div]

 

FW [A287T594OSPJ0A] Birthday Party Study (5 minutes)(~ 5 minutes) - $0.50 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Low[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $8.45 / hour
00:03:33 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Qualifications: Total approved HITs >= 100; Exc: [-532637450-125113] DoesNotExist ; HIT approval rate (%) >= 90; Location In US;
[div] style="margin-top: 5px;" |

To read FW's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196426" data-reviewerId="2529" |[/div]

 

Social Psychology Experiment [AO02TOCBAPN7W] Rating life experiences - 10 to 15 minute study(~ 12 minutes) - $0.75 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Good[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
<24 hours[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $19.71 / hour
00:02:17 / completion time[/div]
[/div]

Approved! ​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Qualifications: Exc: [-145795901-125140] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;
[div] style="margin-top: 5px;" |

To read Social Psychology Experiment's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196427" data-reviewerId="2529" |[/div]

 

Joeri Wissink [A27S7Q5W5EJB08] Study on decision making(~ 15 minutes) - $1.80 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Unrated[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
<24 hours[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $7.05 / hour
00:15:19 / completion time[/div]
[/div]

Approved! ​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
got paid for waiting[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
I wasn't able to complete the experiment because of people[/div]
[/div]

Qualifications: Total approved HITs >= 100; Exc: [-1481613320-125184] DoesNotExist ; HIT approval rate (%) >= 90; Location In US;
[div] style="margin-top: 5px;" |

To read Joeri Wissink's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196429" data-reviewerId="2529" |[/div]

 

Here's the thing: there is no right answer here. And, I think me advocating one way or another is probably unfair as it'll influence the actual results.

Its... so complicated.

Requesters should be qualling everything in their own best interest --- not even considering the wastefulness/negative impact to the workers not qualling things invites workers to lie and essentially destroy the study. Throwing "FOR FEMALES ONLY" in the HIT title will get them a bunch of "females" lol.

Is there an argument to be made that qualling everything isn't feasible/practical? Sure. Maybe. Kinda. No not really because 2 yrs later they come back and blast MTurk for their lazy methods. But either way that's not my circus/monkeys to figure out.

If workers don't want their time wasted, return reviews (RR) are going to be a good way to impact that because it actually gives me data I can send to requesters and say "look at this, stop doing it, its bad for you & us" at the very least. On the better end, we can build things to help cut it down. TurkPrime does a good job of it already, tbf, but they're not all-encompassing and certainly don't really care about our end of the equation much.

RR are very fluid. They don't really have long term negative impacts to the Requesters profile, and when they are integrated into the profile it will be a relative thing (ie, this Requester is the worst we know of for wasting workers time on broken hits, or unpaid screeners, or whatever).

I RR'd a great requester last night as "broken" because the system they used to determine if you've already participated is, IMO, broken.

Are RR kinda garbage data? Yeah, maybe, a little bit on an individual results basis but from the back end perspective I can tell you they are INSANELY valuable as an aggregate system. They really do give a good insight into who sucks & who doesn't (requesters, not workers). They need a lot of work for sure, but they're honestly a good thing overall as long as workers take them with a grain of salt.

Just seeing the red alert should never be an auto-return for workers. They 100% require some discretion/interpretation, and they probably do hurt newbies a bit who don't know how to interpret the (something TV needs to improve on, *points @ the Endor warning*) but when I can look at a requester like this: https://turkerview.com/requesters/A1OH6DWZ2TL944-center-for-the-science-of-social-connection

and see they have an average screening time of almost 4 minutes and have accrued over $1,800 in wasted time for workers just off return reviews then I've got something to work with as far as giving hard data to a problem largely just passed off to us to bear the cost of.

So yeah, it kinda sucks to neg-rep a requester over something you might not need to but it is at least a contained thing & will get love in the future to help workers navigate it better & better. I think the majority of humans are capable of seeing "FOR FEMALES ONLY" with a note "I was screened out for being a guy" and if they've got the lady bits will know to go ahead & proceed with the survey. If not.. I'm not really sure they're going to make it on MTurk anyway.

 

ugent [A3U0ZJEOCOTBKD] Academic Survey (about 4 minutes in length) - $0.50 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Good[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $12.50 / hour
00:02:24 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
one of the better ugents ive done[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
MCs[/div]
[/div]

Qualifications: Total approved HITs > 1000; HIT approval rate (%) > 96; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read ugent's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196433" data-reviewerId="2236" |[/div]

 

Basil Beshkov [A1J2VJQQ2T2RXS] Publix survey on Kombucha. - $0.25 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $14.06 / hour
00:01:04 / completion time[/div]
[/div]

​

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Qualifications: Location EqualTo US;
[div] style="margin-top: 5px;" |

To read Basil Beshkov's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196434" data-reviewerId="2236" |[/div]

 

Hyungyu Shin [A2JDSWVLZ8HEQV] Read a news story and comments, share your opinion. - $3.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Good[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $21.47 / hour
00:08:23 / completion time[/div]
[/div]
[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
One of the more interesting studies I've had.[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
Whole bunch of writing[/div]
[/div]

Qualifications: HIT approval rate (%) > 95; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read Hyungyu Shin's full profile check out TurkerView!​

[/div]
[div] style="display: none;" data-type="tv-review" data-revId="196436" data-reviewerId="946" |[/div]

 

Today's Assigned HITs 38 $21.51
oday's Submitted HITs 15 $9.70

I got up an hour ago and need more coffee

 

im bored. send it my way.