12/08 - Wild Wintry Weather Wednesday

somniax0x · Dec 8, 2021

Stormation [A3RN8CGUNSQIPM] Write a social media comment (~1 min) #0623 - $0.12 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Unrated[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $3.46 / hour
00:02:05 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Expiring Now (HIT Last Seen: 40 minutes ago)
Qualifications: Location In AU, CA, GB, IE, NZ, US; Total approved HITs >= 1000; HIT approval rate (%) >= 98; Adult Content Qualification EqualTo 1;
[div] style="margin-top: 5px;" |
To read Stormation's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301320" data-reviewerId="39586" |[/div]

lanaaa · Dec 8, 2021

Imanuel said: ↑

Oh what a load of S*** that email is.

I love how he tries to brag that 790 people did it right. But if you look at thier requester page it says they, rather conveniently, have a 79% acceptance rate. This implies, to me, that they have a quota of 1000 responses that they were trying to fill and that they rejected probably around 150 people if you count the bs they pulled with that second hit. They also had a 95% qualification on their task. I don't know how that idiot can sit there and act all high and mighty like hes not the one in the wrong rejecting so many people. If you have a HIT with an acceptance rate qual and your data doesn't line up with the acceptance rate, it doesn't take a genius to figure out who probably messed something up.
Click to expand...

I haven't gone back to their page but I didn't believe their numbers either. And the way they talk about "as if screenshots were enough" .

YarnAndCats · Dec 8, 2021

Jonathan Homola [AFOZMHXGTP4E6] Quick survey about other people, 5mins - $2.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $61.02 / hour
00:01:58 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Okay (HIT Last Seen: 7 minutes ago)
Qualifications: Total approved HITs > 100; HIT approval rate (%) > 95; Location EqualTo US;
[div] style="margin-top: 5px;" |
To read Jonathan Homola's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301330" data-reviewerId="12088" |[/div]

PinkLady · Dec 8, 2021

Peter Gault [A1HFIQD0I9UOQ7] Read a passage and then complete 3 sentences about the passage. - $1.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Unrated[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $11.04 / hour
00:05:26 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Great (HIT Last Seen: 3 seconds ago)
Qualifications:
[div] style="margin-top: 5px;" |
To read Peter Gault's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301336" data-reviewerId="44442" |[/div]

lanaaa · Dec 8, 2021

QueenBeeatrix said: ↑

Aren't these the guys who were rude to a bunch of people for even saying anything about their rejections?
Click to expand...

Yeah, that's them. From the first reply he gave I'm sure this "distinguished engagement professor" didn't come up with this email on his own but it still sounds pretty obnoxious.

Random Turker · Dec 8, 2021

Jonathan Homola [AFOZMHXGTP4E6] Quick survey about other people, 5mins - $2.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $49.32 / hour
00:02:26 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Okay (HIT Last Seen: 9 minutes ago)
Qualifications: Total approved HITs > 100; HIT approval rate (%) > 95; Location EqualTo US;
[div] style="margin-top: 5px;" |
To read Jonathan Homola's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301337" data-reviewerId="5700" |[/div]

laby · Dec 8, 2021

lanaaa said: ↑

I was just sent this email regarding the Frankline Muthomi rejections:

Dear MTurk Worker:

Thank you for your email objecting to the rejection of your HIT for our budget balancing simulation. Valid responses for the research require that we are able to match the answers to the Qualtrics survey with the decisions made in the budget balancing simulation. Any other response is unusable. We have carefully reviewed the dataset as captured in the Qualtrics survey, Balancing Act simulation, and MTurk batch results, and we are very pleased that over 790 MTurk workers have been able to complete the two-part HIT successfully.

Our approval threshold was set that the MTurk submission code must match the code at the end of Qualtrics survey, and the unique code generated in the Qualtrics survey must match the unique code submitted in the budget simulation. Some workers were rejected because it was impossible to connect their survey responses to a completed budget simulation. Entries were rejected when one or more of the codes were either erroneous or missing from the table provided by MTurk that shows worker ID, the simulation code entered, and the end code entered.

We carefully review each submission to insure that the worker has completed the simulation and properly entered the provided code, and then properly completed the survey and entered the proper code.

Some workers have complained that we unfairly rejected their work. Sadly, over 60 MTurk workers skipped the simulation entirely. Others have sent screen shots of the budget simulation, as if this is evidence of complete work. We are unable to substantiate screen shots because they are not tied to a simulation submission. If the person does not push SUBMIT, the answers are not recorded in the simulation database. Anyone can enter a code in the simulation box after the project has been closed and take a screen shot, but if the code is not one issued by the Qualtrics program and recorded by MTurk, it is not evidence of an authentic entry. We can see exactly when someone pushes submit on any one of the 8 different treatments in the simulation data set.

Some workers have charged that our project was faulty. We have thoroughly analyzed the results provided by MTurk to identify a fault. Each of the 8 treatment groups has about the same number of responses across over 790 correct responses, so there was no error with the random assignment of workers to different treatments. The distribution of correct and incorrect submissions does not vary over time, based on MTurk data. Simulations that were completed with a submission were recorded in the data base from Qualtrics and if the code at the end of the survey were correct, we paid the worker appropriately.

When a few workers complained about rejections before the time for review deadline, I directed Mr. Muthomi to give them an opportunity to complete the simulation and survey using their MTurk worker ID in place of the codes. Several people successfully did so and their surveys were acceptable.

The MTurk data suggest that the bulk of the errors are for incorrect end code entries. For example, some workers indicated they clicked the back button to reread directions, and then when they clicked forward, they received a different code. They entered the new code but Qualtrics may have recorded the previous code. Qualtrics does not provide any way for us to test that possibility or correct that error.

We have a keen interest in getting the minimum number of completed entries to successfully proceed with our research. We understand that MTurk workers do not want a rejection on their record.

You have politely requested a chance to remediate the MTurk rejection and you shared your MTurk worker ID for our HIT. Therefore, we are offering you the following remediation to achieve our mutual goals.

They go on to list the process to complete the study again and submit with your worker ID used in the email.

If you agree to this remediation, please use this link to begin the remediation. We look forward to notifying you of a successful completion.

If you reject this remediation invitation, please reply to that effect and we will notify the NIU IRB office accordingly.

Thank you for considering this opportunity to remediate this research project exercise and achieve our mutual goals.

Peace,

Kurt Thurmaier

Distinguished Engagement Professor and Chair

Department of Public Administration

Northern Illinois University

Yeah, they need to meet their quota so they've changed their tone. I honestly don't know how I feel about taking them up on the offer. I would like to be rid of those rejections BUT I also want to stick it them for their treatment of this whole thing. Also, I find it hard to trust them.
Edit: I know everyone probably got the same email but I'm posting this here just in case some people never received a reply from them since they seem to be bad at that.
Click to expand...

I used the turkerview bridge rejection thing and it's still showing my message unread. After everybody got such rude responses it didn't seem worth emailing him or the IRB directly.

AlexZ · Dec 8, 2021

ChrisTurk said: ↑

lololololololol
Click to expand...

I'm kinda jealous. I wish my forum title was "Distinguished Asshat".

laby · Dec 8, 2021

AlexZ said: ↑

I'm kinda jealous. I wish my forum title was "Distinguished Asshat".
Click to expand...

@ChrisTurk you need to make that happen

mdeem · Dec 8, 2021

Keana Richards [A21E73MP2C93BG] Short study on decision-making(~ 10 minutes) - $1.20 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Unrated[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $10.72 / hour
00:06:43 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Okay (HIT Last Seen: 8 minutes ago)
Qualifications: Exc: [-354749879-335098] DoesNotExist ; HIT approval rate (%) >= 80; CR Research Group #1 >= 100; Location In US;
[div] style="margin-top: 5px;" |
To read Keana Richards's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301340" data-reviewerId="27264" |[/div]

YarnAndCats · Dec 8, 2021

laby said: ↑

I used the turkerview bridge rejection thing and it's still showing my message unread. After everybody got such rude responses it didn't seem worth emailing him or the IRB directly.
Click to expand...

If you would like his email to reach out about it I can send it to you.

lapetitebaker · Dec 8, 2021

Antino Kim [A2U6YZEK262E09] Yelp and Restaurant Search Results - $3.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Good[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $18.46 / hour
00:09:45 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
• Timed code page[/div]
[/div]

Catchability: Great (HIT Last Seen: 3 minutes ago)
Qualifications: YelpLabel DoesNotExist ; HIT approval rate (%) > 98; Total approved HITs > 5000; Location EqualTo US;
[div] style="margin-top: 5px;" |
To read Antino Kim's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301343" data-reviewerId="239" |[/div]

Hedgmog · Dec 8, 2021

NIMH-CompPsych [AGQ21VKCGELRB] A survey about mood - $7.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Excellent[/div][/div]
[div] style="float: left; width: 33%;" | $76.13 / hour
00:05:31 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
I answered all the questions on this hit and the hit itself ended up being very short - I contacted the requester and they assured me that as long as I got a code I could submit it - In this survey all the questions are about 'mood' - great communication and fantastic pay! Best survey and pay I have had in a long time![/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Okay (HIT Last Seen: 35 minutes ago)
Qualifications: Total approved HITs >= 5000; mfq_cesd_pairwise DoesNotExist ; HIT approval rate (%) >= 98; Location EqualTo US;
[div] style="margin-top: 5px;" |
To read NIMH-CompPsych's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301344" data-reviewerId="3581" |[/div]

enomi · Dec 8, 2021

Jonathan Homola [AFOZMHXGTP4E6] Quick survey about other people, 5mins - $2.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $47.06 / hour
00:02:33 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs > 100; HIT approval rate (%) > 95; Location EqualTo US;
[div] style="margin-top: 5px;" |
To read Jonathan Homola's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301346" data-reviewerId="3321" |[/div]

lanaaa · Dec 8, 2021

laby said: ↑

I used the turkerview bridge rejection thing and it's still showing my message unread. After everybody got such rude responses it didn't seem worth emailing him or the IRB directly.
Click to expand...

I'm sure you're not the only one, I'm sorry.

johnxyz · Dec 8, 2021

Stanford GSB Behavioral Lab [A3OSXTUM1QEXNY] Decision Study(~ 3 minutes) - $0.60 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $28.80 / hour
00:01:15 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
Instant approval[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Terrible (HIT Last Seen: 38 minutes ago)
Qualifications: Total approved HITs >= 100; Exc: [335915-335326] DoesNotExist ; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;
[div] style="margin-top: 5px;" |
To read Stanford GSB Behavioral Lab's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301348" data-reviewerId="1103" |[/div]

Kathleen! · Dec 8, 2021

Title: Short fun research study(~ 5 minutes) | PANDA
Requester: phillab [A36MJBQYSQS7EB]
TurkerView: [ $19.76 / hour ]
Description: Read stories and answer questions
Duration: 60 Min
Available: 1
Reward: $1.00
Qualifications:

TP Panel: -1223293458 N GreaterThanOrEqualTo 100

Exc: [335841-335252] DoesNotExist

Total approved HITs GreaterThanOrEqualTo 1000

HIT approval rate (%) GreaterThanOrEqualTo 97

CR Research Group #1 GreaterThanOrEqualTo 100

Location In US

[3F0Z1FPMVQP866D108FSMHW408FLYZ]

enomi · Dec 8, 2021

Yu Research Group [A1ISL1RJLPX24X] Earn $3 for certain. Plus, earn extra (up to about $10) through a decision exercise (~ 50 minutes) - $1.00 $12.96 bonus | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $22.83 / hour
00:36:41 / completion time[/div]
[/div]

Approved!
[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Very Low (HIT Last Seen: 2 hours ago)
Qualifications: Total approved HITs >= 100; Exc: [913970278-335182] DoesNotExist ; HIT approval rate (%) >= 90; CR Research Group #1 >= 100; Location In US;
[div] style="margin-top: 5px;" |
To read Yu Research Group's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301349" data-reviewerId="3321" |[/div]

johnxyz · Dec 8, 2021

Jonathan Homola [AFOZMHXGTP4E6] Quick survey about other people, 5mins - $2.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Unrated[/div][/div]
[div] style="float: left; width: 33%;" | $55.38 / hour
00:02:10 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
Instant approval[/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Great (HIT Last Seen: 4 seconds ago)
Qualifications: Total approved HITs > 100; HIT approval rate (%) > 95; Location EqualTo US;
[div] style="margin-top: 5px;" |
To read Jonathan Homola's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301350" data-reviewerId="1103" |[/div]

PinkLady · Dec 8, 2021

Hedgmog said: ↑

NIMH-CompPsych [AGQ21VKCGELRB] A survey about mood - $7.00 | PANDA
[div] style="border: 1px solid transparent; padding: 10px 0; display: flex; align-items: center; border-color: #ecf0f1; box-shadow: 0 1px 1px rgba(0,0,0,0.05); text-align: center;" |
[div] style="float: left; width: 25%;" |
Generous[/div]
[div] style="float: left; width: 41%;" |[div] style="float: left; width: 50%;" |
Unrated[/div]
[div] style="float: left; width: 50%;" |
Excellent[/div][/div]
[div] style="float: left; width: 33%;" | $76.13 / hour
00:05:31 / completion time[/div]
[/div]

[div] style="width: 100%; display: flex; flex-items: center; margin-top: 5px;" |[div] style="width: 50%; display: inline-block; margin: 0 5px 0 0;" | Pros:
I answered all the questions on this hit and the hit itself ended up being very short - I contacted the requester and they assured me that as long as I got a code I could submit it - In this survey all the questions are about 'mood' - great communication and fantastic pay! Best survey and pay I have had in a long time![/div]
[div] style="width: 50%; display: inline-block; margin: 0 0 0 5px;" | Cons:
[/div]
[/div]

Catchability: Okay (HIT Last Seen: 35 minutes ago)
Qualifications: Total approved HITs >= 5000; mfq_cesd_pairwise DoesNotExist ; HIT approval rate (%) >= 98; Location EqualTo US;
[div] style="margin-top: 5px;" |

To read NIMH-CompPsych's full profile check out TurkerView!
[/div]
[div] style="display: none;" data-type="tv-review" data-revId="1301344" data-reviewerId="3581" |[/div]
Click to expand...

12/08 - Wild Wintry Weather Wednesday

somniax0x Turker

lanaaa Well-Known Turker

YarnAndCats Survey Slinger

PinkLady Survey Slinger

lanaaa Well-Known Turker

Random Turker Survey Slinger TurkerView Masters

laby Survey Slinger Former MTG MotM TurkerView Masters

AlexZ Distinguished Butthat The Prophet

laby Survey Slinger Former MTG MotM TurkerView Masters

mdeem Survey Slinger TurkerView Masters

YarnAndCats Survey Slinger

lapetitebaker Survey Slinger TurkerView Masters

Hedgmog Well-Known Turker TurkerView Masters

enomi New Turker

lanaaa Well-Known Turker

johnxyz Well-Known Turker TurkerView Masters

Kathleen! Survey Slinger

enomi New Turker

johnxyz Well-Known Turker TurkerView Masters

PinkLady Survey Slinger

About TurkerView Forum

12/08 - Wild Wintry Weather Wednesday

somniax0x Turker

lanaaa Well-Known Turker

YarnAndCats Survey Slinger

PinkLady Survey Slinger

lanaaa Well-Known Turker

Random Turker Survey Slinger TurkerView Masters

laby Survey Slinger Former MTG MotM TurkerView Masters

AlexZ Distinguished Butthat The Prophet

laby Survey Slinger Former MTG MotM TurkerView Masters

mdeem Survey Slinger TurkerView Masters

YarnAndCats Survey Slinger

lapetitebaker Survey Slinger TurkerView Masters

Hedgmog Well-Known Turker TurkerView Masters

enomi New Turker

lanaaa Well-Known Turker

johnxyz Well-Known Turker TurkerView Masters

Kathleen! Survey Slinger

enomi New Turker

johnxyz Well-Known Turker TurkerView Masters

PinkLady Survey Slinger

Useful Searches