01/24 - Thwomp Thursday!

Discussion in 'Daily mTurk HITs Threads' started by Melting Glacier, Jan 24, 2019.

Thread Status:
Not open for further replies.
  1. BurntToast

    BurntToast Well-Known Turker

    Messages:
    2,981
    Gender:
    Male
    Ratings:
    +1,587
    Pinterest [AURHK491L2LH6] Pinterest - Pinterest Ad Relevance in Search - $0.40 | PANDA


    Generous

    Unrated

    Unrated
    $18.23 / hour
    00:01:19 / completion time
    Pros:
    Cons:

    Qualifications: sofia_accuracy DoesNotExist ; Scammers DoesNotExist ;
    To read Pinterest's full profile check out TurkerView!
     
  2. BurntToast

    BurntToast Well-Known Turker

    Messages:
    2,981
    Gender:
    Male
    Ratings:
    +1,587
    Stephen J. Tonks [A1YLG3BNTSUFK2] Reading Motivation(~ 1 minutes) - $0.10 | PANDA


    Fair

    Unrated

    Unrated
    $9.00 / hour
    00:00:40 / completion time
    Pros:
    Cons:

    Qualifications: Exc: [-1279088119-119104] DoesNotExist ; Location In US;
    To read Stephen J. Tonks's full profile check out TurkerView!
     
  3. Paradigm365

    Paradigm365 Well-Known Turker

    Messages:
    2,085
    Gender:
    Male
    Ratings:
    +326
    Elisa Kreiss [A2O23Q58W1CO9A] Read a story and answer questions about it - $0.60 | PANDA


    Fair

    Unrated

    Unrated
    $8.93 / hour
    00:04:02 / completion time
    Pros:
    Fair pay
    Cons:

    Qualifications: HIT approval rate (%) >= 95; Location EqualTo US;
    To read Elisa Kreiss's full profile check out TurkerView!
     
  4. Girl Polar Bear

    Girl Polar Bear Queen of the North

    Messages:
    29,273
    Gender:
    Female
    Ratings:
    +45,742
    last half an hour

    Today's Assigned HITs 24 $20.00
    Today's Submitted HITs 2 $1.50
     
    • LOL LOL x 3
    • 5/5 Pay 5/5 Pay x 1
    • WOW WOW x 1
  5. Epictetus

    Epictetus Well-Known Turker

    Messages:
    1,158
    Gender:
    Male
    Ratings:
    +1,108
    Juliana [AQGZAPJ1BO9XS] Rating Conversations Survey(~ 12 minutes) - $1.20 | PANDA


    Good

    Unrated

    Unrated
    $11.61 / hour
    00:06:12 / completion time
    Pros:
    Simple task for good pay
    Cons:
    None

    Qualifications: Exc: [3734000-125135] DoesNotExist ; Total approved HITs >= 500; HIT approval rate (%) >= 95; Location In US;
    To read Juliana's full profile check out TurkerView!
     
  6. Babadooba

    Babadooba Active Turker

    Messages:
    741
    Gender:
    Male
    Ratings:
    +87
    Survey Research [AQHH4IOCZMFO3] 10-Minute Scenario Survey - $1.50 | PANDA


    Generous

    Unrated

    Unrated
    $35.53 / hour
    00:02:32 / completion time
    Pros:
    Cons:

    Qualifications: Total approved HITs >= 1; HIT approval rate (%) >= 90; Location EqualTo US;
    To read Survey Research's full profile check out TurkerView!
     
  7. Pronewbi3

    Pronewbi3 Survey Slinger TurkerView Masters

    Messages:
    15,649
    Gender:
    Male
    Ratings:
    +27,826
    elisa s [A3PEEBFTVESGEG] Answer a survey about your opinions - $1.00 | PANDA


    Generous

    Unrated

    Unrated
    $18.18 / hour
    00:03:18 / completion time
    Pros:
    Cons:

    Qualifications: HIT approval rate (%) > 95; Location EqualTo US;
    To read elisa s's full profile check out TurkerView!
     
  8. TinaBanina

    TinaBanina Active Turker

    Messages:
    1,242
    Gender:
    Female
    Ratings:
    +1,251
    Juliana [AQGZAPJ1BO9XS] Word Search HIT(~ 6 minutes) - $0.60 $0.60 bonus | PANDA


    Generous

    Unrated

    Unrated
    $20.47 / hour
    00:03:31 / completion time
    Pros:
    - Performance-based bonus
    - Progress bar
    - Could be completed slightly faster if you don't have a bird on your keyboard attacking your fingers when you try to type
    Cons:
    - Writing

    Qualifications: Total approved HITs >= 500; Exc: [125816-125227] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;
    To read Juliana's full profile check out TurkerView!
     
    • Good Review! Good Review! x 1
  9. mrnotoriousman

    mrnotoriousman Survey Slinger TurkerView Masters

    Messages:
    21,943
    Gender:
    Male
    Ratings:
    +20,112
    NOTE 1: This HIT requires a considerable amount of reading and writing.

    [​IMG]
     
    • LOL LOL x 1
  10. bowtied

    bowtied Well-Known Turker

    Messages:
    1,053
    Ratings:
    +1,531
    John Stanton [A2ATPYB1Q9ZDX7] 10 minutes simple survey about food products' preferences - $1.00 | PANDA


    Low

    Unrated

    Unrated
    $8.61 / hour
    00:06:58 / completion time
    Pros:
    Cons:

    Qualifications: Total approved HITs > 10000; HIT approval rate (%) >= 98; Location EqualTo US;
    To read John Stanton's full profile check out TurkerView!
     
  11. Nick9195

    Nick9195 Turker

    Messages:
    162
    Gender:
    Male
    Ratings:
    +240
    elisa s [A3PEEBFTVESGEG] Answer a survey about your opinions - $1.00 | PANDA


    Generous

    Unrated

    Unrated
    $18.00 / hour
    00:03:20 / completion time
    Pros:
    Cons:

    Qualifications: HIT approval rate (%) > 95; Location EqualTo US;
    To read elisa s's full profile check out TurkerView!
     
  12. bowtied

    bowtied Well-Known Turker

    Messages:
    1,053
    Ratings:
    +1,531
    FW [A287T594OSPJ0A] Birthday Party Study (5 minutes)(~ 5 minutes) - $0.50 | PANDA


    Low

    Unrated

    Unrated
    $8.45 / hour
    00:03:33 / completion time
    Pros:
    Cons:

    Qualifications: Total approved HITs >= 100; Exc: [-532637450-125113] DoesNotExist ; HIT approval rate (%) >= 90; Location In US;
    To read FW's full profile check out TurkerView!
     
  13. bowtied

    bowtied Well-Known Turker

    Messages:
    1,053
    Ratings:
    +1,531
    Social Psychology Experiment [AO02TOCBAPN7W] Rating life experiences - 10 to 15 minute study(~ 12 minutes) - $0.75 | PANDA


    Good

    <24 hours

    Unrated
    $19.71 / hour
    00:02:17 / completion time
    Approved!
    Pros:
    Cons:

    Qualifications: Exc: [-145795901-125140] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;
    To read Social Psychology Experiment's full profile check out TurkerView!
     
  14. bowtied

    bowtied Well-Known Turker

    Messages:
    1,053
    Ratings:
    +1,531
    Joeri Wissink [A27S7Q5W5EJB08] Study on decision making(~ 15 minutes) - $1.80 | PANDA


    Unrated

    <24 hours

    Unrated
    $7.05 / hour
    00:15:19 / completion time
    Approved!
    Pros:
    got paid for waiting
    Cons:
    I wasn't able to complete the experiment because of people

    Qualifications: Total approved HITs >= 100; Exc: [-1481613320-125184] DoesNotExist ; HIT approval rate (%) >= 90; Location In US;
    To read Joeri Wissink's full profile check out TurkerView!
     
  15. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,679
    Ratings:
    +162,927
    Here's the thing: there is no right answer here. And, I think me advocating one way or another is probably unfair as it'll influence the actual results.

    Its... so complicated.

    Requesters should be qualling everything in their own best interest --- not even considering the wastefulness/negative impact to the workers not qualling things invites workers to lie and essentially destroy the study. Throwing "FOR FEMALES ONLY" in the HIT title will get them a bunch of "females" lol.

    Is there an argument to be made that qualling everything isn't feasible/practical? Sure. Maybe. Kinda. No not really because 2 yrs later they come back and blast MTurk for their lazy methods. But either way that's not my circus/monkeys to figure out.

    If workers don't want their time wasted, return reviews (RR) are going to be a good way to impact that because it actually gives me data I can send to requesters and say "look at this, stop doing it, its bad for you & us" at the very least. On the better end, we can build things to help cut it down. TurkPrime does a good job of it already, tbf, but they're not all-encompassing and certainly don't really care about our end of the equation much.

    RR are very fluid. They don't really have long term negative impacts to the Requesters profile, and when they are integrated into the profile it will be a relative thing (ie, this Requester is the worst we know of for wasting workers time on broken hits, or unpaid screeners, or whatever).

    I RR'd a great requester last night as "broken" because the system they used to determine if you've already participated is, IMO, broken.

    Are RR kinda garbage data? Yeah, maybe, a little bit on an individual results basis but from the back end perspective I can tell you they are INSANELY valuable as an aggregate system. They really do give a good insight into who sucks & who doesn't (requesters, not workers). They need a lot of work for sure, but they're honestly a good thing overall as long as workers take them with a grain of salt.

    Just seeing the red alert should never be an auto-return for workers. They 100% require some discretion/interpretation, and they probably do hurt newbies a bit who don't know how to interpret the (something TV needs to improve on, *points @ the Endor warning*) but when I can look at a requester like this: https://turkerview.com/requesters/A1OH6DWZ2TL944-center-for-the-science-of-social-connection

    and see they have an average screening time of almost 4 minutes and have accrued over $1,800 in wasted time for workers just off return reviews then I've got something to work with as far as giving hard data to a problem largely just passed off to us to bear the cost of.

    So yeah, it kinda sucks to neg-rep a requester over something you might not need to but it is at least a contained thing & will get love in the future to help workers navigate it better & better. I think the majority of humans are capable of seeing "FOR FEMALES ONLY" with a note "I was screened out for being a guy" and if they've got the lady bits will know to go ahead & proceed with the survey. If not.. I'm not really sure they're going to make it on MTurk anyway.
     
    • Today I Learned Today I Learned x 4
    • LOL LOL x 1
    • WOW WOW x 1
  16. Troy

    Troy Well-Known Turker

    Messages:
    4,958
    Gender:
    Male
    Ratings:
    +4,507
    ugent [A3U0ZJEOCOTBKD] Academic Survey (about 4 minutes in length) - $0.50 | PANDA


    Good

    Unrated

    Unrated
    $12.50 / hour
    00:02:24 / completion time
    Pros:
    one of the better ugents ive done
    Cons:
    MCs

    Qualifications: Total approved HITs > 1000; HIT approval rate (%) > 96; Location EqualTo US;
    To read ugent's full profile check out TurkerView!
     
  17. Troy

    Troy Well-Known Turker

    Messages:
    4,958
    Gender:
    Male
    Ratings:
    +4,507
    Basil Beshkov [A1J2VJQQ2T2RXS] Publix survey on Kombucha. - $0.25 | PANDA


    Generous

    Unrated

    Unrated
    $14.06 / hour
    00:01:04 / completion time
    Pros:
    Cons:

    Qualifications: Location EqualTo US;
    To read Basil Beshkov's full profile check out TurkerView!
     
  18. humbleturker

    humbleturker Survey Slinger

    Messages:
    5,697
    Gender:
    Male
    Ratings:
    +11,133
    Hyungyu Shin [A2JDSWVLZ8HEQV] Read a news story and comments, share your opinion. - $3.00 | PANDA


    Good

    Unrated

    Unrated
    $21.47 / hour
    00:08:23 / completion time
    Pros:
    One of the more interesting studies I've had.
    Cons:
    Whole bunch of writing

    Qualifications: HIT approval rate (%) > 95; Location EqualTo US;
    To read Hyungyu Shin's full profile check out TurkerView!
     
  19. SunlitSunflower

    SunlitSunflower baby head

    Messages:
    22,494
    Ratings:
    +36,431
    Today's Assigned HITs 38 $21.51
    oday's Submitted HITs 15 $9.70

    I got up an hour ago and need more coffee
     
  20. Troy

    Troy Well-Known Turker

    Messages:
    4,958
    Gender:
    Male
    Ratings:
    +4,507
    im bored. send it my way.
     
Thread Status:
Not open for further replies.