02/22 - QualifEye? QualiFyre? QualiFriday (Softlaunch)

Discussion in 'Daily mTurk HITs Threads' started by ChrisTurk, Feb 22, 2019.

Thread Status:
Not open for further replies.
  1. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,679
    Ratings:
    +162,927
    [​IMG]

    QualifEye? What is this? Why do you love puns?

    The long & short of it is that you can now use TurkerView itself to alert you to brand new qualification tests & potential qualification hits on MTurk. You don't need to be logged into MTurk, and this will not use any of your valuable page requests to do it's work.

    This allows you to focus on the work actually available to you, while opening up new opportunities during down time and eliminating wasted time & focus. You can actually utilize the "qualified only" options available in most scrapers to filter out the massive amount of junk that you will never be able to do. That is one of the few filters that applies directly to MTurk which actually increases the coverage of HITs your scraper will actually get to scrape & see.

    This will also hopefully help good requesters get their work done. In many cases requesters who go through the trouble of setting up qual tests just have their HITs languish in the void because of how difficult it is to find & complete them. So we're looking to bring good workers together with those kinds of HITs & make it easier for both parties.

    I think the name is funny, I'll change it some time in the future I'm sure since it's objectively pretty dumb lol. QualiFyre, maybe? ..wait I just typed that out and it sounds amazing.. "qualifier" => qualifyre.. who is coming to the festival? :emoji_joy: Sorry y'all, you know I get delirious near feature launches by now!

    Current Features:
    • Tracking & auto updating of qualification tests on MTurk
    • Tracking & auto updating of HITs that are likely qualification, qualifiers, demographic, or pre-qualifiers for batches/surveys
    • Tab alerts
    • Live desktop push notifications

    How good is it?
    You'll have to let me know :) I've found a potential ~$40 off of it the last 2 days but in fairness I was lazy working and only cherry picking the two batches & a random survey which are HITs you may have noticed on your scraper anyway. But this should definitely make it easier!

    Qual Tests
    [​IMG]

    QualifEye has a few thousand qualification tests indexed already (though for the moment it will only display the last few days worth), and it picks up new ones to the platform (or old ones making a return to being used) automatically.

    In the last day of testing both of these HIT groups came about from me using QualifEye (the first had 100 available, the other 300, and both sat around for hours):

    [​IMG]

    [​IMG]

    They added up to $44 worth of HITs I didn't see on scraper but did pick up the qual test & did the batches from off QualifEye and I only caught them while testing/building it, not actively using the tool. Of course YMMV, but I think QualifEye can potentially add a lot of value to your workflow & am excited to see how it's utilized!

    Qual HITs
    [​IMG]

    In the past few days it picked up GeoHives, Cloud Labor, & a Unanimous AI qual along with dozens of other small screening/demographic surveys. I'll be improving it based on feedback from this pilot run over the weekend, of course, but it's already pretty good at what it does.

    Is this free?
    It's free until March 1st, but after that it will be included with the normal API subscription package (if you already have a subscription/unlocked key then yes this is included in that w/o any price changes :) ). This is just one of the tools I'll be adding to add value to TV for its userbase but hopefully it gives some insight into the direction TV is headed.

    As with all things I expect some bugs & glitches that I'll need to work out over the weekend, but I'd like folks to be able to get a feel for it & if it has actual value to them so the plan is to knock out any user/browser specific bugs by Monday :)

    If you've got questions, comments, feedback, & the normal gauntlet of words I use here to ask for your opinions as always just throw 'em at me. I need a nap so will be back around in the morning.

    Where Is It!?
    You can access it directly through this link: https://turkerview.com/qualifeye/

    QualifEye Link

    It'll be added to the main navigation bar later on today :)

    Aaaand as always thank you to everyone who gave suggestions & helped me test things out! :emoji_heart_eyes:
     
    • Love x 18
    • Like x 4
    • WOW x 3
    • Today I Learned x 2
    • Nom Nom Nom! x 1
    • LOL x 1
    • 5/5 Pay x 1
    • Your Spellcheck Is As Broke As a Turker Working for Brelig x 1
    Last edited: Feb 22, 2019
  2. Randomacts

    Randomacts Survey Slinger

    Messages:
    94,622
    Gender:
    Male
    Ratings:
    +124,073
    Help I'm being repressed.

    The evil admin closed the thread when I was going to make a joke :(
     
    • LOL LOL x 7
    • Love Love x 1
  3. morweeg

    morweeg Triple Double Certified Organic Batch Master

    Messages:
    40,571
    Ratings:
    +54,131
    Moment of silence for all the good qual test batches.
     
    • Like Like x 1
    • Love Love x 1
  4. A6_Foul_Out

    A6_Foul_Out Organic Meme Panda TurkerView Masters

    Messages:
    17,777
    Gender:
    Male
    Ratings:
    +23,954
    rip anything good hidden behind a qual test

    :rain:
     
    • Love Love x 1
  5. Randomacts

    Randomacts Survey Slinger

    Messages:
    94,622
    Gender:
    Male
    Ratings:
    +124,073
    Yeah...

    Also

    upload_2019-2-22_0-2-31.png
     
    • LOL LOL x 1
  6. liondog

    liondog Well-Known Turker

    Messages:
    186
    Gender:
    Female
    Ratings:
    +476
    Title: Study on Decision Making(~ 10 minutes) [ $ | $ ] PANDA
    Requester: The Wharton School [ABIUW8FBC3EE7]
    TurkerView: [ $16.00 / hour ]
    Description: This study will take up to 10 minutes of your time. On average, you can expect to earn a bonus of $3.50.
    Duration: 00:45:00
    Available: 1
    Reward: $0.10
    Qualifications:
    • Exc: [4161561-130255] DoesNotExist [ Request | How to Use ]
    • Total approved HITs GreaterThanOrEqualTo 1000,
    • HIT approval rate (%) GreaterThanOrEqualTo 99,
    • Location In US,
    [37Z7ICZ5H99RVLA1SOLHZUSEUAS11C]
     
    • Like Like x 2
  7. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,679
    Ratings:
    +162,927
    I posted this 2 days ago for you to look at >.> lol
     
  8. Randomacts

    Randomacts Survey Slinger

    Messages:
    94,622
    Gender:
    Male
    Ratings:
    +124,073
    We never said it it wouldn't be a useful tool but it may be too useful.
     
    • Like Like x 2
    • LOL LOL x 1
  9. morweeg

    morweeg Triple Double Certified Organic Batch Master

    Messages:
    40,571
    Ratings:
    +54,131
    People were being too much "omg I love it" for me to give adequate feedback, plus you wouldn't have listened anyway.
     
    • Like Like x 1
    • Love Love x 1
  10. A6_Foul_Out

    A6_Foul_Out Organic Meme Panda TurkerView Masters

    Messages:
    17,777
    Gender:
    Male
    Ratings:
    +23,954
    direction

    they haven't approved you yet to grab an approved screen cap?

    remove speechpad/granola/other crap by default

    :rain:
    lol this
     
    • Love Love x 1
  11. THFYM

    THFYM Survey Slinger Former MTG MotM

    Messages:
    8,887
    Gender:
    Male
    Ratings:
    +23,050
    [​IMG]
     
    • LOL LOL x 4
    • Love Love x 3
    • 5/5 Pay 5/5 Pay x 1
    • WOW WOW x 1
  12. A6_Foul_Out

    A6_Foul_Out Organic Meme Panda TurkerView Masters

    Messages:
    17,777
    Gender:
    Male
    Ratings:
    +23,954
    New Requester Profile!

    Anouk Bergner [A24YJWRDXL1TX4] Complete a virtual shopping trip and answer survey questions - $0.70 | PANDA


    Generous

    Unrated

    Unrated
    $14.00 / hour
    00:03:00 / completion time
    Pros:
    Cons:

    Qualifications: Online Purchase - Groceries & Food EqualTo 1; Location EqualTo US;
    To read Anouk Bergner's full profile check out TurkerView!
     
    • Good Review! Good Review! x 1
  13. THFYM

    THFYM Survey Slinger Former MTG MotM

    Messages:
    8,887
    Gender:
    Male
    Ratings:
    +23,050
    Kenan Kalayci [ASBS3GOH094FU] Decision making study - $2.00 $9.45 bonus | PANDA


    Generous

    <24 hours

    Unrated
    $95.64 / hour
    00:07:11 / completion time
    Approved!
    Pros:
    Cons:
    Tons of instructions and MCs, but for this pay rate I'll take it.

    Qualifications: dkm-study DoesNotExist ; Total approved HITs > 500; HIT approval rate (%) > 95; Location EqualTo US;
    To read Kenan Kalayci's full profile check out TurkerView!
     
  14. morweeg

    morweeg Triple Double Certified Organic Batch Master

    Messages:
    40,571
    Ratings:
    +54,131
    Amazon Requester Inc. - RVD Team [A116XPE56JVGXQ] AllegiantMTurk - test 22/02/19 - $0.02 | PANDA


    Underpaid

    <24 hours

    Unrated
    $6.55 / hour
    00:00:11 / completion time
    Approved!
    Pros:
    Instant approval.
    Cons:
    I did this before I realized it was only 2 cents.

    Qualifications: Location EqualTo US;
    To read Amazon Requester Inc. - RVD Team's full profile check out TurkerView!
     
  15. A6_Foul_Out

    A6_Foul_Out Organic Meme Panda TurkerView Masters

    Messages:
    17,777
    Gender:
    Male
    Ratings:
    +23,954
  16. A6_Foul_Out

    A6_Foul_Out Organic Meme Panda TurkerView Masters

    Messages:
    17,777
    Gender:
    Male
    Ratings:
    +23,954
  17. A6_Foul_Out

    A6_Foul_Out Organic Meme Panda TurkerView Masters

    Messages:
    17,777
    Gender:
    Male
    Ratings:
    +23,954
    New Requester Profile!

    Robbie [AWC5GDCA2QRMV] 10-minute survey about urban public spaces (mobile-friendly) - $0.50 | PANDA


    Unrated

    Unrated

    Unrated
    $12.00 / hour
    00:02:30 / completion time
    Pros:
    Cons:

    Qualifications: Location NotEqualTo HK; Total approved HITs > 100; HIT approval rate (%) > 95;
    To read Robbie's full profile check out TurkerView!
     
    • Good Review! Good Review! x 1
  18. awdrf

    awdrf Well-Known Turker

    Messages:
    6,605
    Ratings:
    +5,459
    ConsumerLab [A1H30QO26Z80MM] Combination of several studies - $0.50 | PANDA


    Fair

    Unrated

    Unrated
    $7.38 / hour
    00:04:04 / completion time
    Pros:
    Cons:

    Qualifications: HIT approval rate (%) >= 95; Location EqualTo US;
    To read ConsumerLab's full profile check out TurkerView!
     
  19. A6_Foul_Out

    A6_Foul_Out Organic Meme Panda TurkerView Masters

    Messages:
    17,777
    Gender:
    Male
    Ratings:
    +23,954
    New Requester Profile!

    Shiny A [A1RRFF0NJ1SS5L] Brand survey - $0.50 | PANDA


    Underpaid

    Unrated

    Unrated
    $6.92 / hour
    00:04:20 / completion time
    Pros:
    Cons:
    Extremely underpaid considering most surveys from OSU are extremely well paid.

    Jee-Ahe Ahn
    Ph.D. student
    Dept. of Human Sciences
    The Ohio State University

    Qualifications: HIT approval rate (%) > 95; Location EqualTo US;
    To read Shiny A's full profile check out TurkerView!
     
    • Good Review! Good Review! x 2
  20. Mothra

    Mothra Survey Slinger

    Messages:
    6,468
    Ratings:
    +11,952
    Kevin C Murray [A68PN511AMUA6] Survey about behavior, personality, and your mobile app usage - $0.80 | PANDA


    Unrated

    Unrated

    Unrated
    $44.31 / hour
    00:01:05 / completion time
    Pros:
    Brief
    Generous compensation
    Cons:

    Qualifications: HIT approval rate (%) > 90; Location EqualTo US;
    To read Kevin C Murray's full profile check out TurkerView!
     
Thread Status:
Not open for further replies.