[Please Help!] "Review and Return" Abandoning HITS

Discussion in 'Help & Guides' started by Memnoch, Apr 1, 2019.

  1. Memnoch

    Memnoch New Turker

    Messages:
    22
    Gender:
    Male
    Ratings:
    +11
    Hey everyone, I don't know if this is MTurk's idea of an April Fools joke, but I'm not laughing.

    Several HITS from over the weekend that I "Review and Returned" are showing up as "Abandoned". As of now it's down to five due to a Noah HIT being changed from "Abandoned" to "Paid" overnight. (I seriously have .12 in my MTurk Account this morning)

    [​IMG]

    I've never abandoned a HIT in my years of turking and maintain a 100% Approval Rate, never been softbanned (even from Noah) yet it seems like the last 48 hours is going to destroy all that.

    Is this a MTS issue? MTurk? Aliens?

    Please help - I've been emailing requesters doing damage control from this all morning.
     
    Last edited: Apr 1, 2019
  2. Yuk

    Yuk Zing King

    Messages:
    2,585
    Ratings:
    +5,059
    Abandoned just means that the timer ran out on the hit before it was either returned or submitted. The only negative side effect from having a high abandon rate is when requesters use a qual (Abandon Rate is not greater than 20%, for example), which I've only seen a handful of times ever.
    MTS changing values could just be a syncing issue on its end
     
  3. Randomacts

    Randomacts Survey Slinger

    Messages:
    94,622
    Gender:
    Male
    Ratings:
    +124,073
    Return and reviews don't trigger MTS's 'return' thing so it only will know that it is abandoned.
     
    • Like Like x 1
  4. Memnoch

    Memnoch New Turker

    Messages:
    22
    Gender:
    Male
    Ratings:
    +11
    Thanks, that makes me feel a bit better about the negative impact. That said, I'd still like to have that impact negated or at the very least lessened.

    Most of all, I'd like to solve the issue so I can continue to use MTS, as it's all kinds of awesome. I'm not doing any more HITS until I decide to ditch MTS altogether or a workable solve is found.
     
  5. Memnoch

    Memnoch New Turker

    Messages:
    22
    Gender:
    Male
    Ratings:
    +11
    This makes perfect sense. So it is an MTS issue. Thank you so much! I'll turn off MTS and see what type of damage control I can do - this seems like the kind of thing that would be IN BOLD PRINT as it can ruin someone's account without them even knowing.
     
  6. Yuk

    Yuk Zing King

    Messages:
    2,585
    Ratings:
    +5,059
    Abandoning hits is part of turking, intentional or otherwise, like if you're trying to do a batch and the servers are lagging to hell and all of a sudden 6 of your hits expire as you're trying to submit them lol.
    There are quals requesters can use to exclude people that have high return rates too, so they both (returning and abandoning) have the same impact just so you're aware.
     
    • Today I Learned Today I Learned x 1
  7. Randomacts

    Randomacts Survey Slinger

    Messages:
    94,622
    Gender:
    Male
    Ratings:
    +124,073
    Damage control? It doesn't matter.

    >ruin someone's account

    lmao no it doesn't matter stop freaking out.
     
  8. Girl Polar Bear

    Girl Polar Bear Queen of the North

    Messages:
    29,273
    Gender:
    Female
    Ratings:
    +45,742
    "Review and Return" is just returning the HITs, nothing more nothing less. So, you do not need to worry about using it. @ChrisTurk

    This is what is happening (in my opinion): You are accepting a HIT. MTS knows that you accepted the HIT. You review and returned the HIT. MTS do not know you returned the HIT since you did not return it properly but used R&R. MTS is looking for the HIT. You neither submitted the HIT nor returned the HIT. then MTS says you abandoned the HIT since there is no HIT in your queue. @Kadauchi
     
    • Like Like x 1
  9. Girl Polar Bear

    Girl Polar Bear Queen of the North

    Messages:
    29,273
    Gender:
    Female
    Ratings:
    +45,742
    It is not even an issue. You are not abandoning anything, you are just returning.
     
  10. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,679
    Ratings:
    +162,927
    She's correct. MTS has no clue where it went, so it just assumed it expired.

    Abandoned == sat in your queue until the timer ran to 0
    Returned == returned

    They make little to no difference to your actual MTurk account, and in this case MTS is just wrong, but harmlessly so. Review/Returns will be processed by MTurk as actual returns (MTurk does not see your actual review, just the returned action), not abandons.

    The exact same thing would happen if you returned the HIT from a different browser profile or phone or any of a ton of scenarios that would likely pop up to make this unreliable. I'll look into it & see if I can get it to recognize return reviews properly though.
     
    • Today I Learned Today I Learned x 1
  11. Memnoch

    Memnoch New Turker

    Messages:
    22
    Gender:
    Male
    Ratings:
    +11
    Thanks Chris, I see that you're 100% correct in that it doesn't "abandon" the HITs within MTurk itself, only in MTS. Once again Turkleton, you've saved the day!

    Now as for people saying "abandonments doesn't matter", that is demonsterably false, as there are a minority of requesters that use it to qualify and it's certainly taken into account for people hoping to get Masters qualification. Still, I appreciate the help. (Probably not a great idea to tell someone to "calm down". It's meaningless over the internet and only makes people more upset in person) Concerned does not equal upset, just a protip.
     
    • Like Like x 2
  12. Memnoch

    Memnoch New Turker

    Messages:
    22
    Gender:
    Male
    Ratings:
    +11
    I... I did not know this. I'm currently sitting at an 18% return rate, which I assume isn't good. Thank you - seriously.
     
    • WOW WOW x 1
  13. Yuk

    Yuk Zing King

    Messages:
    2,585
    Ratings:
    +5,059
    I wouldn't sweat about it. I can count on one hand the amount of return or abandonment related exclude quals I've seen in 5 years so far lol
    I've seen many more hits with exclude quals of something like "Less than 50000 approved" which kind of sucks
     
    • Like Like x 1
  14. Memnoch

    Memnoch New Turker

    Messages:
    22
    Gender:
    Male
    Ratings:
    +11
    So a hilarious end to all this would be the email response from a well known requester a few minutes ago asking me what in the actual hell I was talking about!

    You guys and gals are the best.
     
    • LOL LOL x 1
  15. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,679
    Ratings:
    +162,927
    I was actually gonna mention this but figured they'd get the point across.

    IIRC, the quals were removed from the requester UI for use at all, so only an incredibly small % of requesters will even know it exists at all :emoji_sweat_smile:
     
    • Like Like x 1
  16. SunlitSunflower

    SunlitSunflower baby head

    Messages:
    22,494
    Ratings:
    +36,431