Mturk Qualification Database and Scraper

Discussion in 'mTurk Scripts & Resources' started by Elias041, Jan 18, 2023.

  1. Elias041

    Elias041 New Turker

    Messages:
    2
    Ratings:
    +8
    A new, hopefully better, Qual Sorter with amazing new features, such as:
    1. It handles timeouts. It will catch a timeout error and increment its delay higher up to 5 times. If it continues to fail after that it will stop and print a message to inform you about what happened.
    2. The table renders much faster.
    3. User-friendliness-ish, sort of. There's a progress indicator, a cancel button and error messages.
    https://greasyfork.org/en/scripts/458477-mturk-qualification-database-and-scraper

    (It's also up on Github if anyone wants to contribute to it, or fix it, or laugh at it)
    https://github.com/Elias0419/qualScraper.user.js
     
    • Like Like x 5
    • Love Love x 3
  2. Elias041

    Elias041 New Turker

    Messages:
    2
    Ratings:
    +8
    Hello everyone. I came across this post [1] and I thought I ought to drop in and say something about it.

    First of all, my script does not do anything shady or malicious. Anybody who can read JavaScript can look it over and tell you that it does exactly what it says on the tin. I wrote this script to assuage an issue with Eisen-Uchiha's Worker-MTurk Qual Sorter [2] script - namely, that it would time out silently. A common fix floating around reddit and forums was to edit the script to increase the timeout. That was my original purpose and then it blossomed into a whole script. The core functionality of my script and that script are exactly the same - you press a button and it makes a series of requests to [3] the qualifications page to retrieve all of your qualifications.

    Now, I don't know for sure that it isn't the cause of someone getting an account suspended, of course. Who knows what goes on behind the scenes of mturk? But I strongly believe that it was not. I and quite a few other people are regular users and have not had the same issue.

    I made this as a hobby project and I released it to the community in the hopes that it would be useful.

    If anyone wants to ask any questions, feel free to DM me or leave a comment on this thread. I'm also AOT in the Turkenation slack and you can contact me on my Github[4] or Greasyfork[5] pages as well.

    [1]https://forum.turkerview.com/posts/2140368/
    [2]https://greasyfork.org/en/scripts/38977-worker-mturk-qual-sorter
    [3]https://worker.mturk.com/qualifications/assigned.json
    [4]https://github.com/Elias0419
    [5]https://greasyfork.org/en/users/1004048-elias041
     
  3. laby

    laby Survey Slinger Former MTG MotM TurkerView Masters

    Messages:
    14,705
    Gender:
    Female
    Ratings:
    +31,309
    Hi, I was the one that was suspended. I did not say this script was the definite cause of my suspension, or that your script was purposely malicious, just that this was the only thing I had done differently. I installed and ran it Tuesday night and was suspended Wednesday morning. I will not know the cause unless I actually get a response from the appeals department. I have been turking for nearly a decade so perhaps the amount of pages it had to scrape triggered a few too many errors, or made me look like a bot, or it could be some completely different thing that made the mturk gods angry. If I ever find out I will certainly let everyone know.
     
    • WOW WOW x 1
  4. RosieTheRobot

    RosieTheRobot New Turker

    Messages:
    2
    Ratings:
    +0
    Wow, I'm so sorry that your account was suspended. Have you asked Turk Opticon for help? They sometimes are able to help.

    Sent from my SM-A136U using Tapatalk
     
  5. laby

    laby Survey Slinger Former MTG MotM TurkerView Masters

    Messages:
    14,705
    Gender:
    Female
    Ratings:
    +31,309
    I'm trying to give a week or so for appeals to reply before I try other avenues.
     
  6. RosieTheRobot

    RosieTheRobot New Turker

    Messages:
    2
    Ratings:
    +0
    That's a good plan.

    Sent from my SM-A136U using Tapatalk
     
  7. Razr

    Razr Jive Turkey

    Messages:
    2,270
    Gender:
    Male
    Ratings:
    +2,723
    ru chatgpt
     
    • LOL LOL x 2
    • Like Like x 1
    Last edited by a moderator: Mar 20, 2024