MTurk Cookies & 400 Bad Request Errors

Discussion in 'Help & Guides' started by ChrisTurk, Jun 20, 2019.

  1. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,698
    Ratings:
    +163,052
    [​IMG]
    Yesterday evening MTurk made a change to how the website operates. Now when you accept a HIT the response sets a "cookie" in your browser with information about the HIT (no clue why or the purpose).

    This is fine if you accept HITs & submit them all from the exact same browser and the same profile/session. However if you accept HITs in one browser/profile, and return/submit from another one, the cookies will not expire properly and can cause all of your requests to MTurk to be overloaded when sending these cookies to the server.

    Right now (as of June 20th, 2019 2PM EST) these cookies have absolutely no purpose other than to break the website functionality of anyone using advanced workflows/scripts, so the suggested solution to resolving the issue w/o giving up your workflow is as follows:

    ***IMPORTANT*** You only need to follow these steps for the browser/profile you accept HITs from
    • In Chrome, Opera, Vivaldi and other Chromium based browsers install EditThisCookie from here:
    • In FireFox you can try this but I don't have detailed instructions for it, sorry:
    • Right click the extension icon and go to Options
      • upload_2019-6-20_14-14-3.png
    • From the options click on "Blocked cookies" on the left navigation pane, on the right hand side click "block cookie" and enter a record as shown in the screenshot:
      • upload_2019-6-20_14-15-34.png
      • Domain: worker.mturk.com
      • Name: Hit-*
      • Value: any
    • Hit ENTER to make sure the entry is saved (there is no save button, enter will save it)
    • Use chrome://restart (or just completely close out of your browser & reopen it for other installs) to make sure the changes take full effect
    This will prevent MTurk from setting these cookies so if they actually implement some functionality around this at a later date this guide may impair your ability to use MTurk. PLEASE send in a support ticket with MTurk and let them know whatever they are trying to do is a bad solution because even at 25 HITs in a queue they are dangerously close to the request maximum when implementing these cookies and if they append any more information to these things MTurk will be grinding to a halt for everyone.
     
    • Today I Learned Today I Learned x 17
    • Love Love x 10
    • Like Like x 1
    Last edited: Jun 10, 2021
  2. Kan Du

    Kan Du Well-Known Turker

    Messages:
    2,502
    Gender:
    Female
    Ratings:
    +2,722
    FYI: You need to hit Enter while in the row with the new block to save it.
     
    • Like Like x 4
    • Today I Learned Today I Learned x 2
    • LOL LOL x 1
    • Love Love x 1
  3. GimmeHits

    GimmeHits Well-Known Turker TurkerView Masters

    Messages:
    2,553
    Gender:
    Male
    Ratings:
    +2,898
    :emoji_clap:
     
    • Like Like x 1
    Last edited: Jun 28, 2019
  4. sundar

    sundar New Turker

    Messages:
    5
    Gender:
    Male
    Ratings:
    +2
    Its safe or not, i was got 400 bad requester error, get some days...
     
  5. Lindazzz

    Lindazzz Turker

    Messages:
    32
    Ratings:
    +13
    I use Chrome only for Mturk, (and Waterfox for everything else.) I usually throw out all of my Chrome cookies regularly. Is it better to use the Edit Cookie extension?
     
  6. Lindazzz

    Lindazzz Turker

    Messages:
    32
    Ratings:
    +13
    Just re-read this. First, Amazon answers support tickets with form letters, so we're really on our own. I once sent them one on another topic.

    Since this article was written in June, is anyone having problems because their MT cookies are blocked?
     
    Last edited: Jan 11, 2020
  7. marcusdavvid

    marcusdavvid Well-Known Turker

    Messages:
    2,926
    Gender:
    Male
    Ratings:
    +5,187
    @ChrisTurk
     
  8. jose miguel sanchez

    jose miguel sanchez New Turker

    Messages:
    1
    Gender:
    Male
    Ratings:
    +0
    Hello, I also use chrome and I do the same as you
     
  9. WildFlower

    WildFlower Survey Slinger FF Champion II

    Messages:
    4,305
    Gender:
    Female
    Ratings:
    +5,004
    FYI, this reared it's ugly head for me today again

    I should add, directions from @ChrisTurk still work to fix this
     
    • Like Like x 3
    Last edited: Nov 6, 2020
  10. IcyTundra

    IcyTundra Tundra Thundra

    Messages:
    9,022
    Gender:
    Female
    Ratings:
    +17,082
    This just happened to me today. Had never seen this before. Just went through all the steps and things and hoping it works.

    Thanks for posting this :emoji_fingers_crossed:
     
    • Like Like x 1
  11. Thomas William

    Thomas William New Turker

    Messages:
    4
    Gender:
    Male
    Ratings:
    +0
    • Right click the extension icon and go to Options.
    • From the options click on "Blocked cookies" on the left navigation pane, on the right hand side click "block cookie" and enter a record as shown in the screenshot: Domain: worker.mturk.com. Name: Hit-* Value: any.
     
  12. sander

    sander New Turker

    Messages:
    23
    Gender:
    Female
    Ratings:
    +3
    I've done what you said up above. I have Chrome. But how do you save what you put in. There is nowhere to save the block rules. And I get in and get back in and the info I entered is gone. ??

    This is a bummer, every hit I get into says
    Sorry, there was a problem with the requested page
    I wrote a message to MTurk but I'm not sure it will do any good.
     
  13. sander

    sander New Turker

    Messages:
    23
    Gender:
    Female
    Ratings:
    +3
    Oh, I just read the post up above how to save it so I will try it.
     
  14. sander

    sander New Turker

    Messages:
    23
    Gender:
    Female
    Ratings:
    +3
    There still are problems, I still can't do any hits. I get that message I posted above. Am I having a different issue maybe?
     
  15. sander

    sander New Turker

    Messages:
    23
    Gender:
    Female
    Ratings:
    +3
    This is the whole message I get when I try and do a hit.

    Sorry, there was a problem with the requested page
    This was unexpected and we are looking into it. Feel free to contact us if this problem persists for you. In the meantime let’s go home and try again.
     
  16. Sheri

    Sheri Turker

    Messages:
    78
    Gender:
    Female
    Ratings:
    +23
    I will try it. I see this when I work on MLDataLabeler:
    Sorry, we couldn’t find that page
    Strange... the page you were looking for is not here. Let’s go home and try again.

    Go Home
     
  17. yokebec

    yokebec New Turker

    Messages:
    2
    Ratings:
    +0
    I have a question. If survey has a broken link should I just feel out the box of feedback or I need to send that and also return the hit?
     
  18. Sheri

    Sheri Turker

    Messages:
    78
    Gender:
    Female
    Ratings:
    +23
    sometimes I click on the [ i ] in the top left corner and message the requester. Some requesters appreciate it and others don't care. Sometimes the surveys are handled by Cloud Research or other platforms and there is little communication. Sometimes I use feedback in the bottom left corner if there is no code but I don't think amazon cares.
     
  19. jim718181

    jim718181 Survey Slinger

    Messages:
    2,708
    Gender:
    Male
    Ratings:
    +3,777
    Bump.

    This is still a thing in June 2024. The fix @ChrisTurk described is still working. The edit this cookie extension is on manifest version 2. I'm guessing all hell breaks loose if they don't update the extension and Chrome shuts it down.