Fraudulent? One person using multiple MTurk accounts?

Discussion in 'Requesters' started by HUANREN ZHANG, Mar 13, 2024.

  1. HUANREN ZHANG

    HUANREN ZHANG A2J47PTIYO03TZ

    Messages:
    8
    Gender:
    Male
    Ratings:
    +3
    I have been running interactive economic games that require real-time interactions between workers. I noticed that sometimes in a session with 60 workers, the geolocation indicates half of them are from the same city, which is statistically impossible. And these workers provide bad quality data -- it seems that they just clicked through without thinking. What makes it more suspicious is that some of the workers seem to take turns to answer the questions, and the answers they provide are quite similar, making me believe that it is actually one person using multiple accounts. This issue occurs for almost all the sessions. I have used CAPTCHA and checked for the usage of VPN, but it does not seem to solve the problem.

    I just want to ask: Is there any way for one person to bypass Amazon's restriction and work on the same assignment using multiple accounts? Anyone knows how to detect that and solve the issue?
     
  2. j0sh83

    j0sh83 Survey Slinger

    Messages:
    5,433
    Gender:
    Male
    Ratings:
    +8,149
    Each person has a unique worker ID, however, If they have multiple ID's through whatever means (e.g. stolen), it wouldn't be hard to run multiple incognito windows with each ID logged in. Other than what you are already doing, not sure how you could circumvent it. I am not a requester, so this is just me spitballing.

    I think you should at the very least reject the garbage submissions and block their ID's. This will only stop the ID's you've already encountered, but it's a start.

    You could also try to limit their access by adding qualifications:
    • HIT approval rate (%) >= 99
    • Location EqualTo US, CA, GB
    • A custom qual.
    If your target audience is native English speakers, you could throw in a few English comp checks at the start to try and route them out that way. Wouldn't use multiple choice or any thing they could copy and paste into ChatGPT.
     
  3. dianabaror

    dianabaror New Turker

    Messages:
    1
    Gender:
    Female
    Ratings:
    +0

    Hi,
    I noticed the same issue at the last days. There are about 5-8 different users with different WorkId repeat the same data at my survey. He writes "green" word for every area text and at the comment input "good". Is it possible that there are so many accounts owned by the same person?
    Please assist,
    Diana.
     
  4. HUANREN ZHANG

    HUANREN ZHANG A2J47PTIYO03TZ

    Messages:
    8
    Gender:
    Male
    Ratings:
    +3

    Thanks for the input. I do not have hard evidence that these accounts are used by the same person so I do not have strong reasons to block these accounts. I simply use some screening to filter out potentially fraudulent accounts and reject assignments if they appear to be of low quality.

    The other day I had two workers who asked me to give them bonuses without even participating in the experiment (they only participated in the qualification HITs). They were from the same locations according to the geolocation information collected from the qualification HITs, and their inquiry emails used exactly the same wording. Making me more convinced about the issue, even though it is not clear to me how they are able to use multiple accounts to accept and submit HITs.
     
  5. HUANREN ZHANG

    HUANREN ZHANG A2J47PTIYO03TZ

    Messages:
    8
    Gender:
    Male
    Ratings:
    +3
    That is what I am also wondering -- I don't know. In theory they cannot, but increasing evidence shows that many accounts are used by the same person.
     
  6. j0sh83

    j0sh83 Survey Slinger

    Messages:
    5,433
    Gender:
    Male
    Ratings:
    +8,149
    I think the issue stems mostly from stolen accounts, but could also just be sharing. In the physical gig economy it happens a lot. Someone who doesn't have credentials shares someone's identity in exchange for some of the profits. And all you need to do is open a couple/few incognito windows to log into multiple accounts at the same.
     
  7. Zackary Wolf

    Zackary Wolf New Turker

    Messages:
    2
    Gender:
    Female
    Ratings:
    +0
    Custom Brex Credential is 1. my Custom Brex Credential is none . How to update 1.