Hi all,
I'm hoping to get some feedback from you about the feasibility of study design that I'm about to start running with my group.
We're starting a data collection project where we need a group of workers to take on a series of 3-5 minute HITs spanning about five weeks. It's important for this project that we recruit people who will continue to take new HITs each week for the full period of time. We're hoping that the people we recruit will be able to spend at least 4 hours each week on our HITs, with a pay rate working out to $15/hr.
We're planning to send out emails each time we release a new batch of HITs, increase the possible bonus for participation each subsequent week, and obviously accept all work done in good faith. But even with these measures, we're worried that participation may drop off after the first week or two.
So, my main two questions are:
- Does five weeks sound like too long of a time for a select group to keep working on our HITs?
- Is there anything else we could do to increase the rate of people coming back week after week?
Tags:
Page 1 of 2
-
I think it's going to come down to how many HITs you are looking to release a week, and how much each HIT is going to pay. If you make it so that each one is worthwhile pay wise, people will do as many as they can. If they are really tedious, use a bad platform, or require some extra like voice/webcam people are going to be turned off by them.
-
Like x 4
-
-
I personally like the idea of knowing that I have some steady work for 5 weeks. But as was mentioned above, it depends on the hit. If people like them and the pay is good, they will keep doing them. But if there are problems with the hit, or they just aren't worth it, people will stop doing them.
-
Like x 3
-
-
apologies for any typos I missed dropped my laptop now the keyboard is being wacky-
Like x 2
-
-
Requester name/ID?
https://go.cloudresearch.com/knowledge/conducting-longitudinal-studies
-
Like x 4 -
Love x 1
Last edited: Oct 12, 2020 -
-
- maintain a consistent hourly; make sure your HITs are easy to catch for qual'd people; keep your HIT durations as high as possible-
Like x 2
-
-
One of the biggest turn offs that I have run into, and I believe other workers will agree with, is what feels like a bait and switch first task in a longitudinal series of HITs. When you get a 10 minute task that pays, say $2.50, and you complete it in 2 minutes you feel really good. Then the requester realizes that they "over paid" on the hourly and the next 10 minute task pays $0.50 because they decided that they to align real completion time back down to their $15 and hour rate people get really turned off. Even if the "hourly" is what was promised, workers are going to look at it like "why the hell am I going to do the same amount of work for 1/5 the pay".
However, you have to be careful that you don't swing too far in the other direction. And put the first HIT up at what seems to be too low of a wage because your test group is completing it faster than expected. This will only get you desperate or new workers who don't know how, or can't, get good paying tasks. The first HIT of a series, when people don't have previous work by a requester to go off of, they only look at the estimate time on task and the how much the task is going to pay. Hourly is irrelevant to most people because it's a guess by the requester at best.-
Like x 1
-
-
Thank you so much everyone! The advice has been really helpful, and I appreciate everyone's input. I'll definitely be taking all these points into consideration.
-
Like x 2
-
-
I did most of the steps mentioned to minimize attrition. More than 60% of the participants did not complete the task (returned the HIT). Now, I am left with only two participants who completed and submitted the task. My case might not apply to yours because my study requires a specific background.
-
-
Like x 1
-
-
-
Today I Learned x 1
Last edited: Oct 14, 2020 -
-
I'm running a pre-test for this series of HITs now, if anyone is interested in completing it for entry into the 5wk series (expected to start in 2 weeks):
Requester: Alicia Parrish
Requester ID: A2Y2BMK767GIAU
Title: Statements about short texts (~6min)
Description: Read a line from an unfamiliar text and write five sentences that relate to it (~6min)
Remuneration: $1.50
HITType Id: 3CW8JHPWN0MAY5GWY127Z21V8HI0RW
Qualifications: location in the US, HIT approval rate >= 98%, number of HITs approved >1000
I'm releasing these in small batches. If they're gone by the time you check but you're very interested in participating, just DM me with your ID and I can release a HIT for just you. -
I think my feedback was something to the effect of:"any content words repeated from the context"-
Love x 2 -
Today I Learned x 1
-
-
-
Like x 1
-
-
-
-
There's a ~16 page chapter (pages 198-216) that provides guidelines for conducting longitudinal surveys using MTurk. Might be useful for you, if you can get your hands on it.-
Like x 2 -
Today I Learned x 1
-
-
-
Like x 3
-
-
If this still is available to sign up for, I am very interested.
-
I am new by only a few weeks but I would be happy to do the 5 weeks for decent pay!
-
Like x 1
-
Page 1 of 2