tl;dr
- Everyone will need an API Key starting Feb 1 Feb 7th in order to use TV with any script.
- They can be claimed here for free.
- The first month is free for every user. Once that first month ends the price is discounted at $5/month for users that sign up before Mar 1 and $7.99/month otherwise.
- NOTE: If you have submitted at least 10 reviews on TV (as of 1/20/19), you will get a permanent key for free, this covers hundreds of users who helped build TV & is also extended to a # of community members who have contributed their time/expertise elsewhere.
___________________________________Background
The original post for the new API changes is here. This post is going to serve as an update on the plans laid out in that one and to explain some of the process/decision making that came about when actually testing those plans on real users.
As I dug into MTS, Forker, & updating TVJS, I realized that my original plans for TV's API weren't going to work as intended. There was no good way to split the # of requests for a portion of a day across the scripts that needed it, given that scripts request data in different ways, cache it differently, and have different loads (MTS takes much more data than Forker, etc etc). All things TV itself can't affect or change and will be highly variable across different use cases.
On top of that, and most importantly, in testing partial day access it became clear some of the very problems the API is meant to alleviate (what MTS/Forker users currently suffer with outdated/missing data) is going to reoccur every day. Once a free daily quota limit is reached users will have some portion of data cached but not receive any new data. This means that throughout the day the information previously sent from TurkerView gets progressively worse. This leads to a poor experience for the worker & puts script authors in the position of being forced to explain why data inconsistencies manifest themselves. It's confusing, unreliable, and it'll lead to bad decisions on HITs/Requesters, never mind the technical knowledge burden that places on users.
So, better ideas aside (they're welcome if you've got them):
The Full Plan
This is simpler for all parties. It takes care of newbies (many of whom don't make it to a month on the platform anyway), old folks returning to the trenches, and gives everyone the same fair shake to figure out if TurkerView is useful & worth supporting for them.
- Since this is a divergence from the original plan I've done this: anyone who (as of 1/20/2019) has submitted 10 or more reviews already on TV has permanently upgraded free API keys. I'd absolutely appreciate it if they chose to support the site's infrastructure, but it won't be required for the API and all access will remain free.
- February 1st February 7th will mark when you need an API Key in order to access data through the API. TVJS will update today (1/21) & Forker tomorrow (1/22, TPG pending). MTS will get code pushed to it after I get some reasonable load data returned so I can make sure there is enough infrastructure in place to support it. Once/if MTS' code is accepted we'll transition. Again target date is Feb 1st Feb 7th, this is a 'best laid plans' scenario and should an issue arise I will delay auth token enforcement to preserve worker experience if need be.
- Instead of doing small daily quota limits, we are going to provide users a month of access for free to start out without any of the complicated limits previously planned. It'll work for all scripts & users wont need to worry about caps as long as they're using any of the apps currently supported in normal ways (if you're not in MTurk PRE purgatory, you'll be fine). If you claim your key before Feb 1st you'll be good until Mar 1 (so over 30 days)
- The subscription price will stay at $5/mo until Mar 1st, but along w/ the trial window period will be subject to what is actually sustainable after that (most likely you'll see it revert to the original intended prices Mar 1st & go to 2-weeks w/ a large discount + time extension for folks participating on the platform). For now, that's nominally known as the "price of a cup of coffee" on the internet, I think it's fair for both what TV represents & provides. The API is a convenience feature, there's nothing you get from it you can't really find on the website itself & I plan on adding a lot of extras/perks for supporting the website in the future (almost guaranteed before Mar even hits)
- Return Reviews, at least for the foreseeable future, will not be included in any of this. I think they're more useful to newer users & I'd like to keep them open access if possible.
Page 1 of 4
-
I support the work you share with everyone and I am impressed by your expertise in this field.
A big "THANK YOU" for all that you do.
Will you consider adding the option to pay annually?-
Love x 1
-
-
-
Like x 2
-
-
That is understandable, and I'm not sure if they notify subscribers either.
So, are the seasonal workers and those that don't hang around going to have the option to pause the monthly service or does it stay active until it's canceled? There are times when I go inactive, but, even so, I do like the idea of an annual (or even a quarterly) payment. That's just me though. Everyone on Earth might view it differently. :emoji_upside_down:
EDIT: I'm not seeking to skip months of paying. I only asked that question based on what you said about seasonal workers and wondered if that had anything to do with why you were concerned with annual payments. If I'm subscribed to the service, I have no problem paying for a full year's subscription. I just want to clarify my intent for the question since it can be tough to read people through a screen.Last edited: Jan 21, 2019 -
Crossing my fingers for MTS
-
So, just to clarify - if the only time I see TV is by the color it makes my Hit Forker light up, I won't be able to see that anymore unless I sign up today and pay $60/year?
-
I'd say definitely give it the free period to check out when Forker does update, because what you get right now w/ Forker isn't very reliable or good, but if its not useful to ya no need to fuss with it.-
Like x 1
-
-
-
I’m definitely interested in the fee, but I’m trying to grasp all that would be included when I pay? Also is there a option to pay with the money that I earned from mturk? I’m sorry this is all so new & I’m not a new mturk member, but I’m new to Turkerview
-
Like x 2
-
-
Hey Chris, Just an idea to maybe help making old data that predates the new API more reliable. Would there be a way to set the approval times and/or other data to expire after a certain amount of time? Like lets say I made a review for a hit 1 year ago and guessed the approval time or time it took to complete the hit. That data would be less correct than today with the timer and now AA being auto. Fast forward 1 year if there are other newer reviews, could that data be set to expire and removed from the database only showing newer more recent reviews and reliable data? This would be only for reviews that predates the updated system and API of course. I would figure this would make the data more reliable. As we know requesters also sometimes pay more or less and approve faster or slower through time. Something TO had a problem with is having years old data affecting their ratings when requesters may be paying better or approving faster than they were years ago when the older reviews were made. And also maybe set a min limit of reviews thus omitting the removal provisions if say a requester only has like 1 or 2 reviews. Once new reviews are made then allow the older data to be dropped. Not sure if this would be possible. But just an idea.
-
Like x 2
-
-
For now if you're not using one of those two tools, or don't care about TV's dataset in them, there's no need to worry about needing an upgraded API key at all. Especially if you're using something like HIT Scraper or Overwatch that doesn't use TV to begin with.
Even if you are using one of those two & not so much TVJS I'd give it a couple days until they're updated & confirmed stable before worrying about it. That'll be a much better time to play w/ it all & it'll be more obvious if TV's API data is useful to an individual or not, right now far too much of it is simply missing from those tools to have as much value. Most of these posts today is simply a desire to get advanced notice out for the major core users (who tend to already have TVJS installed & interact w/ it frequently) :)
And honestly, not even just for "stale" data, but AA is something reqs actually change occasionally anyway so its definitely good to have a more "rolling average" available for the API as well. Those are the kinda things that require beefier infrastructure to get rolling (the calculations on the dataset basically get doubled doing all that) but you'll see it happen :)-
Like x 3 -
Today I Learned x 1
-
-
Chris,
Can you tell me where this new version of Hit Forker is? The one in your demo video has a place for the Turkerview API key whereas my Hit Forker version 1.0.6.1 doesn't have it, I only have a Pushbullet Token space, no TurkerView.
I've looked everywhere I can think of but I can't find the version you have.
Thanks!-
Like x 1
-
-
I appreciate the work done on TV, I use it daily along with the forum so its well worth the money to me
keep up the good work-
Like x 2
-
-
-
Today I Learned x 3 -
Like x 1
-
-
I got the green update thing on my Mturk dashboard today for the API.
"Make sure to register & get your new access keys to our upgraded API by visiting your account dashboard. We'll stop displaying this as soon as you do, but the script wont function after February 1st without an API Key."
When I click the link for viewing my TV 'account dashboard', it takes me to https://turkerview.com/account/api/ and won't let me login. Whenever I click "login" or "create account" on that site, it is redirecting me here, to the forum, where I am already logged in. Is there something I am doing wrong here? Any help would be greatly appreciated, thanks! -
-
Today I Learned x 2
-
-
-
I signed up for the freebie account and got the API key; but changed my mind and signed up for the paid API key. Is the key the same or do I need to go in and change to the new key. (And if so how do I change?)
-
-
Like x 1
-
Page 1 of 4