Instructions for posting a simple paraphrase judgement HIT to MTurk using the web interface.

1. From your account's main page, click on "Create" at the top and then on "New Project."

2. Select the "Other" option at the bottom of the list of templates and then click on "Create Project."

3. In the "Enter Properties" tab, you can set tile, description, keywords, redundancy, and payment options. (Pro tip: Rumor has it that checking the "may contain nudity" box will attract more Turkers and get your job done more quickly.)

4. To set worker requirements, click on "Advanced" at the bottom of the page and then on "Worker Requirements." By default, MTurk restricts your HIT to only "Master Workers," who are MTurk-sanctioned workers who have met some undisclosed criteria for being considered reliable and high-quality. If you do not want to use Master Workers, choose "Customize Worker Requirements," remove the "Masters" qualification, and select your own qualifications. 

NOTE: I usually use 3 Qualifications as a default: HIT Approval Rate = 90%, Number HITs Approved = 50, and Location = US (or another country if I am working in another language). The location restriction has a huge effect on the quality of your results. 90% is a fairly low approval rate, but I prefer to set a lower barrier to entry and then perform my own QC to filter out spammers. If you want to spend less time on QC, you can increase the approval rate threshold.

5. Click design layout at the bottom of the page to go to the HIT design editor. You can use the WYSIWYG editor to design your HIT, or you can click on "Source" to open an HTML editor. Since this tutorial uses some javascript in the HIT design, we will work from the HTML editor.

6. Copy and paste the contents of hit_template.html into the editor and then click "Preview". Note we use the ${VARIABLE_NAME} syntax to access variables in our data spreadsheet. In step XXX we will upload our csv, each row of which corresponds to one HIT. In our HIT design, when we use a variable reference like ${sentence0}, MTurk will populate this with the value of the "sentence0" column of the row of the csv to which the HIT corresponds.

7. Click "Finish". You will be brought back to the main "Create" page and you new HIT should appear at the top of the list. Click on the "Publish Batch" button, and upload the paraphrase_input.csv file from this directory. You will get some warnings about unused columns, these are fine.

8. Preview your HIT to make sure it looks okay, and then click Next. On the next page, click "Publish" and you are done.

