Shoonya User Manual for Annotators

Accessing Shoonya

To start working on a project, a user needs to create a new account on the platform. Annotators are invited to Shoonya by Organization Owner. Once invited, they will receive an 'Invite Link' on their e-mail ID. They can access the link in the email and create login credentials for accessing Shoonya.

Shoonya Home Page

After logging in to Shoonya, annotators are directed to the Projects Dashboard as the default landing page. It has a list of all the projects that they are assigned to.

Projects

Refer to /~https://github.com/AI4Bharat/Shoonya/wiki/Project-Types for the project types that are currently supported in Shoonya.

Project Page

Clicking on any project card in the project dashboard page, displays the project page.

It shows the project title, description and the number of unassigned tasks. The 'Annotation Tasks' tab displays the list of annotation tasks that have been assigned to the annotator. Initially, it will not display any tasks.

The annotator has to click on 'Pull New Batch' to pull a set of tasks.

• The annotator can use Deallocate Tasks button to unassign all unlabeled, skipped and draft tasks assigned to him.
• The annotator can then start annotating either using 'Start Labelling Now' button to continuously annotate tasks or click on 'Annotate' button to annotate one task at a time.
• The annotator can filter the tasks based on its status - Accepted, Skipped, Draft, To Be Revised and Unlabeled.
• The annotator can also search for a particular task id or filter for tasks having any specific keywords.
• The annotator can access their own performance statistics for a selected date range using the Reports tab in the project page.

Task Annotation Page

Irrespective of what the project type is, an annotator can use the 'Update' button to submit the annotation for a task. Only a task which has been submitted will have its annotation saved. 'Skip' button can be used to skip annotating a task. Notes can also be added for a task and a task can be marked as 'Draft'. An annotator also has the option of re-editing resubmitting a task using 'Update' button. The 'Next' button takes the annotator to the next task.