Create & Edit Annotation Tasks

Annotation tasks can be created from the Dataset Browser and the Tasks page. To browse a dataset, go to Data Management > Datasets or Project Overview from the side menu, and click on the “BROWSE” icon of a dataset.

New Annotation Task

A task is created over all items queried/filtered in the dataset browser. To learn more about filtering in the dataset browser, read here. You can also select specific items to include in a task by clicking them (hold CTRL to select multiple items) from the thumbnails or details view.

The Create Task dropdown menu in the Dataset Browser allows you to create a new task (“Create task”) or add items to an existing task (“Add to existing task”).

The Create Task button on the Tasks page allows you to create a new task, but not to add items to an existing task.

Annotation Task Parameters

When selecting “Create task,” a dialog box will open. Complete the steps to create a task. You can navigate between steps by clicking Next Step or Back or by clicking on any step from the step list on the left.

Once each step is completed, it will appear in green with a checkmark next to it on the step list. When all steps are completed, click Create to create the task.

General – select the task’s name, type, owner, status, and due date (optional).

Data – select the data source, folder or saved DQL query to filter the items (optional), and the scope of the items (the number or percentage of items included in the task). When creating a task from the dataset-browser, The Dataset section will be locked and reflect your query and items.

Instructions – By default, the recipe selection shows the Dataset's default recipe, and cannot be changed at this step. An instruction document (optional) and instruction range; tools setting (optional); and labeling task actions/statuses (use the default actions and/or add new actions).

Team – select the allocation method and contributors.

• The distribution allocation method means items will be distributed in advance among workers, equally or based on custom percentage.

• The pulling distribution method means workers only pull a batch of items at a time. This option will be availalbe soon.

Add to Existing Task

Before adding items to an existing task, you may select the items you wish to add by clicking on them (CTRL+click to select multiple items). If you do not select any items, you can choose to filter the items with a DQL query or add all items that are not already included in the task.

Data – select the existing labeling task you wish to add items to, a DQL filter query if applicable, and the scope of the items you wish to add (enter a number or percentage).

Team – select the contributors, and click Add.