Note
  • 13 Sep 2023
  • Dark
    Light
  • PDF

Note

  • Dark
    Light
  • PDF

Article Summary

The Note Annotation tool is designed to enable communication between the annotator and the annotation manager.

The Note Annotation is available for images and videos only, and an annotation cannot have attributes.

This tool allows annotators and annotation managers or reviewers to raise and resolve questions and issues (in the course of the annotation task or quality assurance task) while working with the annotations.

Working with the Note Annotation Tool

To create a note, follow these steps:

  1. Click on the Note tool. ladyBug.png
  2. Click the place on the image where you need to create the note. On a video, you can also adjust the start and end time for the Note annotation to appear.
  3. In the Issues dialog box, type a free-text message and click Apply or press Enter to submit your message.
  4. If you wish to edit or delete a message in the Issues dialog box, hover over the message and click the edit or delete icon.
  5. Finally, click Save Changes to save the note. Now, a ladybug mark will appear on the image in the place where you created the note, and the annotator or annotator manager will be able to read the note and respond to it.
  • Notes (ladybug marks) are adjustable in their size and can be dragged on the canvas.
  • Every message includes the creator’s user name, content, and creation date.
  • To read the messages inside a Note, ensure you selected the Note tool from the tool list.
  • Now, double-click on the annotation (the ladybug mark) and the Issues Dialog will appear, allowing you to read the messages listed at the bottom of the box or enter a new message.

Opening, Reviewing, and Resolving Issues

Notes, issues, and reviews contain the assignment ID of the assignment in which they are made and are seen by the annotator working on that specific assignment.

When assigning an issue to an assignee who has no assignments or tasks, the issue will receive the assignment ID of the assignment person who created the issue which is working on.

Adding a Note/Issue in a Task vs Dataset Browser

  • If a note is created in a task, it creates an issue in that task. That issue is visible and can be reviewed in the task.

  • If a note is created in the dataset browser, the issue is visible and can be reviewed in the dataset browser and analytics, but not in any task (the note icon will appear, but an issue will not be created, and the item can still be set to Completed status).

  • This also applies to creating notes from the SDK. If the note/issue is created from the SDK without an association to a task (i.e., without a taskId or assignmentId), an issue will not be created on any task but can be viewed from the dataset browser and analytics.

  • An issue or a note created with no assignment/task association will not be assigned to any user for review or approval, simply because there is no one specific to assign the note/issue to.

Such a situation can occur if a note or issue is created from the dataset browser and not in a task context.

To resolve this situation, you will need to use the Dataloop SDK and add an assignment ID to the annotation (see SDK Update Annotation).

When an annotation manager or higher-role user (developer or owner) creates a note, this will create an issue. issue.png

When an issue is created, the annotator will not be able to mark the item as Done, until the issue is addressed.

The annotator will need to address the issue, click on the magnifying glass icon for review, and only then click Done.

recipe

The annotation manager can review the item, and if the issue has been addressed satisfactorily, Approve it by clicking the checkmark icon at the top of the Annotation panel.


Unless deleted, Note Annotations will remain visible and their internal text messages will be accessible through the Annotation Studio.

  • If you wish to filter all items that have a note on them, use our data filter to filter items for Annotation Type: Note. This can be done in the Dataset browser and the Task browser.

  • Once a note is deleted it does not exist in the Annotation JSON file, and therefore there is no way to list all items that had a Note annotation if the note was deleted.

  • The total number of issues created can be seen in the Analytics Progress Dashboard.