avatarAleena Rayamajhi

Summary

Makesense.ai is an intuitive platform for efficiently annotating images in machine learning and computer vision tasks, offering a streamlined alternative to VIA (VGG Image Annotator).

Abstract

The Image Annotation Using Makesense.ai article discusses the challenges of image annotation as a critical step in data preprocessing for machine learning. It highlights makesense.ai as a user-friendly tool designed to simplify the task of labeling objects in images with features such as bounding boxes and labels. The platform supports various shapes for annotations, with polygons being preferred for instance segmentation in CNNs. The article provides a step-by-step guide on how to use makesense.ai, from uploading images to exporting annotations in formats like VGG JSON and COCO JSON. It also touches on the use of a drawing tablet for annotation and the importance of the x and y coordinates of each region for training machine learning models.

Opinions

  • The author suggests that makesense.ai offers a more straightforward and intuitive interface compared to VIA, indicating a preference for makesense.ai in image annotation tasks.
  • Polygon shapes are recommended for instance segmentation in CNNs, which implies that the author considers this shape to provide superior accuracy or compatibility with CNN algorithms.
  • The use of a Huion Drawing Tablet is mentioned as a preference for labeling, suggesting that the author finds it to be a more efficient or ergonomic tool compared to a standard mouse.
  • The ability to export annotations in two different JSON formats is highlighted, which could indicate the author's appreciation for the platform's flexibility in accommodating different data formats for various machine learning frameworks.

Image Annotation Using Makesense.ai

Image Annotations using Makesense.ai

Capturing images for data collection is easy; what comes next is challenging. Image annotation or labeling is one of the most time-consuming and labor-intensive steps of data preprocessing in machine learning and computer vision tasks.

Image annotation means adding labels or markings to images to identify and define objects or regions of interest. It typically includes bounding boxes and labels to indicate the type of object or category.

An image with annotations of disease symptoms using polygons

You can annotate your images using makesense.ai, a user-friendly image annotation platform. It provides a straightforward and intuitive interface for labeling objects in images. While VIA (VGG Image Annotator) is an alternative, makesense.ai offers a simpler and more streamlined experience for image annotation tasks.

Image Annotation Instructions for Makesense.ai

  1. Go to the website: makesene.ai and click on Get Started on the bottom right.

2. You’ll be taken to a new window. You can click on Drop images or drag the images from your computer directly.

3. After dragging or uploading the images, click on Object Detection.

4. You’ll be asked to define your labels. You can add one or many, depending on the number of classes you’ll define. In my case, I’m just adding one label name, i.e. Anthracnose, as shown on the image below.

5. Click on the image you want to begin annotating on the left side. Then, select the shape from rectangle, point, line, and polygon. Generally, polygon shape is preferred for instance segmentation in CNN. I’ve selected polygon for my labeling as shown below:

6. Label appropriately for all objects. I prefer using the Huion Drawing Tablet for labeling. But you can use mouse as well.

7. You can import more images to the existing library by clicking on the Import Images button under the Actions tab on the top left.

8. A magnifying icon with a + and — sign is for zooming in and out. A hand icon is for dragging the images when zoomed; and an icon next to the hand icon is the cursor crosshair icon, which, when turned on, changes the appearance of the cursor to a cross-hair. With this mode on, the shape of the cursor changes into a cross-hair, which can be moved around the screen to target and select an element, such as a button, link, or image.

9. You can export the file after annotations are complete by clicking on Export Annotations under the Actions tab.

10. You can choose two formats (VGG JSON and COCO JSON) to export the file, as shown below.

Viewing JSON File in Notepad++

You can open the downloaded JSON file in Notepad++ to see the features of the annotations. In order to align the data so that it is easily readable, click on Plugins, then click on JSTool, and select JSFormat as shown in the image below.

The annotated images will be organized and displayed in the following way:

{ ‘filename’: ‘Image.jpeg’, ‘regions’: { ‘0’: { ‘region_attributes’: {}, ‘shape_attributes’: { ‘all_points_x’: […], ‘all_points_y’: […], ‘name’: ‘polygon’}}, … more regions … }, ‘size’: 100202 }

We mostly care about the x and y coordinates of each region. You can load the JSON file in Python and train your model.

Shortcut Keys for makesense.ai:

  1. CTRL + mouse-wheel scroll up/down: Zoom in/out.
  2. Mouse-wheel scroll up.down: move the image in vertical direction.
  3. SHIFT + mouse-wheel scroll up/down: move the image in horizontal direction.
  4. ESC: terminate annotation and start new.
  5. DEL: delete annotated object that is selected.
Image Annotation
Recommended from ReadMedium