makesense.ai is a free to use online tool for labelling photos. Thanks to the use of a browser it does not require any complicated installation - just visit the website and you are ready to go. It also doesn't matter which operating system you're running on - we do our best to be truly cross-platform. It is perfect for small computer vision deeplearning projects, making the process of preparing a dataset much easier and faster. Prepared labels can be downloaded in one of multiple supported formats. The application was written in TypeScript and is based on React/Redux duo.
For AI to be free we need not just Open Source, but also a strong Open Data movement.
Andrew Ng
makesense.ai strives to significantly reduce the time we have to spend on labeling photos. To achieve this, we are going to use many different AI models that will be able to give you recommendations as well as automate repetitive and tedious activities. The first step on this journey is to use a SSD model pretrained on the COCO dataset, which will do some of the work for you in drawing bboxes on photos and - in future versions of the application - will also suggest a label. We also plan to add, among other things, models that classify photos, detect characteristic features of faces, whole faces, and also human pose. The engine that drives our AI functionalities is TensorFlow.js - JS version of the most popular framework for training neural networks. This choice allows us not only to speed up your work but also to care about the privacy of your data, because unlike with other commercial and open source tools, your photos do not have to be transferred to the server. This time AI comes to your device!
# clone repository
git clone https://github.com/SkalskiP/make-sense.git
# navigate to main dir
cd make-sense
# install dependencies
npm install
# serve with hot reload at localhost:3000
npm startTo ensure proper functionality of the application locally, an npm 6.x.x and node.js v11.x.x versions are required. More information about this problem is available in the #16.
| Functionality | Context | Mac | Windows / Linux |
|---|---|---|---|
| Polygon autocomplete | Editor | Enter | Enter |
| Cancel polygon drawing | Editor | Escape | Escape |
| Delete currently selected label | Editor | Backspace | Delete |
| Load previous image | Editor | ⌥ + Left | Ctrl + Left |
| Load next image | Editor | ⌥ + Right | Ctrl + Right |
| Zoom in | Editor | ⌥ + + | Ctrl + + |
| Zoom out | Editor | ⌥ + - | Ctrl + - |
| Move image | Editor | Up / Down / Left / Right | Up / Down / Left / Right |
| Exit popup | Popup | Escape | Escape |
Table 1. Supported keyboard shortcuts
| CSV | YOLO | VOC XML | VGG JSON | COCO | PIXEL MASK | |
|---|---|---|---|---|---|---|
| Point | ☑ | ☒ | ☐ | ☐ | ☐ | ☒ |
| Rect | ☑ | ☑ | ☑ | ☐ | ☐ | ☒ |
| Polygon | ☐ | ☒ | ☐ | ☑ | ☐ | ☐ |
Table 2. The matrix of supported labels export format, where:
- ☑ - supported format
- ☐ - not yet supported format
- ☒ - format does not make sense for a given label type
You can find examples of export files along with a description and schema on our Wiki.
We don't store your images, because we don't send them anywhere in the first place.
Our application is being actively developed. Check out our plans for the near future on our Wiki. If you have an idea for a new functionality, please hit us on Twitter and Gitter or create an issue where you can describe your concept. In the meantime, see what improvements we are planning for you in the future.
Feel free to file issues or pull requests.
@MISC{make-sense,
author = {Piotr Skalski},
title = {{Make Sense}},
howpublished = "\url{https://github.com/SkalskiP/make-sense/}",
year = {2019},
}
This project is licensed under the GPL-3.0 License - see the LICENSE file for details
Copyright (c) 2019-present, Piotr Skalski