Computer Vision Platform

Automatic categorization is a process in which every image is assigned to a category. It is powered by AI which was trained to recognize the categories of images. Each image belongs only to one, visually distinctive, category – for example, dress vs. trousers. E-shops typically use a hierarchical taxonomy of products, so they work with both categories and sub-categories.

Automatic image tagging is a process in which each image is tagged by AI based on attributes recognized in the image. For example, when you upload a photo of a dress on a model, the dress will be put into the category dresses and subcategory casual dresses, and tagged with tags describing its colour, pattern, design, style, material, length, and other attributes.

In the case of categorization & tagging, a label is a term describing both categories and tags. Object Detection, on the other hand, works with detection labels, labelling the detected objects, people, or animals in the images.

Ximilar provides several categorization and tagging services. You can either use our ready-to-use Image Recognition services (such as Fashion Tagging or Home Decor & Furniture Tagging) or train your own from scratch on Ximilar computer vision platform. Both ready-to-use services and custom tasks can cooperate through Flows.

The training of machine learning models is available to everyone. First, log in to Ximilar computer vision platform, then check our comprehensive guide on How to Build Your Own Image Recognition API.

Technically, there is no limitation to the number of labels per task. However, using hundreds or more labels would require a very large volume of training data. In such cases, we recommend creating a hierarchy of models and combining them with Flows.

Yes! The basic principle of our solutions lies in separate machine learning models, which work together or in a modular structure of Flows. Flows enable you to chain your models in a sequence, combine them, put them in a hierarchical structure, and implement conditional processing.

Object detection models’ training requires the training dataset to be annotated. The annotation of images means marking the objects we need to be detected with bounding boxes. Precise and consistent image annotation is a key to successful object detection solutions. It is done manually, but can be assisted by the AI. At the Ximilar platform, users can annotate their training images both in the App and in a dedicated interface Annotate.

Annotate is an advanced image annotation tool by Ximilar built for the annotation of large volumes of training data effectively, precisely, and fast. It is web-based and connected to the same back-end & database as Ximilar App. Therefore, all changes you do in Annotate will also be visible in your workspace in App. It is connected to Rest API with Python SDK, and annotated data are queried.

You can upload images through the App, and annotate them in Annotate. You can work in a team, assign annotating jobs to your teammates, and set how many times each image should be checked.

The basic principle of image annotation in Ximilar App and Annotate is the same: you view an image, pick which object detection task should predict the objects in the image, and then check the position of bounding boxes or draw new ones. You can check the assigned labels (categories and tags) and add new ones from the hierarchy (in Annotate) or even create new ones (in App). You can use both interfaces to create and train your tasks.

Ximilar App is great for creating entities such as labels and tasks, uploading data, model training, task management, and batch management of images (bulk actions for labelling and filtering). If you need to add new labels (tags and categories) even while annotating your images, you can do it in App.

If you need to annotate a lot of images, and you already have a hierarchy of labels (in App), we recommend uploading images there and then working in Annotate. The main difference is Annotate enables you to process large amounts of training images precisely, but fast, with several advanced features.

Your company account can have many workspaces, each for one project. Your team members can get access to different workspaces. Also, everyone can switch between the workspaces in the App as well as in Annotate (top right, next to the user icon). Did you know, that the workspaces are also accessible via API? Check out our documentation and learn how to connect to API.

Each of your models automatically goes through testing on an evaluation dataset during the training phase. You can also add a separate test set.

You can test your models both via standard Rest API endpoint and in Ximilar App. Click on Tasks, scroll down to Models and click on a magnifying glass to view the details about a particular model. There you can check the evaluation metrics (accuracy, precision, recall, confusion matrix, and failed images). Based on these metrics, you can further iterate and improve your training dataset to make your model more robust. We are also able to change the architecture of the neural network if needed and improve the robustness for your specific data.

You can also test the accuracy of your model on a particular image. Drag & drop the image or copy its URL to Test under your service.

A/B testing is a technique to test and decide whether the new version of your machine learning model performs better than the previous one based on selected metrics.

The mAP, or mean average precision (AP) is an evaluation metric describing the precision of your object detection models. It is calculated from IOU (the Intersection Over Union is used to determine whether the bounding box was correctly predicted), Precision, Recall, Precision-Recall Curve, and AP. You can find the mAP of your object detection model per label in your workspace under Object Detection: Tasks: Models in the detail of the particular model.

The task is the latest and the most accurate version of the machine learning model you trained. Read How Ximilar technology works? for details.

Any image that is processed by a deployed machine learning model can be saved to the workspace and used to retrain the model to improve it. The retraining is done manually after annotators check these new images. Then the new, better and more accurate, version of the model is deployed. This loop improves the accuracy of your model in the long term, especially if the character of the data changes over time (e.g. the lightning of the scene changes dramatically). See pricing for details about availability.

Image recognition is a technology able to recognize an image (e.g., a picture of a shoe) and describe its appearance with tags (e.g., leather, brown, women’s shoes, high heels).

Ximilar provides several off-the-shelf solutions for the detection, recognition, tagging and sorting of specific image data, such as stock photos, home decor and furniture images, fashion photos, or trading and collectible cards.

Anyone can create and train their own custom image recognition models on Ximilar’s computer vision platform. Namely, you can train:

• image classification models: categorization & tagging, image regression (value prediction)
• object detection models

It requires no coding experience. The custom models can be easily combined with existing ready-to-use solutions with Flows.

Object Detection requires manual annotation of training data, which can be done both in our App and dedicated interface Annotate.

In retail, image recognition is pivotal in optimizing operations depending on visual data processing. One significant application lies in inventory management, where it automates tracking products and stock levels, streamlining restocking processes and minimizing manual effort.

Additionally, image recognition helps with consumer research, enabling retailers to gain insights into customer demographics and behaviour within physical stores. This information aids in optimizing store layouts, product placements, and staffing strategies to enhance the overall shopping experience.

Image recognition also supports personalized marketing initiatives by analyzing customer preferences and purchase history, allowing e-shops to tailor promotions and recommendations accordingly. This personalized shopping experience fosters stronger customer engagement and increases sales.

In many of these applications, image recognition works in tandem with visual search technology, which identifies visually similar products to items detected in product photos and real-life images.

Image recognition technology finds widespread application in diverse fields such as healthcare, retail, and security systems.

In healthcare, it aids in the interpretation of medical images, assisting clinicians in diagnosing diseases and identifying anomalies with greater precision. Read about some of our use cases here.

Similarly, in retail, image recognition streamlines checkout processes, and, together with visual search, enhances customer experience through personalized recommendations.

In security, it strengthens surveillance systems by enabling real-time monitoring, threat detection, and facial recognition.

This technology is also essential for autonomous vehicles, enabling them to perceive their surroundings through cameras and sensors, recognize objects, pedestrians, and road signs, and make real-time decisions for safe navigation.

Additionally, image recognition systems help in both research and applied sciences. For instance, in biological research, microscopy image analysis and wildlife conservation. It plays a crucial role in monitoring and protecting endangered species. It enables researchers and conservationists to analyze vast amounts of camera trap data efficiently, identifying and tracking individual animals, assessing population dynamics, and detecting potential threats such as poaching or habitat loss.

Image recognition aids satellite imagery analysis, especially in monitoring vegetation coverage crucial for sectors like insurance and agriculture. LAICA, by World From Space (WFS) and Ximilar, addresses this, using deep learning to merge satellite data for daily vegetation monitoring despite cloud cover challenges.

In social media, image recognition facilitates image tagging and content moderation.

The two key factors determining the accuracy of the image recognition task are the complexity of the task and the quality and quantity of the training data available. Some tasks achieve high precision easily, while others demand extensive data and effort for even moderate accuracy. The quality and accuracy of all your models can be tested, compared and improved over time on our platform. Learn more in our articles and reach out to us anytime to discuss your unique use case.

Our platform enables you to get and deploy models for image categorization (which involves assigning photos or detected objects into categories), image or product tagging (assigning more tags to each image or product, also known as multi-label prediction) and value regression (continuous value prediction from images and videos; for instance, a person’s age).

Image recognition allows computers to understand and classify images by analyzing their content. It helps with interpreting, tagging (enrichment with additional metadata), or categorization (sorting into groups) of images.

For example, if you train a dog vs. cat recognition model, and provide it with a folder of mixed pictures, it will be able to distinguish between cats and dogs, and thus sort the images into two separate folders.

It is used in various applications including medical diagnosis, autonomous vehicle systems (object recognition) or security systems (like facial recognition). The accuracy, speed, and efficiency of such systems continue to improve with advancements in artificial intelligence and machine learning techniques and depend on factors such as the quality of training datasets. Deep learning algorithms, particularly convolutional neural networks (CNNs), are commonly used for image categorization tasks.

Ximilar provides several off-the-shelf solutions for classifying specific image data, such as stock photos, home decor and furniture images, fashion photos, or trading and collectible cards. Custom models can be easily trained on our platform. Read the articles in our blog to learn about image recognition technology.

Flows are a technology for chaining, combining and building a hierarchy of tasks for complex visual AI systems. It was developed by Ximilar to make the building of visual AI solutions easier and accessible without the need for coding. We use Flows to streamline complex image processing.

Flows were made to combine different tasks into complex image processing systems. A Flow is built by adding the following actions:

• Branch Selector – contains an image recognition task; based on the recognition, your images are then processed by one or more branches of your Flow
• Recognition – performs an image recognition task and provides an output as specified by the user
• Detection – performs an object detection task, provides bounding boxes, and other outputs as specified by the user
• Object Selector – performs an object detection task; the detected objects are then analyzed separately by other actions
• Ximilar Service – calls any of the Ready-to-use Image Recognition services
• List – performs a list of actions with images (in sequence or simultaneously)
• Nested flow – calls another Flow

Yes, one task (machine learning model) can be used in multiple Flows. Just add the right type of action in your Flow and then pick your task from the selection list.

Image recognition helps optimize diagnostics, treatment, as well as patient care by employing advanced AI algorithms to rapidly analyze medical imagery. It facilitates early disease detection, personalized treatment plans, and efficient workflows for healthcare providers. Key applications include diagnostic imaging and disease detection, such as analyzing X-ray or microscopy images, as well as providing surgical assistance. Additionally, the technology helps with other vital use cases such as drug discovery and health data analysis.

Flows are available to the users of all pricing plans. Check our Pricing for details.

No, the training of custom image recognition models on Ximilar platform is completely free, as well as deploying your solutions and making them accessible to the end users. Also, unlike the competition, Ximilar does not charge the customers for idle time or training time, and the basic scheme for our App users is Free. With Ximilar, you only pay for the actual usage of the services – read about API calls & credits.

Need help with setup? Watch the video tutorial or read the guide. If you need a solution tailored to your business, feel free to contact us. We can prepare a demo on your data and deploy the system for you.

Using Ximilar services consumes API credits. Ximilar provides three pricing plans with different monthly API credit supplies, including a free scheme with 3,000 free credits. Creating a Flow and chaining tasks don’t cost any API credits. There are, however, limitations as to how many Flows you can have.

The speed typically ranges from 5 to 100 milliseconds per image for basic image classification and detection models. This timeframe varies based on factors such as input resolution, connectivity, and the speed of the image CDN used. Our platform’s models are generally very fast, and they can be fine-tuned for even greater efficiency on specialized hardware like GPUs and smartphones.