How to Setup and Maintain Image Recognition
In order for the system to correctly recognize data from a photo, it needs initial information about the products.
The Eyrene performs Image Recognition Quality (QA) with:
- Periodic neural net retraining. Usually, 5-10 times a month depending on data change rates;
- Automated image recognition accuracy evaluation using labeled tests sets;
- Automated image recognition accuracy evaluation based on feedback from mobile users;
- Semi-manual image accuracy evaluation. This is based on image recognition internal score metrics, feedback from mobile users, and automatic measurements;
- Semi-manual corrective measures such as new product design variation introduction, new competitor brand introduction, and additional data search/labeling/cleaning.
- The image recognition accuracy evaluation report is provided by the Eyrene on weekly basis.
For the initial setup of the system, you will need to provide Eyrene staff with information about your products and those of competitors. This is necessary so that the system can learn to correctly recognize products, their parameters, tastes, sizes, etc.
- Provide Eyrene employees with information about your products and their hierarchy, equipment, POSM, etc.
- . After you provide the information, employees will begin training the system to recognize photos with maximum accuracy. The training period takes 2-4 weeks, depending on the initial completeness of the catalog. At the same time, a new product catalog will appear on the portal.
- New products or product designs. When new products appear in the assortment or the design of products changes, you need to update the catalog.
- Re-training Image Recognition. After the data is sent to Eyrene, employees will begin retraining recognition based on the new data. It takes 5 working days. At the same time, the product catalog on the portal will be updated.
For the initial setup of the system in a new market, provide Eyrene employees:
- hierarchy of your product and brand
- product catalog
- equipment catalog
- POSM catalog
- competitor catalog
- shelf image archive
This is the number of hierarchical levels and complete hierarchies used. It is usually provided in Excel files.
This is the own trade items catalog with all relevant product attributes. The product catalog can be imported from Excel tables or received from API. A minimum list of attributes:
- Primary identifier of EAN/GTIN or another identification system;
- Primary Name – in English;
- Category — lowest level of product hierarchy used;
- Brand — lowest level of brand hierarchy used;
- Manufacturer;
- EAN/GTIN or EAN list
- Product physical dimensions in mm: height, width, depth;
- At least one catalog image.
Several images can be provided to show the product from different sides or if the product has design variations. Catalog product images can be both real photos or marketing images. Image height must be larger than 400 px, high resolution is not required.
Additionally, you can provide:
- product attributes relevant to image recognition — such as product package type or size (volume/weight/etc);
- product attributes relevant for KPI calculations/aggregation/analysis;
- a list of local product names — to localize mobile app messages to the agents.
This is the own equipment catalog at the level, relevant for image recognition.
Note.
You don't need to specify each cooler model if the recognition is supposed to recognize 1- and 2-door coolers, the same for other equipment.
A minimum list of attributes: • Primary Code; • Primary Name – in English; • Equipment type (depending on equipment classification used); • At least one catalog image. The requirements are the same as for the product catalog.
Own POSM catalog at the level of detail, relevant for image recognition, data is similar to equipment catalog data.
Catalog with competitor brands for each relevant category (lowest level of product hierarchy). Competitors can be provided brand + category level or SKU level if required for KPI calculations. For example, the “price pair index” KPI measures own product price/competitor product price. The vendor could provide their existing competitor catalog depending on the market and category.
A minimum list of attributes:
- Category — lowest level of product hierarchy used;
- Brand;
- Logo — at least one image or link to the image. Image height must be larger than 400 px. In the process of initial setup and system operation, the Eyrene will extend the competitor catalog with the most common unknown brands seen in the shelf images in the course of the image recognition QA process.
Note.
Unknown competitor products can still be recognized at the category level (e.g. “Unknown beverage”), though the accuracy of such recognition is different for different categories and different product hierarchy levels.
Archive with 1,000-3,000 images per macro-category per market. The recognition is trained using real shelf photos.
You will not need to label the images on the shelves. The system will do it automatically.
Shelf images must be at least 2 MPx in resolution, must be relatively sharp, and do not have large perspective distortions.
Hierarchy of own product and brand
Excel-file with product and brand hierarchy
Product catalog
Attributes:
Primary identifier in EAN/GTIN
Primary Name in English
Manufacturer
EAN/GTIN or EAN list
Country list in ISO alpha-2
Product physical dimensions in mm (H/W/D)
At least one catalog image
Images:
For products with different design variations, a photo of each of the variations has been added
The height of each image is over 400px
Optional:
Added additional product attributes - type, product packaging size, weight, volume, etc.
Added additional attributes for KPI
Added list of local product names
Equipment catalog
Attributes:
Primary code
Primary Name in English
Equipment type
At least one catalog image
Images:
For equipment with different design variations, a photo of each of the variations has been added
The height of each image is over 400px
POSM catalog
Attributes:
Primary code
Primary Name in English
POSM type
At least one catalog image
Images:
For POSM with different design variations, a photo of each of the variations has been added
The height of each image is over 400px
Competitor catalog
Attributes:
Category with lowest level of product hierarchy used
Brand
Logo — at least one image or link to the image
Images:
The height of each image is over 400px
Optional:
Competitors provided brand + category level or SKU level
Shelf image archive
The archive contains a minimum of 1000 images per macro category for each market
Each shelf image in the archive have at least 2 MPx resolution
To keep the product catalog in Eyrene up to date, you need to establish a process of periodic updating. For example, regular weekly updates plus infrequent urgent unscheduled catalog updates. If new products appear or product design changes, the catalogs also need to be updated. Catalog updates can be provided as an Excel file + image or as an API endpoint. Alternatively, you can update the catalog using our API endpoint or manually in the portal.
Activity | Description | Values |
|---|---|---|
Initial Setup Data | Set of objects and parameters required, e.g. quantity/quality/types of pictures, list of physical characteristics, etc. The information is to be provided for the objects that can be recognized by the vendor’s solution, incl.
The vendor should clearly specify which kind of pictures the network gets initially trained (and re-trained in the operation mode):
| See above |
Initial Setup Duration | Training period to achieve the maximum accuracy | 2-4 weeks depending on initial catalog completeness |
Period for Change | Re-training period to achieve the maximum accuracy | 5 business days for a batch of new products/product designs |
Accuracy Measurement | The vendor should specify:
| See above, no effort is expected from your side except of regular catalog updates. |