Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New ML model to detect products on PRICE_TAG proofs #721

Open
raphodn opened this issue Feb 23, 2025 · 2 comments
Open

New ML model to detect products on PRICE_TAG proofs #721

raphodn opened this issue Feb 23, 2025 · 2 comments

Comments

@raphodn
Copy link
Member

raphodn commented Feb 23, 2025

Story

We already have a ML model to detect price_tag bounding boxes on PRICE_TAG proofs - see #511.
But it lacks context, such as the related product (above, or below the price tag).

Ideally train a new model that detects both the price_tag & the product (pairs).
Alternative is to train a separate model that only detects products.

@baslia
Copy link
Collaborator

baslia commented Feb 24, 2025

I was thinking we can label images with 3 labels:

  • product_and_price
  • product
  • price

Basically we will draw a bog bounding box on product + price, then 2 smaller bounding box on the product and the price.
If we respect that the product_and_price is always bigger than the area of product box + price box, the model would pick up on that logic.
Then on our side, with basic geometry, we can link back the triplet (product_and_price, product, price).
What do you think ?

@baslia
Copy link
Collaborator

baslia commented Feb 24, 2025

Basically, the labelling task would look like this:

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Backlog
Development

No branches or pull requests

2 participants