Skip to content
This repository has been archived by the owner on Nov 9, 2024. It is now read-only.

Send document updates by batch #1

Open
kerwanp opened this issue Oct 1, 2024 · 0 comments
Open

Send document updates by batch #1

kerwanp opened this issue Oct 1, 2024 · 0 comments
Labels
enhancement New feature or request
Milestone

Comments

@kerwanp
Copy link
Contributor

kerwanp commented Oct 1, 2024

Description

Today, document updates (update and delete) are sent to the Search engine one by one. And it is a behavior that can lead to a lot of issues when mass updating records.

Proposal

Documents should be sent by batch with the following behavior:

  • When updating or deleting records, the "action" should be stored in a queue.
  • If the queue reach a configurable amount of updates to be done, the queue is processed.
  • If the queue does not receive new updates to be done after a configurable delay, the queue is processed.
  • It should be possible to manually flush the queue. magnify.engine().flushQueue()
@kerwanp kerwanp added the enhancement New feature or request label Oct 1, 2024
@kerwanp kerwanp added this to the v1 milestone Oct 1, 2024
@kerwanp kerwanp changed the title Update documents by batch Send document updates by batch Oct 1, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant