Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recreate persistent subscriptions in the sink ESDB #37

Open
kaancfidan opened this issue Jan 6, 2022 · 3 comments
Open

Recreate persistent subscriptions in the sink ESDB #37

kaancfidan opened this issue Jan 6, 2022 · 3 comments

Comments

@kaancfidan
Copy link
Contributor

kaancfidan commented Jan 6, 2022

Is your feature request related to a problem? Please describe.
Persistent Subscriptions are not replicated to the sink ESDB.

Describe the solution you'd like
I would like the replicator to recreate the persistent subscriptions in the sink ESDB with exact parameters and checkpoints as in the source ESDB.

@alexeyzimarev
Copy link
Member

I am not sure it's in scope for the replicator, as well as user-defined projections... I never planned this tool to be a full-blown migration tool between two clusters. But, I'll discuss it with the team.

@kaancfidan
Copy link
Contributor Author

Well, people will need something to start using Event Store Cloud if they already have self-deployed ESDB in their production.

We extensively use persistent subscriptions to create load balanced services and we currently have 40 million events in the production store. Although our services can handle event redeliveries, doing that for 40 million events takes a significant amount of time.

The only solution we have now is to create the persistent subscriptions with their current offset manually, which we'll do. We will have to recreate 32 separate persistent subscriptions with correct parameters & offsets. I would say it's a minor inconvenience.

If this replication tool took care of that during migration, that would be awesome.

@alexeyzimarev
Copy link
Member

It's the same with catch-up subscriptions, I mentioned it in the docs. Persistent subscriptions are maybe easier as for the older ESDB versions you could only subscribe to a normal stream, not to $all.

Handling persistent subscription checkpoints would require the same functionality to track event numbers on both sides, and it's not easy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants