Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sound With Subtitles #2

Open
idiomer opened this issue Nov 1, 2023 · 2 comments
Open

Sound With Subtitles #2

idiomer opened this issue Nov 1, 2023 · 2 comments

Comments

@idiomer
Copy link

idiomer commented Nov 1, 2023

I'm looking for the solution: How to add subtitles with keeping them in sync with the audio?
Can you give me some help. Thanks

@RaSan147
Copy link
Owner

RaSan147 commented Nov 1, 2023

I'll try on creating some algorithms. Although audio and subtitle sync is totally different field, I'll try learning frequency analizer to match with voice output
(there's also an issue, if you set volume 0 (or change volume in runtime via api), frequency can mess up (provided via browser)

@RaSan147
Copy link
Owner

Okk I worked on suntitle. With proper starting and ending time and async function, you can use those timestamps to predict the word timing (google tts api v1beta allows the starting time for the words)

Then using on_start event (i guess) you can add subtitles dynamically in the text box.

Let me know if you need any help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants