Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor to @tf.function #60

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

khatchad
Copy link

@khatchad khatchad commented Aug 2, 2024

We converted several eager execution function to hybrid execution as part of an assessment of our refactoring tool. The transformations produced were completely automated. We have some preliminary evidence that this improves the run-time performance:

Test Python version TensorFlow version Epochs Before accuracy After accuracy Before loss After loss Before elapsed time (s) After elapsed time (s) Speedup
MusicTransformer-tensorflow2.0/train.py 3.10.0 2.9.3 5 0.0233113606 0.02381204049 4.956358294 4.923633542 1330.180665 919.3014389 1.446947224

The above analysis was repeated five times for each program version (before and after the refactoring) and the values were averaged. The increased speedup is ~1.45 with seemingly negligible loss of accuracy. We would appreciate any feedback you may have to help us as assess our refactoring approach. Thank you for your time!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant