Skip to content
This repository has been archived by the owner on Jan 9, 2023. It is now read-only.

How many long sequences are there? #109

Open
chathasphere opened this issue Jan 31, 2022 · 2 comments
Open

How many long sequences are there? #109

chathasphere opened this issue Jan 31, 2022 · 2 comments

Comments

@chathasphere
Copy link
Collaborator

How many sequences are greater than 512 in length? If there are a bunch, it might be worth looking into some of the "long transformer" frameworks (e.g. sparse attention, combiner, BigBird)
@chathasphere
Copy link
Collaborator Author

Consider truncating extra-long sequences from the end

@chathasphere
Copy link
Collaborator Author

This would be a useful table. Also get a sense of how many visits there are per patient, & over how many years a sequence runs

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@chathasphere