GitHub - adheep04/megabyte-language-model: small language model using the megabyte architecture inspired by the transformer

adheep04 / megabyte-language-model Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

small language model using the megabyte architecture inspired by the transformer

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
.gitignore		.gitignore
README.md		README.md
model.py		model.py
tests.py		tests.py

Repository files navigation

paper: https://arxiv.org/pdf/2305.07185

About

small language model using the megabyte architecture inspired by the transformer

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%