Add Shrek (entropix) Sampler #9831
underwaterbepis
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
https://github.com/xjdr-alt/entropix
Early testing on Twitter has shown it makes Llama 3.2 1B much better at reasoning as it gives the model “longer to think” during tokens it is uncertain about
Repo and method still in development, see Twitter user xjdr (“AI Shrek”)
Beta Was this translation helpful? Give feedback.
All reactions