Skip to content
This repository has been archived by the owner on May 28, 2024. It is now read-only.

[2023-08-28] Sunsetting non-Llama model examples. #8

Open
Yard1 opened this issue Jun 2, 2023 · 0 comments
Open

[2023-08-28] Sunsetting non-Llama model examples. #8

Yard1 opened this issue Jun 2, 2023 · 0 comments

Comments

@Yard1
Copy link
Member

Yard1 commented Jun 2, 2023 •
edited by richardliaw
Loading

This issue serves as a "news ticker" for the Aviary frontend.

Current news:

We're sunsetting the non-Llama models as of the 0.3.0 release. The reason is because we've seen the demand for llama models significantly outpace the Falcon and MPT models along with corresponding accuracy improvements.

Please feel free to create an issue if you would like to see new issues.

Past updates:

  • [2023-08-28] Sunsetting non-Llama model examples on RayLLM - see chat.lmsys.org for others!
  • [2023-07-20] Just added: Llama 2 models All Sizes!!!
  • [2023-07-03] Just added: continuous batching! Refreshed model list!
  • [2023-06-22] Just added: mpt-30b-chat! Streaming support & other improvements!
  • [2023-06-21] Just added: Streaming support & other improvements!
  • [2023-06-15] Falcon Models have a bug that slows them down and cause timeouts.
  • [2023-06-06] Just added: Falcon models! KubeRay guide!
  • [2023-06-02] Just added: Expanded context windows (900 words)! OpenAI CLI support! Upcoming: Falcon 40b
@ray-project ray-project locked and limited conversation to collaborators Jun 2, 2023
@Yard1 Yard1 pinned this issue Jun 2, 2023
@Yard1 Yard1 changed the title News [2023-06-02] Just added: Expanded context windows (900 words)! OpenAI CLI support! Upcoming: Falcon 40b Jun 3, 2023
@Yard1 Yard1 changed the title [2023-06-02] Just added: Expanded context windows (900 words)! OpenAI CLI support! Upcoming: Falcon 40b [2023-06-06] Just added: Falcon models! KubeRay guide! Jun 7, 2023
@waleedkadous waleedkadous changed the title [2023-06-06] Just added: Falcon models! KubeRay guide! [2023-06-15] Falcon Models have a bug that slows them down and cause timeouts. You may get timeouts. Jun 15, 2023
@waleedkadous waleedkadous changed the title [2023-06-15] Falcon Models have a bug that slows them down and cause timeouts. You may get timeouts. [2023-06-15] Falcon Models have a bug that slows them down and cause timeouts. Jun 15, 2023
@waleedkadous waleedkadous changed the title [2023-06-15] Falcon Models have a bug that slows them down and cause timeouts. [2023-06-15] Falcon Models have a bug that slows them down and cause timeouts. Try other models! Jun 15, 2023
@Yard1 Yard1 changed the title [2023-06-15] Falcon Models have a bug that slows them down and cause timeouts. Try other models! [2023-06-21] Just added: Streaming support & other improvements! Jun 21, 2023
@Yard1 Yard1 changed the title [2023-06-21] Just added: Streaming support & other improvements! [2023-06-22] Just added: mpt-30b-chat! Streaming support & other improvements! Jun 23, 2023
@Yard1 Yard1 changed the title [2023-06-22] Just added: mpt-30b-chat! Streaming support & other improvements! [2023-07-03] Just added: continuous batching! Refreshed model list! Jul 3, 2023
@avnishn avnishn unpinned this issue Jul 7, 2023
@avnishn avnishn pinned this issue Jul 7, 2023
@avnishn avnishn changed the title [2023-07-03] Just added: continuous batching! Refreshed model list! [2023-07-20] Just added: Llama 2 models All Sizes!!! Jul 20, 2023
@Yard1 Yard1 changed the title [2023-07-20] Just added: Llama 2 models All Sizes!!! [2023-08-28] Sunsetting non-Llama models - see chat.lmsys.org for others! Aug 28, 2023
@richardliaw richardliaw changed the title [2023-08-28] Sunsetting non-Llama models - see chat.lmsys.org for others! [2023-08-28] Sunsetting non-Llama model examples. Oct 16, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Yard1