Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
23 Open 1,158 Closed
23 Open 1,158 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

hotfix: ipex fails since cuda moe kernel is not supported
#2532 opened Sep 18, 2024 by sywangyi Loading…
2
We can have a tokenizer anywhere.
#2527 opened Sep 17, 2024 by Narsil Loading…
5 tasks
4
speculative decoding complete guide added
#2524 opened Sep 17, 2024 by shirinyamani Loading…
Nix integration tests
#2518 opened Sep 12, 2024 by Narsil Loading…
5 tasks
CI for add gptq and awq int4 support in intel platform
#2494 opened Sep 5, 2024 by ErikKaum Loading…
3
feat: support phi3.5 moe
#2479 opened Aug 30, 2024 by drbh Loading…
9 tasks done
5
Small fixes for supported models
#2471 opened Aug 29, 2024 by osanseviero Loading…
12
nix: very experimental support for building a Docker container
#2470 opened Aug 29, 2024 by danieldk • Draft
5 tasks
fix: skip cuda graphs that will oom and improve free memory logging
#2450 opened Aug 22, 2024 by drbh Loading…
add gptq and awq int4 support in intel platform
#2444 opened Aug 22, 2024 by sywangyi Loading…
5 tasks
@ErikKaum
10
Fix Numba Cache Error
#2443 opened Aug 21, 2024 by tylertitsworth Loading…
1 of 5 tasks
2
Improve vlm support (add idefics3 support)
#2437 opened Aug 20, 2024 by drbh • Draft
4 tasks
fix: repack for marlin when single scale is provided
#2414 opened Aug 13, 2024 by drbh Loading…
4
add docker load_tests
#2387 opened Aug 9, 2024 by ngxson • Draft
1
feat: add release and sha tagged images
#2360 opened Aug 5, 2024 by drbh Loading…
1
Update ROCM libs and improvements
#2358 opened Aug 5, 2024 by mht-sharma Loading…
7 tasks done
5
[TENSORRT-LLM] - Implement new looper thread based backend
#2357 opened Aug 2, 2024 by mfuntowicz • Draft
Update vLLM dependency to 0.5.3.post1 Stale
#2317 opened Jul 26, 2024 by danieldk • Draft
5 tasks
Add model_load_time metric
#2311 opened Jul 26, 2024 by Edwinhr716 Loading…
2 of 5 tasks
2
feat(router): drop permit after batching Stale
#2284 opened Jul 23, 2024 by OlivierDehaene • Draft
adding max_token_capacity metric
#2279 opened Jul 22, 2024 by Edwinhr716 Loading…
2 of 5 tasks
2
feat: Add load tests
#2217 opened Jul 11, 2024 by Hugoch Loading…
1 of 5 tasks
@Hugoch
17
Add FP8 KVCache support
#2028 opened Jun 6, 2024 by mht-sharma Loading…
1 of 4 tasks
@danieldk
60
ProTip! Adding no:label will show everything without a label.