Skip to content
This repository was archived by the owner on Mar 8, 2025. It is now read-only.

Issues: triton-inference-server/triton_distributed

36 Open 15 Closed
36 Open 15 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

vllm.monolith import fails at CI
#306 opened Feb 28, 2025 by piotrm-nvidia
1
Rust vLLM worker_base.py fails because it imports TritonNixlConnector
#304 opened Feb 28, 2025 by piotrm-nvidia
[BUG]When using the openai interface, an error is reported
#302 opened Feb 28, 2025 by Dimensionzw
2
Deployment blueprints documentation Improvements or additions to documentation
#294 opened Feb 27, 2025 by grahamking
Streaming API returns malformed response chunks with unwrapped ':\n\n' during high concurrency testing
#264 opened Feb 25, 2025 by pziecina-nv
@nv-hwoo
9
add python binding for preprocessor and backend
#257 opened Feb 24, 2025 by biswapanda
@biswapanda
Outputs from monolithic and disaggregated deployments are not the same
#248 opened Feb 23, 2025 by glos-nv
Add rust based preprocessor and backend
#247 opened Feb 23, 2025 by biswapanda
@biswapanda
Add rust based tokenizer
#246 opened Feb 23, 2025 by biswapanda
@biswapanda
Python Worker should behave like Rust Worker good first issue Good for newcomers
#233 opened Feb 21, 2025 by ryanolson
Static Analysis Findings: Security Issues in nats_request_plane.py
#232 opened Feb 21, 2025 by nv-anants
Runtime tests python unit test_sanity fails in request plane with missing _nats_client
#229 opened Feb 21, 2025 by piotrm-nvidia
@nnshah1
fix: remove all warnings from the kv router merge good first issue Good for newcomers
#213 opened Feb 19, 2025 by ryanolson
@grahamking
1
Precommit hook for copyright
#211 opened Feb 19, 2025 by ryanolson
@whoisj
1
distributed telemetry
#198 opened Feb 17, 2025 by ryanolson
Style Guide / Contributing
#189 opened Feb 14, 2025 by ryanolson
1
Add etcd configuation to control the lease timeout defaults good first issue Good for newcomers
#172 opened Feb 12, 2025 by ryanolson
Fatal Error Shutdown Path
#171 opened Feb 12, 2025 by ryanolson
performance of disaggregated prefill
#158 opened Feb 11, 2025 by Dimensionzw
3
Add rust integration tests (ex: with etcd/nats) good first issue Good for newcomers
#150 opened Feb 10, 2025 by rmccorm4
1
Add python integration tests good first issue Good for newcomers
#147 opened Feb 10, 2025 by rmccorm4
1
Explore test/code coverage to identify test improvements good first issue Good for newcomers
#144 opened Feb 10, 2025 by rmccorm4
@tanmayv25
1
Add cargo/unit tests for Metrics good first issue Good for newcomers
#143 opened Feb 10, 2025 by rmccorm4
Consider removing /triton/alpha/list-models utility endpoint good first issue Good for newcomers
#142 opened Feb 10, 2025 by rmccorm4
Enable AnnotationsProvider when we merge in other LLM logic
#141 opened Feb 9, 2025 by ryanolson
ProTip! Type g i on any issue or pull request to go back to the issue listing page.