Skip to content

Pull requests: vllm-project/vllm

New pull request New
472 Open 5,371 Closed
472 Open 5,371 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Build/CI] Fix libcuda.so linkage ci/build ready ONLY add when PR is ready to merge/full CI is needed
#12424 opened Jan 25, 2025 by tlrmchlsmth Loading…
2
[ROCm][AMD][Model] llama 3.2 support upstreaming
#12421 opened Jan 24, 2025 by maleksan85 Loading…
5
Fix the pydantic logging validator frontend
#12420 opened Jan 24, 2025 by maxdebayser Loading…
3
[Misc] Add offline test for disaggregated prefill
#12418 opened Jan 24, 2025 by Shaoting-Feng Loading…
1
[Bugfix] Disable w16a16 2of4 sparse CompressedTensors24 ready ONLY add when PR is ready to merge/full CI is needed
#12417 opened Jan 24, 2025 by tlrmchlsmth Loading…
6
[V1][Metrics] Add initial Prometheus logger ready ONLY add when PR is ready to merge/full CI is needed
#12416 opened Jan 24, 2025 by markmc • Draft
4
[V1] Revert uncache_blocks and support recaching full blocks ready ONLY add when PR is ready to merge/full CI is needed
#12415 opened Jan 24, 2025 by comaniac Loading…
1
[Usage] Add pipeline parallelism for usage stats
#12414 opened Jan 24, 2025 by simon-mo Loading…
3
[Frontend] Support override generation config in args ready ONLY add when PR is ready to merge/full CI is needed
#12409 opened Jan 24, 2025 by liuyanyi Loading…
5
[Bugfix] Fix benchmark script bug: inaccurate stats for vllm backend when max_model_len < input_len + output_len
#12407 opened Jan 24, 2025 by WangErXiao Loading…
1
[ci/build] detect and auto use cxx abi ci/build
#12403 opened Jan 24, 2025 by youkaichao Loading…
5
[MISC] add arg pad_for_invariant_seq_len
#12397 opened Jan 24, 2025 by MengqingCao Loading…
1
[Bugfix] Fix output_tokens is 0 if using tgi backend
#12394 opened Jan 24, 2025 by sywangyi Loading…
6
[torch.compile] PyTorch 2.6 and nightly compatibility
#12393 opened Jan 24, 2025 by youkaichao Loading…
3
[Hardware][Intel GPU] add XPU bf16 support documentation Improvements or additions to documentation
#12392 opened Jan 24, 2025 by jikunshang Loading…
2
[V1][Core] Structured decoding on scheduler-level
#12388 opened Jan 24, 2025 by aarnphm • Draft
2
[Misc] Add BNB quantization for Whisper
#12381 opened Jan 24, 2025 by jeejeelee • Draft
2
[Frontend] Rerank API (Jina- and Cohere-compatible API) documentation Improvements or additions to documentation frontend
#12376 opened Jan 24, 2025 by K-Mistele Loading…
1
@DarkLight1337
25
[Core] add and implement VLLM_LOGITS_PROCESSOR_THREADS
#12368 opened Jan 23, 2025 by akeshet Loading…
3
[Hardware][Intel-Gaudi] Enable FusedSDPA support for Intel Gaudi (HPU)
#12359 opened Jan 23, 2025 by SanjuCSudhakaran • Draft
1
[ROCm] Faster Custom Paged Attention kernels ci/build rocm
#12348 opened Jan 23, 2025 by tjtanaa • Draft
4
[Bugfix] handle alignment of arguments in convert_sparse_cross_attention_mask_to_dense
#12347 opened Jan 23, 2025 by tjohnson31415 Loading…
@heheda12345
5
FLOP counting for vLLM inference
#12341 opened Jan 23, 2025 by dianastea • Draft
1
[Build] Only build 9.0a for scaled_mm and sparse kernels ci/build ready ONLY add when PR is ready to merge/full CI is needed
#12339 opened Jan 23, 2025 by LucasWilkinson Loading…
2
[Frontend] Generate valid tool call IDs when using tokenizer-mode=mistral frontend
#12332 opened Jan 22, 2025 by rafvasq Loading…
7
ProTip! Exclude everything labeled bug with -label:bug.