Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sync with upstream @ v0.6.3 #201

Merged
merged 195 commits into from
Oct 15, 2024
Merged

Sync with upstream @ v0.6.3 #201

merged 195 commits into from
Oct 15, 2024

Conversation

dtrifiro
Copy link

ywang96 and others added 30 commits September 26, 2024 07:45
@ywang96
[Misc] Update config loading for Qwen2-VL and remove Granite (vllm-pr…
4bb98f2 
…oject#8837)
@tlrmchlsmth
[Build/CI] Upgrade to gcc 10 in the base build Docker image (vllm-pro…
f70bcca 
…ject#8814)
@mgoin
[Docs] Add README to the build docker image (vllm-project#8825)
520db4d
@fyuan1316
[CI/Build] Fix missing ci dependencies (vllm-project#8834)
68988d4
@youkaichao
[misc][installation] build from source without compilation (vllm-proj…
70de39f 
…ect#8818)
@khluu
[ci] Soft fail Entrypoints, Samplers, LoRA, Decoder-only VLM (vllm-pr…
d9cfbc8 
…oject#8872)

Signed-off-by: kevin <[email protected]>
@Pernekhan
[Bugfix] Include encoder prompts len to non-stream api usage response (…
93d364d 
…vllm-project#8861)
@mgoin
[Misc] Change dummy profiling and BOS fallback warns to log once (vll…
b28d210 
…m-project#8820)
@tlrmchlsmth
[Bugfix] Fix print_warning_once's line info (vllm-project#8867)
e2f6f26
@chiragjn
fix validation: Only set tool_choice auto if at least one tool is p…
ee2da3e 
…rovided (vllm-project#8568)
@tlrmchlsmth
[Bugfix] Fixup advance_step.cu warning (vllm-project#8815)
71d21c7
@njhill
[BugFix] Fix test breakages from transformers 4.45 upgrade (vllm-proj…
4b377d6 
…ect#8829)
@DarkLight1337
[Installation] Allow lower versions of FastAPI to maintain Ray 2.9 co…
1b49148 
…mpatibility (vllm-project#8764)
@maxdebayser
[Feature] Add support for Llama 3.1 and 3.2 tool use (vllm-project#8343)
344cd2b 
Signed-off-by: Max de Bayser <[email protected]>
@DarkLight1337
[Core] renamePromptInputs and inputs (vllm-project#8876)
3b00b9c
@youkaichao
[misc] fix collect env (vllm-project#8894)
dc4e3df
@panpan0000
[MISC] Fix invalid escape sequence '\' (vllm-project#8830)
0e08875 
Signed-off-by: Peter Pan <[email protected]>
@Isotr0py
[Bugfix][VLM] Fix Fuyu batching inference with max_num_seqs>1 (vllm…
6d792d2 
…-project#8892)
@bvrockwell
[TPU] Update pallas.py to support trillium (vllm-project#8871)
8df2dc3
@youkaichao
[torch.compile] use empty tensor instead of None for profiling (vllm-…
a9b15c6 
…project#8875)
@ProExpertProg
[Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear meth…
172d1cd 
…od (vllm-project#7271)
@LucasWilkinson @mgoin
[Bugfix] fix for deepseek w4a16 (vllm-project#8906)
c5d5535 
Co-authored-by: mgoin <[email protected]>
@varun-sundar-rabindranath
[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (
c2ec430 
vllm-project#8378)

Co-authored-by: Varun Sundar Rabindranath <[email protected]>
@youkaichao
[misc][distributed] add VLLM_SKIP_P2P_CHECK flag (vllm-project#8911)
18e60d7
@schoennenbeck
[Core] Priority-based scheduling in async engine (vllm-project#8850)
bd429f2
@youkaichao
[misc] fix wheel name (vllm-project#8919)
d86f6b2
@tylertitsworth @youkaichao
[Bugfix][Intel] Fix XPU Dockerfile Build (vllm-project#7824)
260024a 
Signed-off-by: tylertitsworth <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@DarkLight1337
[Misc] Remove vLLM patch of BaichuanTokenizer (vllm-project#8921)
b0298aa
@tastelikefeet
[Bugfix] Fix code for downloading models from modelscope (vllm-projec…
39d3f8d 
…t#8443)
@varun-sundar-rabindranath
[Bugfix] Fix PP for Multi-Step (vllm-project#8887)
19d02ff
schoennenbeck and others added 20 commits October 11, 2024 15:35
@schoennenbeck
[Bugfix] Fix priority in multiprocessing engine (vllm-project#9277)
df3dcdf
@tlrmchlsmth
[Model] Support Mamba (vllm-project#6484)
7342a7d
@bringlein
[Kernel] adding fused moe kernel config for L40S TP4 (vllm-project#9245)
f710090
@sixsixcoder
[Model] Add GLM-4v support and meet vllm==0.6.2 (vllm-project#9242)
6cf1167
@homeffjy
[Doc] Remove outdated comment to avoid misunderstanding (vllm-project…
1a18238 
…#9287)
@wallashss
[Doc] Compatibility matrix for mutual exclusive features (vllm-projec…
8baf85e 
…t#8512)

Signed-off-by: Wallas Santos <[email protected]>
@LucasWilkinson
[Bugfix][CI/Build] Fix docker build where CUDA archs < 7.0 are being …
de9fb4b 
…detected (vllm-project#9254)
@allenwang28
[Bugfix] Sets is_first_step_output for TPUModelRunner (vllm-project…
c6cf929 
…#9202)
@prashantgupta24
[bugfix] fix f-string for error (vllm-project#9295)
d11b46f 
Signed-off-by: Prashant Gupta <[email protected]>
@maxdebayser
[BugFix] Fix tool call finish reason in streaming case (vllm-project#…
ec10cb8 
…9209)

Signed-off-by: Max de Bayser <[email protected]>
@LiuXiaoxuanPKU
[SpecDec] Remove Batch Expansion (2/3) (vllm-project#9298)
89feb4c
@xiangxu-google
[Bugfix] Fix bug of xformer prefill for encoder-decoder (vllm-project…
00298e0 
…#9026)
@cermeng @youkaichao
[Misc][Installation] Improve source installation script and doc (vllm…
2b184dd 
…-project#9309)

Co-authored-by: youkaichao <[email protected]>
@jeejeelee
[Bugfix]Fix MiniCPM's LoRA bug (vllm-project#9286)
250e26a
@LiuXiaoxuanPKU
[CI] Fix merge conflict (vllm-project#9317)
f519902
@tlrmchlsmth
[Bugfix] Bandaid fix for speculative decoding tests (vllm-project#9327)
16b24e7
@mrsalehi @sangho-vision @ywang96
[Model] Molmo vLLM Integration (vllm-project#9016)
dfe43a2 
Co-authored-by: sanghol <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
@jikunshang
[Hardware][intel GPU] add async output process for xpu (vllm-project#…
4141608 
…8897)
@dtrifiro
[CI/Build] setuptools-scm fixes (vllm-project#8900)
203ab8f
@simon-mo
[Docs] Remove PDF build from Readtehdocs (vllm-project#9347)
fd47e57
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 15, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dtrifiro

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 15, 2024

@dtrifiro: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 4df356c link true /test smoke-test

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@dtrifiro dtrifiro merged commit e14c041 into opendatahub-io:main Oct 15, 2024
4 of 6 checks passed
@dtrifiro dtrifiro deleted the sync-with-0.6.3 branch October 15, 2024 15:53
prarit pushed a commit to prarit/vllm that referenced this pull request Oct 21, 2024
@sanyalington
remove redundant slice when chunked prefill feature is disabled (open…
0e80e85 
…datahub-io#201)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@RH-steve-grubb RH-steve-grubb Awaiting requested review from RH-steve-grubb

@Xaenalt Xaenalt Awaiting requested review from Xaenalt

Assignees
No one assigned
Labels
approved
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.