Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ibm 20241008 roberta2 #198

Closed
wants to merge 136 commits into from
Closed

Ibm 20241008 roberta2 #198

wants to merge 136 commits into from

Conversation

maxdebayser
Copy link

DO NOT MERGE

ywang96 and others added 30 commits September 26, 2024 07:45
@ywang96
[Misc] Update config loading for Qwen2-VL and remove Granite (vllm-pr…
4bb98f2 
…oject#8837)
@tlrmchlsmth
[Build/CI] Upgrade to gcc 10 in the base build Docker image (vllm-pro…
f70bcca 
…ject#8814)
@mgoin
[Docs] Add README to the build docker image (vllm-project#8825)
520db4d
@fyuan1316
[CI/Build] Fix missing ci dependencies (vllm-project#8834)
68988d4
@youkaichao
[misc][installation] build from source without compilation (vllm-proj…
70de39f 
…ect#8818)
@khluu
[ci] Soft fail Entrypoints, Samplers, LoRA, Decoder-only VLM (vllm-pr…
d9cfbc8 
…oject#8872)

Signed-off-by: kevin <[email protected]>
@Pernekhan
[Bugfix] Include encoder prompts len to non-stream api usage response (…
93d364d 
…vllm-project#8861)
@mgoin
[Misc] Change dummy profiling and BOS fallback warns to log once (vll…
b28d210 
…m-project#8820)
@tlrmchlsmth
[Bugfix] Fix print_warning_once's line info (vllm-project#8867)
e2f6f26
@chiragjn
fix validation: Only set tool_choice auto if at least one tool is p…
ee2da3e 
…rovided (vllm-project#8568)
@tlrmchlsmth
[Bugfix] Fixup advance_step.cu warning (vllm-project#8815)
71d21c7
@njhill
[BugFix] Fix test breakages from transformers 4.45 upgrade (vllm-proj…
4b377d6 
…ect#8829)
@DarkLight1337
[Installation] Allow lower versions of FastAPI to maintain Ray 2.9 co…
1b49148 
…mpatibility (vllm-project#8764)
@maxdebayser
[Feature] Add support for Llama 3.1 and 3.2 tool use (vllm-project#8343)
344cd2b 
Signed-off-by: Max de Bayser <[email protected]>
@DarkLight1337
[Core] renamePromptInputs and inputs (vllm-project#8876)
3b00b9c
@youkaichao
[misc] fix collect env (vllm-project#8894)
dc4e3df
@panpan0000
[MISC] Fix invalid escape sequence '\' (vllm-project#8830)
0e08875 
Signed-off-by: Peter Pan <[email protected]>
@Isotr0py
[Bugfix][VLM] Fix Fuyu batching inference with max_num_seqs>1 (vllm…
6d792d2 
…-project#8892)
@bvrockwell
[TPU] Update pallas.py to support trillium (vllm-project#8871)
8df2dc3
@youkaichao
[torch.compile] use empty tensor instead of None for profiling (vllm-…
a9b15c6 
…project#8875)
@ProExpertProg
[Kernel] AQ AZP 4/4: Integrate asymmetric quantization to linear meth…
172d1cd 
…od (vllm-project#7271)
@LucasWilkinson @mgoin
[Bugfix] fix for deepseek w4a16 (vllm-project#8906)
c5d5535 
Co-authored-by: mgoin <[email protected]>
@varun-sundar-rabindranath
[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (
c2ec430 
vllm-project#8378)

Co-authored-by: Varun Sundar Rabindranath <[email protected]>
@youkaichao
[misc][distributed] add VLLM_SKIP_P2P_CHECK flag (vllm-project#8911)
18e60d7
@schoennenbeck
[Core] Priority-based scheduling in async engine (vllm-project#8850)
bd429f2
@youkaichao
[misc] fix wheel name (vllm-project#8919)
d86f6b2
@tylertitsworth @youkaichao
[Bugfix][Intel] Fix XPU Dockerfile Build (vllm-project#7824)
260024a 
Signed-off-by: tylertitsworth <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@DarkLight1337
[Misc] Remove vLLM patch of BaichuanTokenizer (vllm-project#8921)
b0298aa
@tastelikefeet
[Bugfix] Fix code for downloading models from modelscope (vllm-projec…
39d3f8d 
…t#8443)
@varun-sundar-rabindranath
[Bugfix] Fix PP for Multi-Step (vllm-project#8887)
19d02ff
DarkLight1337 and others added 21 commits October 7, 2024 11:55
@DarkLight1337 @ywang96 @Isotr0py
[Model] Support NVLM-D and fix QK Norm in InternViT (vllm-project#9045)
151ef4e 
Co-authored-by: Roger Wang <[email protected]>
Co-authored-by: Isotr0py <[email protected]>
@haitwang-cloud
[Doc]: Add deploying_with_k8s guide (vllm-project#8451)
93cf74a
@russellb
[CI/Build] Add linting for github actions workflows (vllm-project#7876)
e0dbdb0 
Signed-off-by: Russell Bryant <[email protected]>
@KuntaiDu
[Doc] Include performance benchmark in README (vllm-project#9135)
c0d9a98
@youkaichao
[misc] fix comment and variable name (vllm-project#9139)
fa45513
@simon-mo
Add Slack to README (vllm-project#9137)
8eeb857
@youkaichao
[misc] update utils to support comparing multiple settings (vllm-proj…
04c12f8 
…ect#9140)
@jikunshang
[Intel GPU] Fix xpu decode input (vllm-project#9145)
80b57f0
@youkaichao
[misc] improve ux on readme (vllm-project#9147)
e1faa2a
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
e7db59c 
…20241008

Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 5733
573d075 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 6357
61f6474 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9034
6d27ed2 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9049
22a7fe8 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9027
bf8438e 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
install adapter from @main to use adapter/vllm-project#137
6b500af 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Hack up de build to use as base-image 🚀
baeec70 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
🐛 Reverted logic to fix build; potential GGUF-related issues.
1297cc8 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Revert "Hack up de build to use as base-image 🚀"
bc59bd3 
This reverts commit baeec70.

Signed-off-by: Jefferson Fialho <[email protected]>
@maxdebayser
Add fix to identify encoder-only models
cf0b2dd 
Signed-off-by: Max de Bayser <[email protected]>
@maxdebayser
Merge branch 'odh_main' into ibm-20241008-roberta2
3c5605e 
Signed-off-by: Max de Bayser <[email protected]>
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 14, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: maxdebayser
Once this PR has been reviewed and has the lgtm label, please assign nicklucche for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 14, 2024

@maxdebayser: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 3c5605e link true /test smoke-test

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-merge-robot
Copy link

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@maxdebayser maxdebayser deleted the ibm-20241008-roberta2 branch October 28, 2024 17:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@RH-steve-grubb RH-steve-grubb Awaiting requested review from RH-steve-grubb

@Xaenalt Xaenalt Awaiting requested review from Xaenalt

Assignees
No one assigned
Labels
do-not-merge/hold needs-rebase
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.