Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[do not merge] ibm-dev REbuild ibm-20241008 #184

Closed
wants to merge 147 commits into from
Closed

[do not merge] ibm-dev REbuild ibm-20241008 #184

wants to merge 147 commits into from

Conversation

fialhocoelho
Copy link

PR to generate a compiled image

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 8, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fialhocoelho
Once this PR has been reviewed and has the lgtm label, please assign rpancham for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Xaenalt pushed a commit that referenced this pull request Oct 14, 2024
@afierka-intel
Enable llama-405b - w/a for memory allocation error (#184)
691255b 
Work around for allocation error while loading llama-405b.
tlrmchlsmth and others added 9 commits October 15, 2024 00:24
@tlrmchlsmth
[Bugfix] Clean up some cruft in mamba.py (vllm-project#9343)
169b530
@stevegrubb
[Frontend] Clarify model_type error messages (vllm-project#9345)
44eaa5a
@mgoin
[Doc] Fix code formatting in spec_decode.rst (vllm-project#9348)
8e836d9
@hhzhang16
[Bugfix] Update InternVL input mapper to support image embeds (vllm-p…
55e081f 
…roject#9351)
@njhill
[BugFix] Fix chat API continuous usage stats (vllm-project#9357)
e9d517f
@gracehonv
pass ignore_eos parameter to all benchmark_serving calls (vllm-projec…
5d264f4 
…t#9349)
@mgoin @DarkLight1337
[Misc] Directly use compressed-tensors for checkpoint definitions (vl…
22f8a69 
…lm-project#8909)

Co-authored-by: DarkLight1337 <[email protected]>
@CatherineSue @njhill
[Bugfix] Fix vLLM UsageInfo and logprobs None AssertionError with emp…
ba30942 
…ty token_ids (vllm-project#9034)

Co-authored-by: Nick Hill <[email protected]>
@LucasWilkinson
[Bugfix][CI/Build] Fix CUDA 11.8 Build (vllm-project#9386)
717a5f8
mrsalehi and others added 7 commits October 16, 2024 04:56
faychu and others added 24 commits October 23, 2024 17:54
@faychu @DarkLight1337
[Model] Add Qwen2-Audio model support (vllm-project#9248)
fc6c274 
Co-authored-by: DarkLight1337 <[email protected]>
@russellb
[CI/Build] Add bot to close stale issues and PRs (vllm-project#9436)
b548d7a
@mgoin
[Bugfix][Model] Fix Mllama SDPA illegal memory access for batched mul…
bb01f29 
…ti-image (vllm-project#9626)

Signed-off-by: mgoin <[email protected]>
@mgoin
[Bugfix] Use "vision_model" prefix for MllamaVisionModel (vllm-projec…
b7df53c 
…t#9628)

Signed-off-by: mgoin <[email protected]>
@vrdn-23
[Bugfix]: Make chat content text allow type content (vllm-project#9358)
33bab41 
Signed-off-by: Vinay Damodaran <[email protected]>
@yma11 @DarkLight1337
[XPU] avoid triton import for xpu (vllm-project#9440)
056a68c 
Co-authored-by: Cyrus Leung <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
@DarkLight1337
[Bugfix] Fix PP for ChatGLM and Molmo (vllm-project#9422)
836e8ef
@WoosukKwon
[V1][Bugfix] Clean up requests when aborted (vllm-project#9629)
3770071 
Signed-off-by: Woosuk Kwon <[email protected]>
@youkaichao @zhuohan123
[core] simplify seq group code (vllm-project#9569)
4fdc581 
Co-authored-by: Zhuohan Li <[email protected]>
@CRZbulabula @youkaichao
[torch.compile] Adding torch compile annotations to some models (vllm…
8a02cd0 
…-project#9639)

Signed-off-by: youkaichao <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@jeejeelee
[Kernel] add kernel for FATReLU (vllm-project#9610)
295a061 
Signed-off-by: Jee Jee Li <[email protected]>
@CRZbulabula @youkaichao
[torch.compile] expanding support and fix allgather compilation (vllm…
ad6f780 
…-project#9637)

Signed-off-by: youkaichao <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@DarkLight1337
[Doc] Move additional tips/notes to the top (vllm-project#9647)
b979143
@litianjian
[Bugfix]Disable the post_norm layer of the vision encoder for LLaVA m…
f584549 
…odels (vllm-project#9653)
@hmellor
Increase operation per run limit for "Close inactive issues and PRs" …
de662d3 
…workflow (vllm-project#9661)

Signed-off-by: Harry Mellor <[email protected]>
@CRZbulabula @youkaichao
[torch.compile] Adding torch compile annotations to some models (vllm…
d27cfbf 
…-project#9641)

Signed-off-by: youkaichao <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
a92b917 
…20241024

Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 5733
80f94ec 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 6357
9f5b55a 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9027
ce5eebb 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9522
8675a9e 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9625
e949f65 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9631
7a6d518 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
using adapter version merged with PR #172
080973c 
Signed-off-by: Jefferson Fialho <[email protected]>
@maxdebayser
Add support for roberta models
019fe81 
Signed-off-by: Max de Bayser <[email protected]>
@maxdebayser
two stage build
300e64d 
Signed-off-by: Max de Bayser <[email protected]>
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Oct 29, 2024

@fialhocoelho: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 300e64d link true /test smoke-test

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@rpancham rpancham Awaiting requested review from rpancham

@vaibhavjainwiz vaibhavjainwiz Awaiting requested review from vaibhavjainwiz

@njhill njhill Awaiting requested review from njhill njhill is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.