-
Notifications
You must be signed in to change notification settings - Fork 15
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dockerfile.ubi: set uvicorn logging level #129
Conversation
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: dtrifiro The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Merge after #128 |
@dtrifiro could we do this in such a way that we could still override if back to info if wanted? |
f9ac7a7
to
438d7d1
Compare
@dtrifiro: The following test failed, say
Full PR test history. Your PR dashboard. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
@njhill Sorry, I'm only seeing your comment now. I guess this can be overridden by changing the entrypoint itself. If this is not optimal we can revert this and have this set via env var in the adapter. |
* Re-enable FusedRoPE for Gaudi1 * add fallback impl of rope
* Add support for a rope extension method (vllm-project#6553) * [BugFix] Fix RoPE error in Llama 3.1 (vllm-project#6693) --------- Co-authored-by: Simon Mo <[email protected]> Co-authored-by: Woosuk Kwon <[email protected]>
set vllm_tgis_adapter unicorn log level to warning