Sync with [email protected] #57
Conversation
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
This PR adds basic support for OpenTelemetry distributed tracing. It includes changes to enable tracing functionality and improve monitoring capabilities. I've also added a markdown with print-screens to guide users how to use this feature. You can find it here
…en activation quantization (#5542)
Signed-off-by: kevin <[email protected]>
…ition penalties (#5639) Signed-off-by: Thomas Parnell <[email protected]>
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: github-actions[bot] The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
|
Hi @github-actions[bot]. Thanks for your PR. I'm waiting for a opendatahub-io member to verify that this patch is reasonable to test. If it is, they should reply with Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
/ok-to-test |
Signed-off-by: Thomas Parnell <[email protected]>
… garbage on certain devices (#5641)
Signed-off-by: kevin <[email protected]>
… in arg_utils.py (#5688)
Signed-off-by: Rafael Vasquez <[email protected]>
…date w8a8 schemes to share base classes (#5650)
Signed-off-by: kevin <[email protected]>
Co-authored-by: Varun Sundar Rabindranath <[email protected]>
Co-authored-by: Varun Sundar Rabindranath <[email protected]>
Signed-off-by: Thomas Parnell <[email protected]> Co-authored-by: Thomas Parnell <[email protected]> Co-authored-by: Nick Hill <[email protected]> Co-authored-by: Davis Wertheimer <[email protected]>
Co-authored-by: Antoni Baum <[email protected]>
Co-authored-by: Cody Yu <[email protected]>
* add quantization_weights_path for fp8 weights * fix lint * fix lint * change to quantized_weights_path * fix lint
Merge vllm-project/vllm:main@v0.5.0.post1-57-g59a1eb59 into main