Skip to content

Conversation

@huydhn
Copy link
Contributor

@huydhn huydhn commented Dec 19, 2025

There are a couple of changes:

  • I bring back the logic to detect DEVICE_NAME and DEVICE_TYPE from https://github.com/pytorch/pytorch-integration-testing/blob/main/.github/workflows/vllm-benchmark.yml and get rid of PyTorch as a dependency from this workflow to find the device name and type. Installing PyTorch just to get this information is a waste
  • Use nvidia-ml-py as a replacement of pynvml
  • Fail the upload step when there is no results. This indicates that the benchmark has failed, it's better to be explicit than failing silently here
  • Accept a benchmark name input

Signed-off-by: Huy Do <huydhn@gmail.com>
@vercel
Copy link

vercel bot commented Dec 19, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment
Project Deployment Review Updated (UTC)
torchci Ignored Ignored Preview Dec 19, 2025 11:12pm

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 19, 2025
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Huy Do <huydhn@gmail.com>
@huydhn huydhn requested a review from atalman December 19, 2025 18:20
Signed-off-by: Huy Do <huydhn@gmail.com>
echo "DEVICE_NAME=$DEVICE_NAME" >> $GITHUB_ENV
- name: Get device type
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This logic is from https://github.com/pytorch/pytorch-integration-testing/blob/main/.github/workflows/vllm-benchmark.yml#L139. There is a task to consolidate this into this official upload benchmark results GHA

Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Huy Do <huydhn@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants