Skip to content

[DO NOT MERGE] pjin/misc-infra-log-fix #477

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
pjin-nvidia wants to merge 44 commits into
base: main
Choose a base branch
from
Draft

[DO NOT MERGE] pjin/misc-infra-log-fix #477

pjin-nvidia wants to merge 44 commits into from

Conversation

@pjin-nvidia
Copy link
Contributor

@pjin-nvidia pjin-nvidia commented Dec 10, 2025

No description provided.

@pjin-nvidia
Miscellaneous infra.
316d43e 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Remove DEBUG. Comment.
4ecd8d3 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Comment about ray package extra.
8103dbf 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
The.
dc493d5 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Merge remote-tracking branch 'origin/main' into pjin/misc-infra
f9e5d8f 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Fix test (?).
9502d82 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Initial support for server pyproject.toml (WIP).
0475d5e 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Fix pyproject.toml check.
d86756b 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Working directory Path.
79028a6 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Install a server venv from pyproject.toml if available.
7e62b1d 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Deprecated vllm_model requirements.txt.
36efb94 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Consistently use dashes in package names.
8d49b95 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Lint.
6fb0a95 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Cleanup.
7231efa 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
VLLM server spinup.
8fc0d9d 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
VLLM server host and port.
8975e98 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Allocate the free port for VLLM in the model server process.
51ba6fc 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Type.
aa97796 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Fix for pyproject.toml (this works lol).
6ec9325 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
VLLM server "routing" (just re-using the existing multiple clients).
33ec3f9 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Better order.
77cda85 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Comment.
7201c8f 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Default to "mp" backend.
834d9b9 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Cleanup.
5ee8b57 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Cleanup.
10b5295 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Non-async VLLM server heartbeat to avoid early asyncio event loop.
e4c5573 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
With pyproject.toml, no pre-install command needed.
0a8da20 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Improved server venv pyproject install that does not use editable.
ad0e2fc 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Packaging and setup.
0436b47 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Revert VLLMModel changes (moving to PR #318).
854609f 
Signed-off-by: Peter Jin <pjin@nvidia.com>
pjin-nvidia and others added 14 commits November 17, 2025 16:17
@pjin-nvidia
One line uv pip install.
dc6ffef 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Print the names of servers yet to have finished spinning up.
e8afd2d 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Formatting.
0142784 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Merge remote-tracking branch 'origin/main' into pjin/misc-infra
a0c0d19 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Merge remote-tracking branch 'origin/main' into pjin/misc-infra
0a94c2d 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Revert to just cd into working dir.
66b788d 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Deduplicate.
a78f226 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Also add explicit check for requirements.txt.
fdb54fe 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Revert format.
3fb2911 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Merge remote-tracking branch 'origin/main' into pjin/misc-infra
b99a5c4 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Sync vllm_model pyproject.toml.
fd98595 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@pjin-nvidia
Minimum version of vllm >= 0.11.2.
987cf5c 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@bxyu-nvidia
Merge branch 'main' of https://github.com/NVIDIA-NeMo/Gym into pjin/m…
d11a66a 
…isc-infra
@pjin-nvidia
Log with stdout/stderr redirection.
912f23a 
Signed-off-by: Peter Jin <pjin@nvidia.com>
@copy-pr-bot
Copy link

copy-pr-bot bot commented Dec 10, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@pjin-nvidia pjin-nvidia changed the title pjin/misc-infra-log-fix [DO NOT MERGE] pjin/misc-infra-log-fix Dec 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@pjin-nvidia @bxyu-nvidia