Open
Description
Details here: unslothai/unsloth#2494 (comment)
Summary: We need to add a port argument and then edit the load_vllm logic to ping the port inputs taken
Metadata
Metadata
Assignees
Labels
No labels
{{ message }}
No one assigned
No labels
No type
No projects
No milestone
None yet
No branches or pull requests