vllm support#1063

Open

kczimm wants to merge 9 commits intomasterfrom

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.

Alternative Proxies:

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

vllm support#1063

vllm support#1063
kczimm wants to merge 9 commits intomasterfrom
kczimm-vllm-support

Commits on Oct 19, 2023

add vllm binding

add vllm SamplingParams

add test showing vllm model support check

refactor into llm module, use PyResult

add vLLM to the transform API

make bindings vllm::outputs

swap out vLLM model if new

add vllm docs

add vllm inference docs; fix logic

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

vllm support#1063kczimm wants to merge 9 commits intomasterpostgresml/postgresml:masterfrom kczimm-vllm-supportpostgresml/postgresml:kczimm-vllm-supportCopy head branch name to clipboard

Commits

Commits on Oct 19, 2023

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

vllm support#1063
kczimm wants to merge 9 commits intomasterfrom
kczimm-vllm-support