Skip to content
GuideLLM Docs
vllm
Initializing search
GitHub
GuideLLM Docs
GitHub
Home
Getting started
Getting started
Install
Start a Server
Run a Benchmark
Analyze Results
Guides
Guides
Architecture
Backends
Datasets
Embeddings Benchmarking Guide
Geospatial Model Benchmarking
Metrics
Multiturn Conversation Benchmarking
Output Types
Over-Saturation Stopping
Service Level Objectives
Tool Calling
Trace File Formats
v0.6.0 to v0.7.2 CLI Migration Guide
vLLM Python Backend
Multimodal
Multimodal
Audio Benchmarking
Image Benchmarking
Video Benchmarking
Synthetic Visual Data
Troubleshooting
Examples
Examples
GuideLLM Benchmark Testing with a Local Tokenizer and Custom Dataset
GuideLLM Benchmark Testing Best Practice
Developer
Developer
Code of Conduct
Contributing Guide
Development Guide
API Reference
API Reference
guidellm
guidellm
logger
settings
version
backends
backends
backend
openai
openai
common
http
request_handlers
websocket
vllm_python
vllm_python
vllm
vllm_response
benchmark
benchmark
benchmarker
entrypoints
progress
outputs
outputs
console
csv
html
output
plot
serialized
profiles
profiles
asynchronous
concurrent
profile
replay
sweep
synchronous
throughput
scenarios
scenarios
schemas
schemas
accumulator
base
benchmark
entrypoints
metrics
output
profiles
random
report
cli
cli
env
export
mock_server
run
preprocess
preprocess
args
dataset
data
data
builders
config
entrypoints
deserializers
deserializers
deserializer
file
huggingface
memory
synthetic
synthetic_image
synthetic_video
trace_common
trace_minimal
trace_mooncake
finalizers
finalizers
finalizer
generative
loaders
loaders
loader
torch
preprocessors
preprocessors
encoders
mappers
preprocessor
tool_calling
turn_pivot
schemas
schemas
base
entrypoints
preprocess
tokenizers
tokenizers
huggingface
tokenizer
utils
utils
dataset
extras
extras
audio
plot
vision
vllm
mock_server
mock_server
config
models
server
utils
handlers
handlers
chat_completions
completions
responses
tokenizer
scheduler
scheduler
environments
scheduler
schemas
strategies
worker
worker_group
constraints
constraints
args
constraint
error
factory
request
saturation
schemas
schemas
base
info
request
request_stats
response
statistics
tool_call
utils
utils
arg_string
audio
auto_importer
cli
click_pydantic
colors
console
default_group
dict
encoding
env_validator
functions
hf_datasets
hf_transformers
imports
lazy_loader
messaging
mixins
random
registry
singleton
synchronous
text
typing
vision
Home
API Reference
guidellm
extras
guidellm.extras.vllm
vLLM wrapper with same interface as vLLM.
Back to top