Skip to main content
Version: v0.8.1

OpenAPIRerankerDeployModelParameters Configuration

OpenAPI Reranker Deploy Model Parameters.

Parameters

NameTypeRequiredDescription
namestring✅
The name of the model.
providerstring❌
The provider of the model. If model is deployed in local, this is the inference type. If model is deployed in third-party service, this is platform name('proxy/<platform>')
Defaults:proxy/openapi
verboseboolean❌
Show verbose output.
Defaults:False
concurrencyinteger❌
Model concurrency limit
Defaults:50
api_urlstring❌
The URL of the rerank API.
Defaults:http://localhost:8100/v1/beta/relevance
api_keystring❌
The API key for the rerank API.
backendstring❌
The real model name to pass to the provider, default is None. If backend is None, use name as the real model name.
timeoutinteger❌
The timeout for the request in seconds.
Defaults:60