OpenAPIRerankerDeployModelParameters Configuration
OpenAPI Reranker Deploy Model Parameters.
Parameters
| Name | Type | Required | Description |
|---|---|---|---|
name | string | ✅ | The name of the model. |
provider | string | ❌ | The provider of the model. If model is deployed in local, this is the inference type. If model is deployed in third-party service, this is platform name('proxy/<platform>') Defaults： proxy/openapi |
verbose | boolean | ❌ | Show verbose output. Defaults： False |
concurrency | integer | ❌ | Model concurrency limit Defaults： 50 |
api_url | string | ❌ | The URL of the rerank API. Defaults： http://localhost:8100/v1/beta/relevance |
api_key | string | ❌ | The API key for the rerank API. |
backend | string | ❌ | The real model name to pass to the provider, default is None. If backend is None, use name as the real model name. |
timeout | integer | ❌ | The timeout for the request in seconds. Defaults： 60 |