Baidu Wenxin Proxy LLM Configuration
Baidu Wenxin proxy LLM configuration.
Details can be found in:
https://cloud.baidu.com/doc/WENXINWORKSHOP/s/clntwmv7t
Parameters
Name | Type | Required | Description |
---|---|---|---|
name | string | ✅ | The name of the model. |
backend | string | ❌ | The real model name to pass to the provider, default is None. If backend is None, use name as the real model name. |
provider | string | ❌ | The provider of the model. If model is deployed in local, this is the inference type. If model is deployed in third-party service, this is platform name('proxy/<platform>') Defaults: proxy/wenxin |
verbose | boolean | ❌ | Show verbose output. Defaults: False |
concurrency | integer | ❌ | Model concurrency limit Defaults: 100 |
prompt_template | string | ❌ | Prompt template. If None, the prompt template is automatically determined from model. Just for local deployment. |
context_length | integer | ❌ | The context length of the OpenAI API. If None, it is determined by the model. |
api_key | string | ❌ | The API key of the Wenxin API. Defaults: ${env:WEN_XIN_API_KEY} |
api_secret | string | ❌ | The API secret key of the Wenxin API. Defaults: ${env:WEN_XIN_API_SECRET} |