ModelAPIServerParameters Configuration
ModelAPIServerParameters(host: Optional[str] = '0.0.0.0', port: Optional[int] = 8100, daemon: Optional[bool] = False, log: dbgpt.util.utils.LoggingParameters = <factory>, trace: Optional[dbgpt.util.tracer.tracer_impl.TracerParameters] = None, controller_addr: Optional[str] = 'http://127.0.0.1:8000', api_keys: Optional[str] = None, embedding_batch_size: Optional[int] = None, ignore_stop_exceeds_error: Optional[bool] = False)
Parameters
Name | Type | Required | Description |
---|---|---|---|
port | integer | ❌ | Model API server deploy port Defaults: 8100 |
daemon | boolean | ❌ | Run the server as a daemon. Defaults: False |
log | LoggingParameters (loggingparameters configuration) | ❌ | Logging configuration Defaults: LoggingParameters |
trace | TracerParameters (tracerparameters configuration) | ❌ | Tracer configuration |
controller_addr | string | ❌ | The Model controller address to connect Defaults: http://127.0.0.1:8000 |
api_keys | string | ❌ | Optional list of comma separated API keys |
embedding_batch_size | integer | ❌ | Embedding batch size |
ignore_stop_exceeds_error | boolean | ❌ | Ignore exceeds stop words error Defaults: False |
host | string | ❌ | The host IP address to bind to. Defaults: 0.0.0.0 |