Skip to main content
Version: dev

ModelAPIServerParameters Configuration

ModelAPIServerParameters(host: Optional[str] = '0.0.0.0', port: Optional[int] = 8100, daemon: Optional[bool] = False, log: dbgpt.util.utils.LoggingParameters = <factory>, trace: Optional[dbgpt.util.tracer.tracer_impl.TracerParameters] = None, controller_addr: Optional[str] = 'http://127.0.0.1:8000', api_keys: Optional[str] = None, embedding_batch_size: Optional[int] = None, ignore_stop_exceeds_error: Optional[bool] = False)

Parameters

NameTypeRequiredDescription
portinteger
Model API server deploy port
Defaults:8100
daemonboolean
Run the server as a daemon.
Defaults:False
logLoggingParameters (loggingparameters configuration)
Logging configuration
Defaults:LoggingParameters
traceTracerParameters (tracerparameters configuration)
Tracer configuration
controller_addrstring
The Model controller address to connect
Defaults:http://127.0.0.1:8000
api_keysstring
Optional list of comma separated API keys
embedding_batch_sizeinteger
Embedding batch size
ignore_stop_exceeds_errorboolean
Ignore exceeds stop words error
Defaults:False
hoststring
The host IP address to bind to.
Defaults:0.0.0.0