Skip to main content
Version: dev

ModelWorkerParameters Configuration

ModelWorkerParameters(host: Optional[str] = '0.0.0.0', port: Optional[int] = 8001, daemon: Optional[bool] = False, log: dbgpt.util.utils.LoggingParameters = <factory>, trace: Optional[dbgpt.util.tracer.tracer_impl.TracerParameters] = None, worker_type: Optional[str] = None, worker_class: Optional[str] = None, standalone: Optional[bool] = False, register: Optional[bool] = True, worker_register_host: Optional[str] = None, controller_addr: Optional[str] = None, send_heartbeat: Optional[bool] = True, heartbeat_interval: Optional[int] = 20)

Parameters

NameTypeRequiredDescription
portinteger
Model worker deploy port
Defaults:8001
daemonboolean
Run the server as a daemon.
Defaults:False
logLoggingParameters (loggingparameters configuration)
Logging configuration
Defaults:LoggingParameters
traceTracerParameters (tracerparameters configuration)
Tracer configuration
worker_typestring
Worker type
Valid values:llm, text2vec, reranker
worker_classstring
Model worker class, dbgpt.model.cluster.DefaultModelWorker
standaloneboolean
Standalone mode. If True, embedded Run ModelController
Defaults:False
registerboolean
Register current worker to model controller
Defaults:True
worker_register_hoststring
The ip address of current worker to register to ModelController. If None, the address is automatically determined
controller_addrstring
The Model controller address to register
send_heartbeatboolean
Send heartbeat to model controller
Defaults:True
heartbeat_intervalinteger
The interval for sending heartbeats (seconds)
Defaults:20
hoststring
The host IP address to bind to.
Defaults:0.0.0.0