跳到主要内容
版本:dev

ModelWorkerParameters Configuration

ModelWorkerParameters(host: Optional[str] = '0.0.0.0', port: Optional[int] = 8001, daemon: Optional[bool] = False, log: dbgpt.util.utils.LoggingParameters = <factory>, trace: Optional[dbgpt.util.tracer.tracer_impl.TracerParameters] = None, worker_type: Optional[str] = None, worker_class: Optional[str] = None, standalone: Optional[bool] = False, register: Optional[bool] = True, worker_register_host: Optional[str] = None, controller_addr: Optional[str] = None, send_heartbeat: Optional[bool] = True, heartbeat_interval: Optional[int] = 20)

Parameters

NameTypeRequiredDescription
hoststring❌
The host IP address to bind to.
Defaults:0.0.0.0
portinteger❌
Model worker deploy port
Defaults:8001
daemonboolean❌
Run the server as a daemon.
Defaults:False
logLoggingParameters❌
Logging configuration
Defaults:LoggingParameters
traceTracerParameters❌
Tracer configuration
worker_typestring❌
Worker type
Valid values:llm, text2vec, reranker
worker_classstring❌
Model worker class, dbgpt.model.cluster.DefaultModelWorker
standaloneboolean❌
Standalone mode. If True, embedded Run ModelController
Defaults:False
registerboolean❌
Register current worker to model controller
Defaults:True
worker_register_hoststring❌
The ip address of current worker to register to ModelController. If None, the address is automatically determined
controller_addrstring❌
The Model controller address to register
send_heartbeatboolean❌
Send heartbeat to model controller
Defaults:True
heartbeat_intervalinteger❌
The interval for sending heartbeats (seconds)
Defaults:20