ModelWorkerParameters Configuration
ModelWorkerParameters(host: Optional[str] = '0.0.0.0', port: Optional[int] = 8001, daemon: Optional[bool] = False, log: dbgpt.util.utils.LoggingParameters = <factory>, trace: Optional[dbgpt.util.tracer.tracer_impl.TracerParameters] = None, worker_type: Optional[str] = None, worker_class: Optional[str] = None, standalone: Optional[bool] = False, register: Optional[bool] = True, worker_register_host: Optional[str] = None, controller_addr: Optional[str] = None, send_heartbeat: Optional[bool] = True, heartbeat_interval: Optional[int] = 20)
Parameters
Name | Type | Required | Description |
---|---|---|---|
port | integer | ❌ | Model worker deploy port Defaults: 8001 |
daemon | boolean | ❌ | Run the server as a daemon. Defaults: False |
log | LoggingParameters (loggingparameters configuration) | ❌ | Logging configuration Defaults: LoggingParameters |
trace | TracerParameters (tracerparameters configuration) | ❌ | Tracer configuration |
worker_type | string | ❌ | Worker type Valid values: llm , text2vec , reranker |
worker_class | string | ❌ | Model worker class, dbgpt.model.cluster.DefaultModelWorker |
standalone | boolean | ❌ | Standalone mode. If True, embedded Run ModelController Defaults: False |
register | boolean | ❌ | Register current worker to model controller Defaults: True |
worker_register_host | string | ❌ | The ip address of current worker to register to ModelController. If None, the address is automatically determined |
controller_addr | string | ❌ | The Model controller address to register |
send_heartbeat | boolean | ❌ | Send heartbeat to model controller Defaults: True |
heartbeat_interval | integer | ❌ | The interval for sending heartbeats (seconds) Defaults: 20 |
host | string | ❌ | The host IP address to bind to. Defaults: 0.0.0.0 |