ModelsDeployParameters Configuration

ModelsDeployParameters(default_llm: Optional[str] = None, default_embedding: Optional[str] = None, default_reranker: Optional[str] = None, llms: List[dbgpt.core.interface.parameter.LLMDeployModelParameters] = <factory>, embeddings: List[dbgpt.core.interface.parameter.EmbeddingDeployModelParameters] = <factory>, rerankers: List[dbgpt.core.interface.parameter.RerankerDeployModelParameters] = <factory>)

Parameters

Name	Type	Required	Description
default_llm	string	❌	Default LLM model name, used to specify which model to use when you have multiple LLMs
default_embedding	string	❌	Default embedding model name, used to specify which model to use when you have multiple embedding models
default_reranker	string	❌	Default reranker model name, used to specify which model to use when you have multiple reranker models
llms	LLMDeployModelParameters	❌	LLM model deploy configuration. If you deploy in cluster mode, you just deploy one model. Defaults：[]
embeddings	EmbeddingDeployModelParameters	❌	Embedding model deploy configuration. If you deploy in cluster mode, you just deploy one model. Defaults：[]
rerankers	RerankerDeployModelParameters	❌	Reranker model deploy configuration. If you deploy in cluster mode, you just deploy one model. Defaults：[]