跳到主要内容
版本:dev

RAG Serve Configurations Configuration

This configuration is for the RAG serve module.

Parameters

NameTypeRequiredDescription
api_keysstring❌
API keys for the endpoint, if None, allow all
embedding_modelstring❌
Embedding Model
Defaults:None
rerank_modelstring❌
Embedding Model
Defaults:None
chunk_sizeinteger❌
Whether to verify the SSL certificate of the database
Defaults:500
chunk_overlapinteger❌
The default thread pool size, If None, use default config of python thread pool
Defaults:50
similarity_top_kinteger❌
knowledge search top k
Defaults:10
similarity_score_thresholdinteger❌
knowledge search top similarity score
Defaults:0.0
query_rewriteboolean❌
knowledge search rewrite
Defaults:False
max_chunks_once_loadinteger❌
knowledge max chunks once load
Defaults:10
max_threadsinteger❌
knowledge max load thread
Defaults:1
rerank_top_kinteger❌
knowledge rerank top k
Defaults:3