Skip to main content
Version: dev

RAG Serve Configurations Configuration

This configuration is for the RAG serve module.

Parameters

NameTypeRequiredDescription
embedding_modelstring
Embedding Model
Defaults:None
rerank_modelstring
Embedding Model
Defaults:None
chunk_sizeinteger
Whether to verify the SSL certificate of the database
Defaults:500
chunk_overlapinteger
The default thread pool size, If None, use default config of python thread pool
Defaults:50
similarity_top_kinteger
knowledge search top k
Defaults:10
similarity_score_thresholdinteger
knowledge search top similarity score
Defaults:0.0
query_rewriteboolean
knowledge search rewrite
Defaults:False
max_chunks_once_loadinteger
knowledge max chunks once load
Defaults:10
max_threadsinteger
knowledge max load thread
Defaults:1
rerank_top_kinteger
knowledge rerank top k
Defaults:3
api_keysstring
API keys for the endpoint, if None, allow all