RAG Serve Configurations Configuration
This configuration is for the RAG serve module.
Parameters
Name | Type | Required | Description |
---|---|---|---|
embedding_model | string | ❌ | Embedding Model Defaults: None |
rerank_model | string | ❌ | Embedding Model Defaults: None |
chunk_size | integer | ❌ | Whether to verify the SSL certificate of the database Defaults: 500 |
chunk_overlap | integer | ❌ | The default thread pool size, If None, use default config of python thread pool Defaults: 50 |
similarity_top_k | integer | ❌ | knowledge search top k Defaults: 10 |
similarity_score_threshold | integer | ❌ | knowledge search top similarity score Defaults: 0.0 |
query_rewrite | boolean | ❌ | knowledge search rewrite Defaults: False |
max_chunks_once_load | integer | ❌ | knowledge max chunks once load Defaults: 10 |
max_threads | integer | ❌ | knowledge max load thread Defaults: 1 |
rerank_top_k | integer | ❌ | knowledge rerank top k Defaults: 3 |
api_keys | string | ❌ | API keys for the endpoint, if None, allow all |