ModelCacheParameters Configuration
Model cache configuration.
Parameters
| Name | Type | Required | Description |
|---|---|---|---|
enable_model_cache | boolean | ❌ | Whether to enable model cache, default is True Defaults： True |
storage_type | string | ❌ | The storage type. Supported values: memory, disk, valkey. For valkey, configure via environment variables VALKEY_HOST, VALKEY_PORT, VALKEY_PASSWORD. Defaults： memory |
max_memory_mb | integer | ❌ | The max memory in MB, default is 256 Defaults： 256 |
persist_dir | string | ❌ | The persist directory, default is model_cache Defaults： model_cache |