ModelCacheParameters Configuration
Model cache configuration.
Parameters
| Name | Type | Required | Description |
|---|---|---|---|
storage_type | string | ❌ | The storage type, default is memory Defaults： memory |
max_memory_mb | integer | ❌ | The max memory in MB, default is 256 Defaults： 256 |
persist_dir | string | ❌ | The persist directory, default is model_cache Defaults： model_cache |
enable_model_cache | boolean | ❌ | Whether to enable model cache, default is True Defaults： True |