ModelCacheParameters Configuration

Model cache configuration.

Parameters

Name	Type	Required	Description
enable_model_cache	boolean	❌	Whether to enable model cache, default is True Defaults：True
storage_type	string	❌	The storage type, default is memory Defaults：memory
max_memory_mb	integer	❌	The max memory in MB, default is 256 Defaults：256
persist_dir	string	❌	The persist directory, default is model_cache Defaults：model_cache