Skip to main content
Version: dev

Qwen (Tongyi)

Configure DB-GPT to use Alibaba Cloud's Qwen models via the DashScope API.

Prerequisites​

Install dependencies​

uv sync --all-packages \
--extra "base" \
--extra "proxy_openai" \
--extra "rag" \
--extra "storage_chromadb" \
--extra "dbgpts"

Configuration​

Edit configs/dbgpt-proxy-tongyi.toml:

[models]
[[models.llms]]
name = "qwen-plus"
provider = "proxy/tongyi"
api_base = "https://dashscope.aliyuncs.com/compatible-mode/v1"
api_key = "${env:DASHSCOPE_API_KEY}"

[[models.embeddings]]
name = "text-embedding-v3"
provider = "proxy/tongyi"
api_url = "https://dashscope.aliyuncs.com/compatible-mode/v1/embeddings"
api_key = "${env:DASHSCOPE_API_KEY}"
tip

Set the environment variable to keep your key out of config:

export DASHSCOPE_API_KEY="your-dashscope-api-key"

Available models​

LLMs​

ModelConfig nameNotes
Qwen-Maxqwen-maxFlagship model, best quality
Qwen-Plusqwen-plusBalanced performance and cost
Qwen-Turboqwen-turboFastest and cheapest
Qwen-Longqwen-longExtended context window

Embeddings​

ModelConfig nameNotes
text-embedding-v3text-embedding-v3Recommended
text-embedding-v2text-embedding-v2Previous generation

Start the server​

uv run dbgpt start webserver --config configs/dbgpt-proxy-tongyi.toml

Troubleshooting​

IssueSolution
InvalidAPIKeyVerify your DashScope API key and ensure it is activated
Model quota exceededCheck your DashScope console for usage limits
Slow responseTry qwen-turbo for faster responses

What's next​