zilliztech/GPTCache

An LLM semantic cache library that reuses similar queries to reduce API cost and latency.

APISDKGPT

Visit zilliztech/GPTCache website →

Category
AI インフラ
Official URL
https://github.com/zilliztech/GPTCache
Last updated
Wed Apr 08
Tags
API · SDK · GPT