缓存优化算法更新
-
由于输入 Token 的成本最高可达缓存输入成本的 10 倍,较低的缓存命中率可能导致用户的使用成本大幅增加。
在最新的算法更新中,我们优化了调度系统并显著提升了缓存效率。目前针对付费用户 1x 倍率以上的分组 的缓存命中率已超过 90%,从而大幅减少了不必要的输入 Token 消耗。
还在追求低倍率的朋友,你会发现,没有缓存的0.05x倍率可能比缓存90%的0.2x的高倍率还贵——因为输入费用是缓存费用的10倍!
通过此次优化,您会发现 Token 余额的使用效率显著提高,使用成本也不会再因缓存率低而迅速攀升。
我们将继续改进路由与资源管理算法,致力于为您提供更具性价比且更稳定的 AI API 体验。
感谢您的持续支持。
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login