What is Cache Augmented Generation (CAG) - CAG vs RAG

[@TheTechchan]

Truly appreciate your work 🙏

[@WhatsAI]

Thank you!

[@Nex_Addo]

In light of R1 and the cost savings it brings, especially when run locally, it seems like CAG is gonna have its own moment. My guess is ultimately we'll all use both.

[@thibs0]

Merci Louis ! Now I need to test it ;)

[@WhatsAI]

The most important step! ;)

[@TheNaitik2]

How can we implement CAG for api model ?

[@WhatsAI]

API model you mean for example using Gemini through an api? You can just use the caching library from google and cached_content parameter :)
Each provider has its way implemented