AI's memory sucks, so Google is helping!

In case you weren't aware, most of what you discuss with a chat bot is based out of what's called parametric memory. This is what is always talked about as far as the information it's trained on. But what about context of a conversation? This is something that even toddlers can begin to understand to help a conversation, but AI cannot. It does it's best, but it has limited capacity to recall what is most recent in a chat conversation. Here comes Google's Titan's architecture that expands the context of something like a GPT model of, let's just say 8,000 words (more correctly tokens) to a whopping 2 MILLION!
Sources:
Google's Paper: arxiv.org/pdf/...
Great X thread breaking down the paper: x.com/behrouz_...
What is a transformer model: blogs.nvidia.c...
Transformer Explainer: poloclub.githu...
------
Follow me: / wesjh_
X: / wesjh_
@chubbies, @chubbiesshorts
Subscribe to the podcast!
Apple: podcasts.apple... d1570344602
Spotify: open.spotify.c...
Support the Channel with my affiliate links!
havenathletic....
Shop Lululemon: creatoriq.cc/3...
/ weshenderson
Best active eyewear and triathlon gear in the game! Visit ROKA! www.avantlink....
Thorne: Most science backed, and clinically validated supplements on the market - Get 20% off your first order with my link: thor.ne/qOtrs
My choice for CBD - cbdMD - 15% OFF - cbdmd.t7c9v8.n...
Badass Coffee Company - NVR Rest - Use ‘WES’ to get 10% off - nvrrest.com/
Shop on Amazon! www.amazon.com...
To get your own Eight Sleep mattress or pod pro cover use the following link and code 'WES' for $100 Off at checkout: eight-sleep.io...

[@christopherd.winnan8701]

Agree completely but UX is also important. An empty text box is not the best way to access ASI. You need at least something like Infranodus or Gephi to perform at that level. I did not see any text boxes in Minority Report!
Which frontier model you access is going to be a lot less relevant than how you access it.