Is NVIDIA’s ChatRTX The Next Big Thing?

NVIDIA just released their ChatRTX application which solves 2 of the biggest issues we see with LLMs today; Data access & privacy. The ChatRTX application solves these issues by allowing you to run a free & open-source model locally on your computer.
Want to create your own local chatbot powered by ​⁠@NVIDIAGeForce RTX GPUs? Download ChatRTX here: nvda.ws/4a3lgw8
⏳ Timestamps ⏳
00:00 | The Problem With LLMs
01:01 | What Is ChatRTX?
01:28 | ChatRTX Demo
05:03 | Installation & Requirements
06:22 | How This Works (RAG)
Hashtags
#alonrtx
#ChatRTX
#Allinnovation

[@faristhehonest]

imagine talking to your lecture notes, crazy useful

[@cody_codes_youtube]

Super interesting. I hadn’t heard much about this, so this is awesome to have someone do a review on it. Thanks dude

[@vinosamari]

Great video Tim. 👍🏾

[@Tomatechs558]

Thanks Tim for the video, I'm locked and following

[@gaureesha9840]

There is Open source project called Vectra for local index

[@peterwassmuth4014]

Awesome Thank you for Sharing! 💯✴

[@TechWithTim]

My pleasure!!

[@akhuff]

I got this running a week ago, threw all my FSMs in there - All the Factory Service Manuals for my vehicles, R/C Cars, random equipment... What's the upper A Arm part number for the Revo... List all the front suspension torque specs for this vehicle...

[@dingalingus4338]

How well did it handle those prompts?

[@KrAsHeDD]

Thanks so much for the explanation.

[@clairekraft4892]

Did you have to set up the chunking and embedding? What kind of fine prompt engineering did you do?

[@sumibalian]

I like your channel very much
Ilike the way how you teach and tell

[@usamashami11]

Thank you for the amazing video ❤
1 comment and 1 question. I have a work PC which almost fulfills all the requirements except for the OS 😅
Btw, we still be needing RAG to train this model on our data or just providing the directory link is sufficient?

[@davidtindell950]

thank you !

[@AutobotsTransform]

Tim, can you please create some videos regarding CUDA programming? and the cheapest Nvidia card & PC we can use. Thx buddy.

[@mfc1190]

A great development environment for getting started is the jetson Orin nano. It’s about $500 but it’s a full cpu gpu and it’ll also teach you how to get setup and running.

[@AutobotsTransform]

@@mfc1190 ok, appreciate your suggestions & advice.

[@GiiT2023]

I like your new Look Tim 🤩

[@midz6432]

Can you change .py files to .txt and use it for coding?

[@ImTheRealCam]

I love how your first ever video is more helpful and is cooler than every other video…

[@Recklessness97]

Cries in GTX 1080. I really need to get a new GPU but all the video games I play still runs great on it. I'll wait till the 5000 series.

[@khalidkhalid6856]

Hi tim

[@tajsec498]

imagine it support markdown and use it with obsidian

[@JARFAST]

What languages ​​does Nividia support? chat whit rtx

[@nasiriqbal5475]

Bro, i have a question, i know more than the basics of python, should i start to learn a new language, or go for advance python?(Libraries, Frameworks). Looking forward for your answer

[@vinosamari]

Build something bro. The joy of progress will keep you going past the frustrating errors. Plus you’ll have an extra project for your résumé. Hope this helps! 😁

[@nasiriqbal5475]

@@vinosamari I currently don't need much for a resume as I am currently 13, but, I like your idea of project building, I need a tip about writing logic or fixing bugs, thank you brother

[@Lets_code_together_]

​Upcoming Tim​@@nasiriqbal5475

[@amir3515]

@@nasiriqbal5475do data structures and algorithms

[@NyxesRealms]

​@@nasiriqbal5475chat gpt is great for debugging as well

[@mdelim3128]

Hello Tim.where are you working right now and in wht country ??just curious because of the change in your surroundings like your videos before

[@eugenmalatov5470]

looks like AnythingLLM

[@hariprasath7050]

Hey I just wondered why you using RTX 4090 and 64GB Ram do you using for Ultre Real Engine or Fine Tuning LLM what's the purpose to build current latest high end specs if you're developer means

[@lumi8416]

lost me at "windows only" :(

[@SeaJay_Oceans]

ChatRTX operates very poorly. Given the full anwer to a question 3 times, after being trained on the exact text files needed to answer the question correctly, it still get the wrong answer most of the time. When asked to read back the source information, it's hit or miss to get the correct result. It is very touchy about word order.

[@VamsiDevendrakumar__]

Will it support my gtx 1650

[@muddkipp_1]

The Next Big Thing. Ad Talk. Can A.I. solder a circuit? Like Tim said or I heard some time ago, learn a language..

[@superpayaseria]

Any coder interested in partnering up to help me on my humanoid terminator project?? Please hit me up.

[@user-dt1ul5kx8n]

its windows only so I no longer care.