Видео

Thanks, the plug in is awesome!

and thank you for cool stuff!

I just like messing with VM's. And I like keeping main PC clean and use VM for experimental things.

thanks!

Thanks for watching, check this link it might help you jan.ai/docs/use-tools

Thanks for watching! What framework and tools would you be using? any ideas yet about that?

Thanks for watching!

What kind of error(s) are you getting?

Can explain a little more details?

thank you for checking out my video. Hope it helped you.

You are welcome, thanks for watching.

Jan AI allows users to adjust their settings so they can change alignment, moderation and censorship levels to their needs on LLM settings.

Hello. Just checking, did you get it up and running on your computer yet?

@@ScottDevOps no

can you explain a little more what problem you are facing? Are you using Windows 10 or Windows 11, or other OS?

Hello there. I thought those tools were pretty interesting. I am not in the algorithm yet.

that is great to hear! thanks for checking out my video!

Let me see if I can find out, if you haven't already discovered a way to do that.

yep that was funny. Got to find humor where we can lol

thanks for watching. Glad you liked it. This is amazing stuff happening these days.

:-) Thanks for watching. I will give that a try and see what I can come up with.

Glad my video helped you! Hey thats great. I am glad you found an answer. What tool did you find?

What operating system are you using? can you explain in more detail about your configuration and tools you are using?

Hello there. Have you seen this guide yet: github.com/janhq/jan/blob/3bfa2773bdee03646e89e38367ef76a7b97a66af/docs/docs/guides/08-troubleshooting/03-gpu-not-used.mdx#L2 A few questions for you: Which Nvidia card are you using and how much RAM does it have? What OS are you using? Did you install it with the EXE or use the actual github source code like I did in the video? Some things to consider: In NVIDIA command line tools, if you don't see the option "Enable GPU Acc" (GPU Acceleration), there could be several reasons: - Version Difference: The tool or driver version you are using might not support GPU acceleration, or the feature could be named differently. - GPU Compatibility: Your NVIDIA GPU might not be compatible with the GPU acceleration feature required by the tool. - Driver Issues: The necessary drivers for GPU acceleration might not be installed or updated on your system. * Operating System Compatibility: - The exact operating system you are using might not support the GPU acceleration feature, or there could be compatibility issues. - Hardware Limitations: Your system's hardware might not meet the requirements for GPU acceleration. Maybe consider these options if you have not yet: - Update your NVIDIA drivers and tools to the latest version. Check the tool's documentation for specific instructions or requirements for enabling GPU acceleration. - Ensure your hardware and operating system are compatible with the feature.

@ScottDevOps GPU is an RTX3070 with 8GB VRAM and 6,144 CUDA cores, GameReady driver is the current latest 546.33 and I installed the nVidia Cuda Toolkit v12.3 (also the currently latest version) CPU is Ryzen 3900 and mem is 2x16GB DDR4, OS is Win11. All drivers othersie are up to date as well. And as im writing this and giving it yet another shot, it now runs super fast, compared to earlier where it would be rather slow using the Hermes Neural 7B Q4 model. Yet in the settings there are still no "GPU accel" option, but oh well, its running super fast, instantly reply when I ask it something and types the answer super fast as well. So I guess its working really good, but then that begs the question, would it perform even better with GPU accel? X-)

@ScottDevOps also there is this discord for help: Get help in [Jan Discord] discord.gg/mY69SZaMaC

Just checked compatibility list as well, my 546 gameready driver and my RTX3070 is compatible with Cuda 12.3 it says, so another one to check off the list. Ill chk the discord and see if I can get further information there, thank you for all your help, its truly and highly appreciated 🙂

Yes, I would think it should perform even faster with GPU support. You can also post an Issue on the github repo github.com/janhq/jan/issues for Jan.AI. The developers of that tool should know why that is happening. I also noticed many times it was very fast! :-) PS If you get an answer let us know, Thanks!

thanks for watching, glad it was helpful.

Thanks for watching. And yes, I think most org's will be needing this sooner than later. Some questions would be, which cloud would you be using? do you know that yet? Is it just technical information and no personal PII or financial information in your manuals? How many manuals are you talking about? 100, 1000, 10000? And how many end users would need to access this information on average per day, and how many users need to access it at any one point in time?

@ScottDevOps So, like 10 users at one time, 100 users at one time etc....any guesses about what would ever be the maximum number of users who would need access?

And last questions for now, how many pages of information do these manuals typically have, and what size on disk are the files? 1MB, 10MB, etc....

@@ScottDevOps Just to give you high level. The customers i have are aircraft owners and operators performing maintenance. Each aircraft type is about 5-10gigs of technical manuals in PDF/HTML format with various figures and drawings. The manuals are currently provided through the manufacture on either a USB drive or logging into their website. There could be multiple users at a time

OK, wow that would be a lot of information, but it makes sense I mean those are aircraft with a bajillion parts etc.

Thanks so much. So many things going on in the world of IT these days. Always plenty to talk about.

Yes, there certainly are many options now for ChatBots and AI things. And I think it will all keep improving with time. It will be interesting to see where it all goes in the near future.

have you tried anything similar to this? ruclips.net/video/AVInhYBUnKs/видео.htmlsi=u-YMILydG5uRB5F1 I’m testing + training the Hyperwrite Assistant (hoping it’ll inform me how to efficiently use their Self-Operating Computer framework), and trying out different breakdowns of roles / tasks handled by each entity (GPTs, or in HW case called “tools”)

Thanks! So many things happening in AI space these days. Will be very interesting to see a year from now.

@@ScottDevOps seriously!

@@ScottDevOps I feel very privileged to have watched your video.

it took a bit but they have resolved the main issues I faced, so I hope they can do the same for you sooner than later. hang in there!!!

Yes, Pinegrow is really awesome. Did you see they are now offering a online version of the tools?

I use it all the time. Really like it too!