Размер видео: 1280 X 720853 X 480640 X 360
Показать панель управления
Автовоспроизведение
Автоповтор
Great work, Jordan! Gonna start scraping the parts together...
I feel jalous of that 8xH100 server. Currently using a 4x3090 at home. I actually use a pretty similar setup with vLLM for the full precision models and exllama or llama.cpp for quantized models + OpenwebUI as a frontend.
Why would you need more than that? Be glad for what you already have or you won't find happiness :)
Bitch i have a p40 and im over the moon. Being poor in ml is hard.
Sweet rig. Is that your daily driver? 😀😀
- what are you using it for?- .... stuff
AI, apparently. (LLM = Large Language Model)
The cost of such a setup is circa $500,000........ amma get me 2 :)
30k GC? 8 of them?
Word
Why not podman tho
Great work, Jordan! Gonna start scraping the parts together...
I feel jalous of that 8xH100 server. Currently using a 4x3090 at home. I actually use a pretty similar setup with vLLM for the full precision models and exllama or llama.cpp for quantized models + OpenwebUI as a frontend.
Why would you need more than that? Be glad for what you already have or you won't find happiness :)
Bitch i have a p40 and im over the moon. Being poor in ml is hard.
Sweet rig. Is that your daily driver? 😀😀
- what are you using it for?
- .... stuff
AI, apparently. (LLM = Large Language Model)
The cost of such a setup is circa $500,000........ amma get me 2 :)
30k GC? 8 of them?
Word
Why not podman tho