Put your gaming GPU to work! Remote machine learning on Windows with Docker and WSL2 from anywhere.

Поделиться
HTML-код
  • Опубликовано: 21 авг 2024

Комментарии • 28

  • @TheTempic
    @TheTempic Месяц назад

    Thanks for the description, my immich processing time now got reduced by 40x when using my desktop GPU vs the i5-1235u in my NAS!

  • @techdad6135
    @techdad6135 3 месяца назад +1

    This is awesome! I just started using Immich a couple days ago. I will definitely be trying this out. Thank you for sharing.

  • @jupiter909
    @jupiter909 3 месяца назад +1

    Extremely practical and useful show and tell this, thank you!

  • @hrgagan9192
    @hrgagan9192 4 месяца назад +1

    This tutorial is excellent! I could see this becoming a regular thing. It would be great if we could have the gaming rig in sleep mode to save power, and then activate it whenever one or more services need AI compute... Thanks a lot

  • @malzbier1339
    @malzbier1339 3 месяца назад

    You are always on point. Immich and GPU sharing is a perfect idea👍🏻.

  • @thewebart
    @thewebart 3 месяца назад

    Wow! This is huge. Thank you so much.

  • @warlordianx23
    @warlordianx23 2 месяца назад

    This is what I'm doing it right now

  • @gregsmith4661
    @gregsmith4661 4 месяца назад +1

    Nice I will have to try this out Thanks

  •  3 месяца назад +1

    Great guide but I am getting "Error: only 0 Devices available, 1 requested. Exiting." on that docker run -it --gpus=all ... command on my RTX 4080 :/. Any idea why pls?

  • @ikkoyi6971
    @ikkoyi6971 3 месяца назад

    geat video. My use case is that run synergy over tailscale with windows mac and linux which runs on different wired network.

  • @painy3248
    @painy3248 Месяц назад

    I don't want my gaming PC running 24/7. What happens when I add a new picture to immich and the PC is offline? Does it fallback to 'regular' immich or wait with the job until the remote machine is online?

  • @martinzipfel7843
    @martinzipfel7843 2 месяца назад

    Hi Alex, followed your setup but there seems to be no connection between Immich and the machine learning instance. You mention at the end that your Immich instance couldn't see the ML instance because of the 'container' tag. My ML instance is not shared into the tailnet but native, would this still apply? If I remove this line '- TS_EXTRA_ARGS=--advertise-tags=tag:container' from my docker compose config the container doesn't connect to the tailnet anymore :( Any idea how I get the Immich instance into my tailnet without the tag?

  • @ChilliSinCarne
    @ChilliSinCarne 2 месяца назад +1

    Possible to do the same for video editing rendering?

  • @jojokispotta
    @jojokispotta Месяц назад

    what is the location of model-cache in windows?

  • @martinzipfel7843
    @martinzipfel7843 3 месяца назад

    Awesome Video as always. I tried something similar but with Home Assistant and Ollama. Both are connected to my Tailnet, I can reach both from my Laptop (also connected to my Tailnet) but I can't for the life of me reach (ping) the Ollama tailnet instance from within the Home Assistants terminal and subsequently the Ollama integration fails when I try to connect using the tailnet IP or URL. Anyone knows why that is? Does the Home Assistant Addon only allow traffic one way into the tailnet?

  • @panchajanya1999
    @panchajanya1999 4 месяца назад

    Hey, is it possible to switch to Passkey(Yubikey) login from Google login in TS?

  • @phee303
    @phee303 3 месяца назад

    i've got immich running on my qnap in container station, i now have tailscale installed on my pc, i followed this video and installed docker and have immich_machine_learning running in the dockerwindows. i tried sharing but since immich is just running on a container there's no way to "paste" the link. i must be missing something here. i guess i need to create tailscale in docker and somehow merge it with the immich_machine_learning container? honestly i'm totally lost lol

    • @Tailscale
      @Tailscale  3 месяца назад +1

      See the supporting resources. We assume that Immich is on your tailnet already. Look at the Linux host section for Immich, you’ll need to get that sorted on your qnap end

  • @suliyachareunsouk5613
    @suliyachareunsouk5613 3 месяца назад

    When I run a smart search my docker desktop displays this error "CUDA driver version is insufficient for CUDA runtime version ; GPU=21219207" Runtime Error on my windows PC. Has anyone seen this before?

    • @Tailscale
      @Tailscale  3 месяца назад

      Are you on a recent GPU? Drivers?

    • @suliyachareunsouk5613
      @suliyachareunsouk5613 3 месяца назад

      @@Tailscale I am on the most recent drivers on Geforce Experience gui

  • @sohail579
    @sohail579 4 месяца назад

    Got to ask what model the speakers are in the background?

    • @Tailscale
      @Tailscale  3 месяца назад +1

      Asking the real questions am I right?
      They’re a pair of KEF LS50 I got myself as a graduation milestone with my first real pay cheque after a career change comp sci msc course 9 years ago.
      - Alex

    • @sohail579
      @sohail579 3 месяца назад

      @@Tailscale you know it 😜 I'm contemplating the same LS50 Wireless II or the LSX II as they have better connectivity

    • @Tailscale
      @Tailscale  3 месяца назад

      Passive speakers never need software updates though ;)

  • @yagoa
    @yagoa 4 месяца назад

    dislike, because docker