LoRA Training in FLUX: How to Use FluxGym Effectively

Поделиться
HTML-код
  • Опубликовано: 17 янв 2025

Комментарии • 30

  • @Bioshock_84
    @Bioshock_84 4 дня назад +3

    I was waiting for the explanation of the advanced options in fluxgym. I'll have to continue investigating on my own.
    Good video.

    • @Geekatplay
      @Geekatplay  4 дня назад +1

      Thank you for the feedback! 😊 I understand the curiosity about the advanced options in FluxGym. I’ll make sure to cover those in more detail in a future video to help clarify everything. In the meantime, good luck with your investigations-FluxGym has so much potential to explore! 🚀✨

  • @K-A_Z_A-K_S_URALA
    @K-A_Z_A-K_S_URALA 3 дня назад +2

    приветствую уважаемый! Вопрос такой: я когда раньше лору тренировал на Kohya_ss-GUI-LoRA-Portable, я называл папку, где фотографии размещались, 10_итд, а в настройках эпох 1итд, а здеся сколько и чего указывать, помоги разобраться, я как понял, Repeat trains per image 10... это так же, как я папку указывал с фото... а Max Train Epochs 1 ставить - это как в настройках 1 стояло у меня? Верно...

    • @Geekatplay
      @Geekatplay  3 дня назад +1

      Приветствую! Да, ты правильно понял. В ComfyUI настройка "Repeat trains per image 10" аналогична тому, как ты раньше называл папку 10_итд в Kohya_ss, то есть это количество повторений тренировок на каждую картинку. А "Max Train Epochs 1" соответствует тому, как ты ставил 1 в настройках эпох ранее. Если ты привык к такой логике, то можешь смело использовать эти настройки, они работают примерно так же. Главное - следи за балансом, чтобы модель не переобучалась. Удачи с тренировкой!

    • @K-A_Z_A-K_S_URALA
      @K-A_Z_A-K_S_URALA 3 дня назад +1

      @@Geekatplay благодарю за ответ друг!

  • @greathawken7579
    @greathawken7579 19 дней назад +1

    Hey Vladimir, thanks for the tip about Sampler: Euler and Scheduler: Normal! It made a huge difference for my character, Loras. Really appreciate it! Great Video Thank You.

    • @Geekatplay
      @Geekatplay  19 дней назад

      Hey, thank you so much for the kind words! 😊 I'm glad the tip about Sampler: Euler and Scheduler: Normal worked well for your character, Loras. It’s always great to hear when these small tweaks make a big difference. Appreciate your support and feedback! 🎉👍

  • @Samt2b
    @Samt2b 19 дней назад +2

    Can you please make a video of multiple consistency

    • @Geekatplay
      @Geekatplay  19 дней назад

      Thank you for the suggestion! 😊 A video about multiple consistency sounds like a great idea. I’ll add it to the list and make sure to cover it with clear examples. Stay tuned! 👍🎥

  • @jefitedemetrio
    @jefitedemetrio 3 дня назад +1

    i'm try , but the result is bas, traning with 25 imagens,512x512, white background, standart config, 512x512, but my face dont reproduce on comfyui, why

    • @Geekatplay
      @Geekatplay  3 дня назад +1

      The issue might be caused by insufficient training data, resolution, or incorrect configurations. Increase the dataset size to at least 100-200 high-quality images with varied angles, lighting, and expressions. Use higher-resolution images, like 768x768 or 1024x1024, if possible, or crop the images closer to the face while maintaining quality. Avoid plain white backgrounds; instead, use neutral or varied backgrounds, or blur them during preprocessing. Adjust the training configuration by lowering the learning rate to 1e-5 and increasing the training steps or epochs, starting with 3-5 epochs. Use a cosine or linear learning rate scheduler for smoother convergence. Include regularization images from a pretrained model to improve generalization and avoid overfitting. Save intermediate checkpoints during training to evaluate progress. In ComfyUI, verify that the correct workflow is set for LoRA training, and check that the LoRA is applied correctly during generation. If issues persist, ensure proper preprocessing of your dataset and review training logs for potential errors.

    • @jefitedemetrio
      @jefitedemetrio 3 дня назад

      @@Geekatplay 😍 tankyou very much, you are the best!! i'm Brazilian, my english is bad 🤣

  • @mrrubel8841
    @mrrubel8841 9 часов назад

    Please zoom the part you are working, as it was very difficult to see which part you were working. Your screen might very big.

  • @INVICTUSSOLIS
    @INVICTUSSOLIS 8 дней назад +1

    Does this work with Mac?

    • @Geekatplay
      @Geekatplay  8 дней назад +1

      Yes, training LoRAs for Flux using ComfyUI works on a Mac, as ComfyUI is compatible with Apple Silicon machines and can run Flux models, allowing you to train custom LoRAs on your Mac with full functionality; you can use Flux LoRAs within the ComfyUI interface on your Mac.

    • @INVICTUSSOLIS
      @INVICTUSSOLIS 7 дней назад

      @@Geekatplay I use comfy regularly but i never really tried training with it. Thought the fluxgym thing doesnt work with Mac as I tried it one and didnt know what I was doing perhaps.

  • @sr.modanez
    @sr.modanez 18 дней назад +1

    top top top, obrigado pelo video

  • @ze7189
    @ze7189 7 дней назад

    Will the program automatically download the model? I didn't see the model download step in the video.

    • @Geekatplay
      @Geekatplay  7 дней назад

      i downloaded model in previous videos, please check one video before that.

  • @foopinhoff
    @foopinhoff 19 дней назад +2

    I'm getting "WARNING The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable." on launch. any tips?

    • @Geekatplay
      @Geekatplay  19 дней назад +5

      It looks like the issue is related to the bitsandbytes library not detecting GPU support, which is essential for efficient 8-bit optimization during LoRA training. Here are some tips to resolve this issue:
      Ensure CUDA Compatibility
      Verify that your GPU supports CUDA and that the correct CUDA version is installed.
      Use nvcc --version or check your GPU specs to confirm compatibility.
      Update bitsandbytes
      Run the following command to reinstall or update bitsandbytes:
      pip install --upgrade bitsandbytes
      Install the Correct Version
      If you are using a specific CUDA version (e.g., CUDA 11.x), you may need to install the appropriate bitsandbytes version:
      pip install bitsandbytes-cuda11x
      Check PyTorch Installation
      Make sure PyTorch is installed with GPU support. Install it using:
      pip install torch torchvision torchaudio --index-url download.pytorch.org/whl/cu11x
      Replace cu11x with your CUDA version (e.g., cu117 for CUDA 11.7).
      Verify Installation
      Test if bitsandbytes recognizes the GPU:
      import bitsandbytes as bnb
      print(bnb.__version__)
      Fallback Solution
      If you can't resolve the GPU issue, you can still use CPU-based training, but it will be slower:
      export BNB_CUDA_QUIET=1
      If these steps don’t resolve the issue, feel free to share additional details about your setup (OS, GPU, versions of CUDA, PyTorch, etc.), and I’ll help you troubleshoot further! 😊

    • @WhySoBroke
      @WhySoBroke 18 дней назад +3

      @@Geekatplaythanks for taking the time to trobleshoot!! You are legend!

  • @jacky_west
    @jacky_west День назад

    I don’t have the same comfy ui workflow

  • @quercus3290
    @quercus3290 14 дней назад +1

    triggers words are more or less optional to be honest, they may even degrade your lora if bias is associated with the token used.

  • @andyy79
    @andyy79 7 дней назад +1

    Thank you Vladimir for making this tutorial, this is fantastic for local Loras and works like a charm..:D
    I would like to use several Trigger words to trigger different details on an object. Is that possible in Fluxgym? In addition, I created some Car Loras and the overall look is amazing, but, how do I get the details cleaner?
    For example a Car Brand logo on the rear of the car, or clean and accurate rims? The trained Car looks great in proportion and surface, but Logos/number plates for eg. are unreadable.
    Does anybody has experience with this / can give me some tips?

    • @Geekatplay
      @Geekatplay  6 дней назад +1

      Thank you for the kind words! 😊 I'm glad the tutorial was helpful and that FluxGym is working well for your LoRA training!
      To address your questions:
      Using Multiple Trigger Words:
      Yes, you can use multiple trigger words to control different details of an object in FluxGym. When training your LoRA, you can associate specific trigger words with different features during the dataset preparation stage. Just ensure your dataset is annotated clearly, and the corresponding prompts during training reflect those distinctions.
      Improving Logo and Detail Quality:
      Blurry or unreadable details like logos and number plates often result from insufficient high-quality samples in the dataset. Here are some tips to improve:
      Dataset Quality: Include more high-resolution images of the details you're focusing on, such as logos, rims, and number plates.
      Data Augmentation: Use zoomed-in or cropped images of those specific details alongside full car images to reinforce their importance during training.
      Training Parameters: Try increasing the number of training steps or adjusting learning rates slightly to fine-tune for detail retention.
      Trigger Words: Use specific words for details like "logo," "number plate," or "rim" in your training prompts and during inference.
      Post-Training Refinement:
      After training, you can try using inpainting or ControlNet with Stable Diffusion to refine specific areas (e.g., logos or rims) to achieve cleaner results.
      I'm sure with these tweaks, you'll get even better outcomes for your car LoRAs! 🚗✨ If you or anyone else has additional tips or questions, feel free to share! 😊

    • @andyy79
      @andyy79 5 дней назад

      @@Geekatplay Thank you Vladimir:)

  • @LouisGedo
    @LouisGedo 19 дней назад +1

    👋 hi