How to Create Efficient Training Pipelines with TensorFlow data.Dataset (Tensorflow Datasets)

Поделиться
HTML-код
  • Опубликовано: 11 сен 2024

Комментарии • 35

  • @GregHogg
    @GregHogg  Год назад

    Take my courses at mlnow.ai/!

  • @ShoaibKhanZ
    @ShoaibKhanZ 19 дней назад

    F!!! its a functional lazy eval. Argh, was clear as mud before, now crystal clear. Thanks!

  • @vasudevraghav2109
    @vasudevraghav2109 Год назад +1

    What an awesome tutorial man! Keep up the great work, really learned a lot!

    • @GregHogg
      @GregHogg  Год назад

      Thanks I really appreciate that!

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 года назад +2

    the way I understood it, is that on the first epoch, the processed data gets cached. and therefore, subsequent epochs, we don't need to preprocess, since we can now use the cached data instead. since they are the same anyway. no need to repeat it for each epoch.

    • @GregHogg
      @GregHogg  2 года назад

      Yes, that's right. In my phrasing, I may have dumbed it down slightly while still providing what's important to understand

  • @iciukas
    @iciukas 4 месяца назад

    Excellent! Clear and helpful

    • @GregHogg
      @GregHogg  4 месяца назад

      Super glad to hear it!

  • @hussainsalih3520
    @hussainsalih3520 Год назад +1

    very well document , I hope you make a video on best practice neural network when it faced overfitting

  • @datapro007
    @datapro007 Год назад +1

    Great video Greg, thank you.

  • @inakitodc6816
    @inakitodc6816 Год назад +1

    OMG this was so fcking useful, really good and deep material. Thanks!

  • @Amir-gi5fn
    @Amir-gi5fn 2 месяца назад

    9:41 Oh so it turns data from uint8 to float32 only when needed and this actually saves a lot of memory I've already preprocessed my data but can now do resizing in Pipeline

  • @freya291
    @freya291 Год назад +2

    Hello, and thank you for this great content.
    What may happen if you have multi-input models and large datasets? Would you use the for loop to separate the input features and the labels?

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 года назад +1

    what would be also cool is to see a video on vision transformer?

  • @fiknthapis6231
    @fiknthapis6231 Год назад +1

    Good stuff

  • @elafakceramicmagasin3705
    @elafakceramicmagasin3705 2 года назад

    hi greg we need a road map for sql or at least some course suggestions , or a tutorial from you will be great

    • @GregHogg
      @GregHogg  2 года назад +1

      You might want to check this Specialization out: ruclips.net/video/V6pZ_-4KPYA/видео.html

  • @anwerhassan154
    @anwerhassan154 Год назад

    thank you very much, but how can I print the result from the model and visualization the actual data and prediction data

  • @Ecoute_AI
    @Ecoute_AI Год назад

    Please make a video on how to train voice model stem by step in pycharm, please sir make video on this

  • @arsheyajain7055
    @arsheyajain7055 2 года назад

    Wonderful

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 года назад +1

    Is there a way to see what you have already included in the pipeline?

    • @GregHogg
      @GregHogg  2 года назад

      That's a great question. I actually don't know the answer.

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 года назад

    doesn't cache simply mean, take that data and put it in local memory for reuse again? not sure what point I am missing.

    • @GregHogg
      @GregHogg  2 года назад

      Their caching process is rather complex. I would just think of it as remembering.

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 года назад

    may be PyTorch also has something like this? is it very different?

    • @GregHogg
      @GregHogg  2 года назад

      I'm just learning it now. When I feel I understand everything well enough, I will teach it back :)

  • @koji4059
    @koji4059 2 года назад

    Could you make a review on HyperSkill Python course. I’ve heard it’s very good but not sure.

    • @GregHogg
      @GregHogg  2 года назад

      Never heard of it.

    • @koji4059
      @koji4059 2 года назад

      @@GregHogg It’s also known as JetBrains Academy. It’s entire structure is project based learning and they have a Python Core track and a new Machine Learning in Python course.

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 года назад

    it seems like a really unintuitive way to create a pipeline. wouldn't it be better to create a list of first class functions, where each function within the list does a step in the pipeline.

    • @GregHogg
      @GregHogg  2 года назад

      You could make a function where it does a list of those functions

  • @cagataytekin6372
    @cagataytekin6372 Месяц назад

    imparator