Train, Test, & Validation Sets | How to Train Machine Learning Models (Properly!!!)

Поделиться
HTML-код
  • Опубликовано: 18 окт 2021
  • The Notebook: colab.research.google.com/dri...
    Thank you for watching the video! You can learn data science FASTER at mlnow.ai!
    Master Python at mlnow.ai/course-material/python/!
    Learn SQL & Relational Databases at mlnow.ai/course-material/sql/!
    Learn NumPy, Pandas, and Python for Data Science at mlnow.ai/course-material/data...!
    Become a Machine Learning Expert at mlnow.ai/course-material/ml/!
    Don't forget to subscribe if you enjoyed the video :D

Комментарии • 28

  • @GregHogg
    @GregHogg  11 месяцев назад

    Take my courses at mlnow.ai/!

  • @djjiang3718
    @djjiang3718 2 года назад +3

    Just want to say Thank you, Greg! love your content always good stuff! Keep up with hard work! Thanks for teaching and sharing !

    • @GregHogg
      @GregHogg  2 года назад

      I really appreciate this, thanks so much and you're very welcome 😄😄

  • @tartlord7061
    @tartlord7061 Год назад

    Great and easy to follow video, thanks!

  • @panagiotisgoulas8539
    @panagiotisgoulas8539 2 года назад

    Cool. thanks for that.

  • @arsheyajain7055
    @arsheyajain7055 2 года назад

    Oooh awesome!!

  • @natureclipsreal
    @natureclipsreal Год назад

    If I am using cross validation during the training process, can I still use a validation set after training the model?

  • @PeterPan-xp2gl
    @PeterPan-xp2gl Год назад +1

    Hey Greg, thanks for your video! Could you explain why you convert the dataframe to a numpy matrix? Since the whole procedure also works with data frames?

    • @ismailucuran4523
      @ismailucuran4523 Год назад +1

      probably its because he didn't use scikitlearn treain_test_split

  • @kshitijalawandi4443
    @kshitijalawandi4443 2 года назад

    This is awesome....

  • @nayliafiqah4072
    @nayliafiqah4072 Год назад

    Thank you so much;

    • @GregHogg
      @GregHogg  Год назад

      You're very welcome!!

  • @mayreyes4402
    @mayreyes4402 Год назад

    when I try to find mean absolute error for linear_test_ preds the result when I run it is "ValueError: could not convert string to float: 'KS'" what should I do with that?

    • @itowindsor
      @itowindsor 2 месяца назад

      One of your feature might be a categorical one. Therefore your models can't work with it. One way to overcome it is to one hot encode this feature. It will increase the dimension of your features spaces (as you will have one more dimension for each category) but every algorithm will understand it

  • @emekaanammah9207
    @emekaanammah9207 2 года назад

    Where did you download the california housing test and train dataset from?

    • @GregHogg
      @GregHogg  2 года назад

      Google Colab. Free cloud env

  • @user-ip9zo8zp4c
    @user-ip9zo8zp4c 11 месяцев назад

    Is it possible that you wrote the arguments of 'mean_absolute_error' in the wrong order?

  • @jyotikapatil2354
    @jyotikapatil2354 Год назад

    Only video explaining actual hyperparameter tuning using validation test.

  • @diazjubairy1729
    @diazjubairy1729 2 года назад

    How to set the proportion of train, val and test of our dataset ?

    • @GregHogg
      @GregHogg  2 года назад

      How technically, or what numbers should you use?

    • @diazjubairy1729
      @diazjubairy1729 2 года назад

      @@GregHogg train : val : test = 50 : 20 : 30

    • @GregHogg
      @GregHogg  2 года назад

      @@diazjubairy1729 is this a question?

    • @diazjubairy1729
      @diazjubairy1729 2 года назад

      @@GregHogg that is the proportion that i want, how to split the dataset like that ?

    • @GregHogg
      @GregHogg  2 года назад +1

      @@diazjubairy1729 sklearn train test split (do it twice), or shuffle a pandas DataFrame and get split indices

  • @pogiribhanuteja4650
    @pogiribhanuteja4650 2 года назад

    When will be the next live session..?

    • @GregHogg
      @GregHogg  2 года назад

      I think I'll be busy this weekend unfortunately. If not, this weekend, otherwise probably the weekend after.

  • @mehediazad1780
    @mehediazad1780 Год назад +1

    you confused me by your variable name