Wenjing Liu
Wenjing Liu
  • Видео 53
  • Просмотров 14 143

Видео

20241219 AWS Machine Learning - Training with EC2
Просмотров 44День назад
#machinelearning #AWS #EC2 👉 Udacity, AWS Machine Learning Engineer Nanodegree, Project 4 ◾ Step 2: EC2 Training ◾ repo: github.com/nov05/udacity-aws-mle-nano-course5 Since the demo training code doesn't appear to use a GPU, I launched a t2.xlarge CPU EC2 instance for the training. Obviously, SageMaker is a fully managed service that saves the hassle of installing GPU drivers, CUDA, Python depe...
20241212 AWS SegeMaker Canvas Data Wrangler data flow: S3 to Feature Store group
Просмотров 38Месяц назад
👉 Udacity AWS Machine Learning Engineer Nanodegree, Course 5, Exercise 4.16 👉 Save to Feature Store Processing Job notebook github.com/nov05/udacity-aws-mle-nano-course5/blob/main/exercise_4.16/New data flow 2024-12-11 11_07_14 PM.ipynb
20241209 Launch an AWS EC2 instance, create "demo.py", and execute it
Просмотров 34Месяц назад
#AWS #MachineLearning #MLOps 👉 Udacity AWS Machine Learning Engineer Nanodegree (ND189) - Course 5, 2.15 Exercise: Lowering Costs with Spot Instances www.evernote.com/shard/s139/u/0/sh/7df126e5-6e53-413d-a4f0-c31df700656a/WPJwxCXLm110RweMfVcj0WlJz5oc_KklNCV9MR5LoDMf7w_DKO9hpP4Yhg P.S. My role doesn't have the permission to create a spot instance.
20241206 ResNet50 133-Dog Breed Image Classification with AWS SageMaker
Просмотров 67Месяц назад
#machinelearning #deeplearning #AWS #MLOps 👉 𝐃𝐨𝐠 𝐁𝐫𝐞𝐞𝐝 𝐈𝐦𝐚𝐠𝐞 𝐂𝐥𝐚𝐬𝐬𝐢𝐟𝐢𝐜𝐚𝐭𝐢𝐨𝐧 𝐰𝐢𝐭𝐡 𝐀𝐖𝐒 𝐒𝐚𝐠𝐞𝐌𝐚𝐤𝐞𝐫 ◾133 dog breeds, 6,680 training pictures (another 835 for validation and 836 for testing) ◾PyTorch ResNet50 pretrained model finetuned in script mode on an AWS "ml.g4dn.xlarge" GPU instance ◾SageMaker hyperparameter optimization, W&B logs and sweep; test accuracy 92% ◾Inference endpoint deployed on an...
20241127 Project 2, CIFAR image classification, AWS Step Functions and Lambda workflow
Просмотров 31Месяц назад
🟢 Udacity AWS Machine Learning Engineer Nanodegree 👉 repo - github.com/nov05/udacity-nd009t-C2-Developing-ML-Workflow
20241122 AWS Machine Learning Workflow: Step Functions for Preprocessing and Training workflow
Просмотров 34Месяц назад
👉 Here's a demo video on setting up a machine learning workflow using AWS Step Functions to preprocess input files and train a model. The workflow is generated by code within a SageMaker notebook and consists of two steps. The first step uses an SKLearnProcessor instance to run a custom Python script that unzips the input file, extracts values, converts them into train-test data files, and stor...
20241122 AWS Machine Learning Workflow: Lambda Function for Preprocessing
Просмотров 67Месяц назад
👉 Here's a demo video on how to set up an AWS Lambda function to preprocess files for downstream tasks in a machine learning workflow. The Lambda function is triggered when a JSON file is uploaded to a specific S3 bucket folder. It unzips the file, extracts the label and review values, splits the data into training and testing sets, and then writes two text files to another folder. 👉 Alternativ...
20241117 Udacity DRLND, Unity Tennis, MADDPG-TD3
Просмотров 98Месяц назад
Env: Unity Tennis Score: 2.6 Colab: drive.google.com/file/d/1VYJT1FR7D4CxjMFZICpcq2BLqrXuyWdu/view W&B training logs: wandb.ai/nov05/udacity-drlnd-matd3-unity-tennis/runs/ehq0fw4a
20240307_021442 how to create multiple environment from the Unity executable in Windows
Просмотров 9410 месяцев назад
👉 changed the code of creating single environment from the Unity executable to creating multiple environments (with Python Subprocess, Multiprocessing, without MLAgents) 👉 check the .py file with the major change: github.com/Nov05/udacity-deep-reinforcement-learning/blob/master/python/unityagents/environment2.py #reinforcementlearning #udacity #machinelearning #unity #mlagents
20240224 Deep Reinforcement Learning, mujoco + mujoco-py
Просмотров 9210 месяцев назад
👉 Install mujoco 150 and mujoco-py-1.50.1.68 in Windows 11 VSCode Powershell miniconda gist.github.com/Nov05/1d49183a91456a63e13782e5f49436be?permalink_comment_id=4935694#gistcomment-4935694
20240219 Reinforcement Learning, PPO, OpenAI Gym's Atari "Pong" pixel game
Просмотров 36210 месяцев назад
👉 Reinforcement Learning, PPO, OpenAI Gym's 𝐀𝐭𝐚𝐫𝐢 "𝐏𝐨𝐧𝐠" pixel game ▪️ 𝐟𝐮𝐥𝐥 𝐜𝐮𝐫𝐫𝐢𝐜𝐮𝐥𝐮𝐦 - www.evernote.com/shard/s139/sh/49b549b3-040e-6829-3800-85e830516134/sdITMf7KBEt6jP_X-hSjU2INJdgfpL8VBCtAS7DHs0C61DeCnJJRR_Yn2Q ▪️ 𝐧𝐨𝐭𝐞𝐛𝐨𝐨𝐤𝐬 - PPO without clipping drive.google.com/file/d/17-HyqTB121RjHvJ03GzY81eGxmmpjY3t github.com/Nov05/Google-Colaboratory/blob/master/20240217_pong_REINFORCE.ipynb - PPO wi...
20240216 reinforcement learning toy env, Policy-Based Methods
Просмотров 2010 месяцев назад
👉 your 6.1 step towards Reinforcement Learning - Policy-Based Methods ▪️ full curriculum - www.evernote.com/shard/s139/sh/cf69fa6a-31fe-720d-ca49-12eaff08c066/DAJfIHP7iO5sZEHsbyIQv11PsYdmzka8OWfHOfD15BULbgKCOp_6iS-aSw ▪️ OpenAI Gym's CartPole-v0 environment view the code - github.com/Nov05/Google-Colaboratory/blob/master/20240216_REINFORCE.ipynb executable in Colab - drive.google.com/file/d/1OE...
20240212 Run a Jupyter notebook to launch the Unity Banana Collecting game (RL-DDQN)
Просмотров 11211 месяцев назад
20240212 Run a Jupyter notebook to launch the Unity Banana Collecting game (RL-DDQN)
20240211 Unity MLAgents Banana Collector, environment set up (aka. setting up Python evn is like...)
Просмотров 4211 месяцев назад
20240211 Unity MLAgents Banana Collector, environment set up (aka. setting up Python evn is like...)
20240208 Reinforcement Learning - Deep Q-Network (DQN)
Просмотров 3711 месяцев назад
20240208 Reinforcement Learning - Deep Q-Network (DQN)
20240202_Tile_Coding.ipynb - Colaboratory, Reinforcement Learning
Просмотров 3311 месяцев назад
20240202_Tile_Coding.ipynb - Colaboratory, Reinforcement Learning
20240202 Reinforcement Learning - Discretization
Просмотров 1411 месяцев назад
20240202 Reinforcement Learning - Discretization
20230921 GitHub Actions auto-uploads repo code to Kaggle, for a better Kaggle workflow
Просмотров 46Год назад
20230921 GitHub Actions auto-uploads repo code to Kaggle, for a better Kaggle workflow
20230705_latex formatted numbered music notations for kalimba, the sound of silence (google colab)
Просмотров 55Год назад
20230705_latex formatted numbered music notations for kalimba, the sound of silence (google colab)
20230705_Copy of music21_creationBoogie.ipynb (Google Colab), Made with Clipchamp
Просмотров 22Год назад
20230705_Copy of music21_creationBoogie.ipynb (Google Colab), Made with Clipchamp
20230615_Python library Gradio (with Colab notebook)
Просмотров 449Год назад
20230615_Python library Gradio (with Colab notebook)
20230612 audio crossfade with Python library Pydub (with Colab notebook)
Просмотров 308Год назад
20230612 audio crossfade with Python library Pydub (with Colab notebook)
20230612 I bypassed MusicGen's 30-second limit (with Colab notebook)
Просмотров 106Год назад
20230612 I bypassed MusicGen's 30-second limit (with Colab notebook)
20230609 music clips generated by MusicGen (10s * 8)
Просмотров 259Год назад
20230609 music clips generated by MusicGen (10s * 8)
20230609 Trying the MusicGen demo notebook
Просмотров 184Год назад
20230609 Trying the MusicGen demo notebook
20230522 graph visualization with python networkx and pyvis.network (x4 speed)
Просмотров 5 тыс.Год назад
20230522 graph visualization with python networkx and pyvis.network (x4 speed)
20230522 graph visualization with python networkx and pyvis.network
Просмотров 712Год назад
20230522 graph visualization with python networkx and pyvis.network
20230508 SAP Official Tutorial - Take a Deep Dive into OData (Beginner)
Просмотров 29Год назад
20230508 SAP Official Tutorial - Take a Deep Dive into OData (Beginner)
20230314 ChatGPT generated Python code to draw flags
Просмотров 101Год назад
20230314 ChatGPT generated Python code to draw flags

Комментарии

  • @JonathanMarlon-o2z
    @JonathanMarlon-o2z 3 месяца назад

    Heidenreic

  • @Hiramale
    @Hiramale 3 месяца назад

    Hey, do you still have the code for this? I've been looking for an example similar to this

    • @wenjingliu7
      @wenjingliu7 2 месяца назад

      Hi, I've just enabled the links in my video descriptions. You can now find the Google Colab notebook there.

  • @Method5440
    @Method5440 8 месяцев назад

    Hey - Any chance you can share the full link to colab notebook?

    • @wenjingliu7
      @wenjingliu7 2 месяца назад

      Hi, I've just enabled the links in my video descriptions. You can now find the Google Colab notebook there.

  • @wenjingliu7
    @wenjingliu7 Год назад

    👉 download the notation sheet - drive.google.com/file/d/1p7NfhAJnIruL2Zc4BCqAvLDoB0lmbdGz 👉【my colab notebook】colab.research.google.com/drive/1qw4aG77bXoeMSmCBlPPYU6LqAHcZ-Zt6

  • @wenjingliu7
    @wenjingliu7 Год назад

    the original notebook - colab.research.google.com/drive/11hX10ErHX1yGKVAHHJs4iYjJkjsTXoeZ my copy - colab.research.google.com/drive/1yMps7e5zE81nwvIeqPy3TCQsfbsxnjx7

  • @wenjingliu7
    @wenjingliu7 Год назад

    👉 my Colab notebook - colab.research.google.com/drive/1n7uEetKNKFV6PBu4-D59bwDY6dO9DnJn

  • @wenjingliu7
    @wenjingliu7 Год назад

    👉 my Colab notebook - colab.research.google.com/drive/1enS7oLn5vVLxRPFXHkwSfEJBZfwU-N9a

  • @wenjingliu7
    @wenjingliu7 Год назад

    👉 Colab notebook - drive.google.com/file/d/1-JFtxWjBmHhmd4j7M9QSnFieUAHBnkzj

  • @wenjingliu7
    @wenjingliu7 Год назад

    my colab notebook link in the video description is not allowed to display by youtube. I am leaving the link here again. hopefully it can be seen. drive.google.com/file/d/1X8U9pLUMCwD0YjkwSMHgPnZka2hOy0NH

  • @theodoregorgovelt2963
    @theodoregorgovelt2963 Год назад

    Tutorial on how to run it on collab pls

    • @wenjingliu7
      @wenjingliu7 Год назад

      Hi, my colab notebook link in the video description is not allowed to display by youtube. I am leaving the link here again. hopefully it can be seen. drive.google.com/file/d/1X8U9pLUMCwD0YjkwSMHgPnZka2hOy0NH

    • @theodoregorgovelt2963
      @theodoregorgovelt2963 Год назад

      @@wenjingliu7 thank you!

  • @breenadorson7745
    @breenadorson7745 2 года назад

    𝕡𝕣𝕠𝕞𝕠𝕤𝕞 🔥

  • @wenjingliu7
    @wenjingliu7 5 лет назад

    Intercept = 46 github.com/Nov05/DS-Unit-2-Linear-Models/blob/master/images/20190711_104540_linear_regression.png Colab Notebook colab.research.google.com/drive/1RfRDqoOJHKex2Fza0K019Z9oSSicOpLG