Effect of Warm Restarts on Stochastic Gradient Descent

arxiv.org/abs/...
Support my learning journey either by clicking the Join button above, becoming a Patreon member, or a one-time Venmo!
/ tunadorable
account.venmo....
Discuss this stuff with other Tunadorks on Discord
/ discord
All my other links
linktr.ee/tuna...

[@immortalityIMT]

Look at this sweet thing: Supermicro X11SPA-TF Motherboard

[@chadx8269]

@7:00 it is a cosine function plotted using logarithmic in the vertical axis.

[@billjasin8388]

Your persistent cough my be GERDs. Look at your diet and taking a course of omeprazole (ask your doctor). I thought my Doc was crazy when he said my stomach was making me cough. Turns out he was right.

[@Tunadorable]

thanks for the concern❤️, the cough has actually gone away recently but this video and the rest that will come out this week were pre-recorded awhile ago

[@OpenSourceAnarchist]

@@Tunadorable Thank god, I've been worried for you too!

[@beagle989]

can we have the code please? also thanks i had no idea there was such drastic differences between schedules, even tho they all got the same place

[@Tunadorable]

github.com/evintunador/templateGPT/blob/main/train.py

[@beagle989]

@@Tunadorable thank you!