- Видео 3
- Просмотров 45 057
The Programming Piglet
Великобритания
Добавлен 2 окт 2019
I LOVE to code, and I can finally do it again... by voice.
I can't use my computer keyboard for long periods of time anymore because of my RSI (repetitive strain injury), so I'm so grateful that I figured out that I can still code using Talon voice recognition software to type instead of my hands. I'm so happy to be able to share all my programming projects with you now!
I can't use my computer keyboard for long periods of time anymore because of my RSI (repetitive strain injury), so I'm so grateful that I figured out that I can still code using Talon voice recognition software to type instead of my hands. I'm so happy to be able to share all my programming projects with you now!
Automated Lip Syncing | Apple facial recognition + Talon + Unity | Salsa LipSync Suite +Unity
Learn about web accessibility on everyonesweb.com, a site that I coded mostly by voice!
I managed to get my character to lip sync automatically! I love when cartoon characters lip sync, but animating speech is hard work and takes such a long time. So, I tried a couple of methods to try and get an automated lip syncing system in place.
Chapters:
0:00 Intro
0:36 Plan 1: Using Apple’s facial recognition feature (combined with a custom Talon Voice script and Unity)
2:00 Live voice coding segment
2:38 Plan 1 continued
3:00 Plan 1 results
3:40 Plan 2 intro - using Salsa LipSync Suite and Unity
4:16 How Salsa LipSync is able to make lip syncing automatic using an audio’s waveform
5:15 Implementing the ...
I managed to get my character to lip sync automatically! I love when cartoon characters lip sync, but animating speech is hard work and takes such a long time. So, I tried a couple of methods to try and get an automated lip syncing system in place.
Chapters:
0:00 Intro
0:36 Plan 1: Using Apple’s facial recognition feature (combined with a custom Talon Voice script and Unity)
2:00 Live voice coding segment
2:38 Plan 1 continued
3:00 Plan 1 results
3:40 Plan 2 intro - using Salsa LipSync Suite and Unity
4:16 How Salsa LipSync is able to make lip syncing automatic using an audio’s waveform
5:15 Implementing the ...
Просмотров: 835
Видео
I Had To Learn To Code By Voice | Talon Voice | Tobii Eye Tracker
Просмотров 9 тыс.3 года назад
Learn about web accessibility on everyonesweb.com, a site that I coded mostly by voice! I had to learn to code by voice. Finally, I've found a solution to not being able to type for long periods of time because of RSI (Repetitive Strain Injury) - hands free coding! I now use Talon Voice and a Tobii eye tracker to control my computer using voice recognition. It's great accessibility software tha...
Genetic algorithms explained in 6 minutes (...and 28 seconds)
Просмотров 35 тыс.5 лет назад
Genetic algorithms are a really fun part of machine learning and are pretty simple to implement once you understand the mechanics. Twitter: @everyonesweb Learn about web accessibility on everyonesweb.com, a site that I coded mostly by voice!
the best explanation
Great and clear explanation. This was a great resource to learn about this topic for my machine learning class. Thank you!
thank you!
Awesome clear explanation..Good olde Jonathan
finally I understand the purpose of mutation
You're the same person who saved my programming career by introducing me to talon and now you're helping me and my data science masters as well hahaha thank you
hope you are still out there working on it
Why does this video has likes in just 3 digits. Such an amazing explanation.
Stick around for the next video to learn how to program genetic algorithms in python 💔💔
Don't stop girl, u nailed it!
Extraordinary explanation and animation
you have a beautiful voice. thank you for your video.
Very well explained. Thanks.
This video was incredible! You deserve much more than 373 subscribers :)
nice work!
I mean, you can probably just change a few things to reduce your RSI. I had really bad RSI from using my mouse, so I switched to a linux desktop with a tiling window manager, and Neovim to significantly reduce mouse use. If your issue is with using a keyboard, you can get a more ergonomic split keyboard to help that. I also use the Vimium C chrome extension for mouse-free browsing, but I imagine your eye+voice tracking solution would be better for that. I just can't imagine using that for writing everything though. And that pop mouth noise is probably fatiguing too.
OMG! An explanation that finally makes complete sense! Thank you, thank you, thank you.
This is amazing
You could get rid of the 28 seconds by cutting out fluff like from 2:15 to 2:28.
This is an amazing expalantion!!!
Awesome explanation. Thank you!
You just saved me girliie ty ❤
Stumbled upon this video because was looking more about Copilot-like programming, where you just tell AI what to do, and it does. Just a bit higher level than typing everything yourself, but everything, not just "ugh, give me code for sorting fractals". First of all you have very pleasant voiceб but that mouse click command is one of the cutes things I've ever heard o)
but bro... Jonathon is gay!
bro is capable of having children
best explanaition ever,please dont stop
Hi, how are you now?
It helped me thanks
nice
I created a genetic algorithm to find combinations of weights and ingredients in meals that meet a person's desired nutritional criteria, both macronutrients and micronutrients. The solution was created in Go without using any library. I absorbed the concept of genetic algorithms and decided to implement something that met my exact objective. I was very happy when I noticed that the results were incredibly satisfactory. A varying number of macronutrient and micronutrient restrictions could lead to meal combinations with ingredients that are very close to what is expected. I am Brazilian and I intend to launch this feature in Brazil in the next few days. If anyone is interested in knowing details about this, please don't hesitate to respond.
That's interesting, I'm still grasping the GA algorithm, I barely know about algorithms tbh let alone the implementation. But I intend to use it in my thesis project for scheduling and room loan system in my faculty. I'd like to know more of your implementation, if that's okay.
What is the repo
Are you still coding? An update to your current workflow would be very appreciated. I imagine you'd be much more proficient and have a smoothed out setup by now. Would love a new demo.
Same thoughts!
Simple and clear explanation.Kudos for your great presentation.
I'm still waiting for the second part 😢
I have fallen into this boat as well; are you still using eye tracking or has your RSI gotten better?
Thank you so much. The best animation about genetic algorithms I've never seen <3
great！
Thank you so much for making this. I'm in the exact same boat as you were. I'll give talon a try!
I'm a month or so into using Talon voice commands. The eye tracking you're showing is sick, this is my first time seeing it. Thanks very much! 'sauce' made me laugh
Damn who on Earth takes so much trouble to go to work?
GitHub Copilot is also a game changer for us with RSI
thank you so much for the great explanation <3
What tobii model do you use to track your eyes?
It's a 4C :) I'm not sure they sell them anymore though, I got it a few years back
That is the best explanation ever, Thank you!
So this program is specifically for people who work in coding? Not for people who work in Sales for ex?
How do you change the left click command from a word, like the default "touch", to a noise like you do? Thank you for the video, your voice is rlly cute btw :)
Hi, awesome video. Your little show case gave me confidence to try that. I was wondering, if you have experience with the eye tracking on two monitors? I read that it doesn't work for gaming, but I'm interested in using it for work.
Just curious, did you ever heal eventually? Or is your rsi permenant
It did get much better eventually :) Though it's always lurking and I do still overdo it with typing too much sometimes and then spend the next week regretting it! I try to combine voice coding with typing these days - I'll use speech for the repetitive or standard things, and I'll use the mouse & keyboard to scroll about and type more obscure stuff (e.g. if it has a lot of weird characters in). Means neither my voice or my hands have too much strain :)
@@theprogrammingpiglet1681 how long would you say it took u to heal if u had to give a time estimate?
@@js_programmer8423 Hm I'd say there was about 3-4 weeks where I wasn't using a keyboard at all or using my phone at all. Then another couple of months where I was typing for only a limited amount of time a day. So maybe 3-4 months to physically be alright (ish) again? But it took me a little longer to get past the mental block of thinking I was going to hurt myself with typing, so it's hard to say for sure. And it does come back every now and then, so I wouldn't say it's 100% okay, but it is fine as long as I don't overdo it :)
hi are you using tobii eye tracker 5 or tobii dynavox the similar hardware different software
I was using the tobii eye tracker 4C :)
Helpful video, thanks. But how did you stop Talon accidentally recognizing your talking between commands? For example I don't hear you don't say "Talon Sleep" / "Talon Wake" at any time. Another commenter Joel asked the same question, but no response, so asking myself.
I just clicked out of any typing areas before I spoke so that it didn't type out what I was saying - if I'd have had the Talon speech log up, you'd have been able to see that it was actually still listening!
Hi, great video! I didn't notice any commands for turning Talon off during your video. Did you do that behind the scenes and then cut it out from thebvideo or have you found a way to be able to speak freely without turning Talon off and it interpreting your speech as weird commands?
Thanks! I just clicked out of any typing areas before I spoke so that it didn't type out what I was saying - if I'd have had the Talon speech log up, you'd have been able to see that it was actually still listening!
@@theprogrammingpiglet1681 I see. Thank you for the answer
Really cool, but I think for regular keyboard and mouse users, its still quite slow. An advantage could be if you could translate a voice command to an actual line of code without having to say the actual syntax. E.g. "print The value of x is 5" result - print("The value of is 5")
I agree. You could do that with Talon, but you'd have to be a coder and make custom commands. I actually started using Serenade AI more often than Talon now because it does exactly that. You can just say 'print The value of x is 5' and it does just that in whichever language you're writing in, which is pretty cool.