I think this is the “missing Talon demo” video. A lot of other videos cover *just* programming and not the rest of the flow where one switches back and forth between testing, looking up documentation, and writing. Also great demonstration of how the eye-tracking works, thanks for making this!
Thank you! That's what I struggled with most when I first got my hands on Talon - I went through some tutorials of how to type the alphabet and words and what not, but I had to keep on using my hands to flick between tabs and scroll and whatnot
I started the same journey in 2016 and this video really spoke to me. It really captures the joy of discovery and the hope that comes from finding tools to continue working productively while managing rsi.
@@aaaak4 it is a massive investment in time and effort. The community is incredibly helpful. It’s initially like sitting down at the controls of an airplane. Once you learn to be functionally productive, it really just keeps opening up to you.
I'm a month or so into using Talon voice commands. The eye tracking you're showing is sick, this is my first time seeing it. Thanks very much! 'sauce' made me laugh
Hey also a programmer and here from Reddit, this is a pretty cool concept, I didn't know there was accessibility software that was so advanced like this! Though it must take a lot of practice as you are pretty fast at using it too! Glad you found a way to continue with your passion. Subbed and looking forward to more content and bigger projects.
either until I needed it! I was pleasantly surprised 😀 I could definitely still customise it a lot more to my specific needs, but generally it’s pretty fast to use. Not quite as fast as typing by hand… but it does force me not to have any distractions on (otherwise my computer starts writing down everything the TV or whatever says… which isn’t ideal), so overall I get the same amount of work done in the same time Thanks, I really appreciate that!
Hello! I just came from reading your Reddit post and found it wholesome. So, I had to come say hi! I know nothing about programming, yet your video is so intriguing! Keep it up 🥺🐷💖
Subscribed. I also suffer from RSI and have started to use Dragon together with Talon to get into coding more. Hoping to study programming at university this autumn, and Talon gives me hope that I can actually go through with it. I've been trying to wrap my head around the different commands that comes with the knausj library, and your video was really helpful in sorting out a few questions I had about some of the commands! I would really like to see a video about making your own macros for voice commands like you talked about at the end of the video, so if you want to make one that would be much appreciated, I would definitely watch it! All in all, great stuff! Keep it up!
Sorry to hear about your RSI; that can be really hard. Glad you found Talon though - it’s definitely helped me hold down my career so I love it! Can be a steep learning curve though, especially as there aren’t too many examples about of people using it, so try not to be put off if it takes a while to be able to do things at a normal speed. I hope it all goes well for you at uni this Autumn - programming is awesome so hopefully you’ll enjoy it! Give us an update on how you’re doing once you start :) Thanks for the suggestion/encouragement - I’ll add it to the list of videos to get round to
I really enjoyed this video! I originally went to school for coding but it ended up to be too much for me, so I switched majors. I loved watching you code though and I love all the things you can do with it! I subbed so I can see more content and hopefully learn a bit more coding through you :)
Ahh thank you! I actually originally studied maths & there were some coding modules - I was totally lost though and had no idea what was going on, ever. Looking back now I know more, the lecturer definitely didn’t do a good job of explaining anything and it completely put me off coding for a few years because I thought I just didn’t have the right brain for it! I fell in love with it when I started learning it by myself though and like you said, seeing all the things I could now do with it. If you ever do pick up coding again and make anything, let me know because I’d like to see it!
@@theprogrammingpiglet1681 What resources did you use to teach yourself? Do you have any suggestions? I agree, most coding teachers don't explain it well and rush through things because it seems simple to them, even though it is confusing to us! I think if I went back to it at my own pace I would fall in love with it again. I would love to learn how to code my own game someday!
At the very beginning, I used Khan Academy to teach my self some basic JavaScript. It was decent and did get me into programming, but I’m not sure I’d recommend it as the best way into it on reflection. If you want to learn programming specifically for games, Unity is awesome 😀 I use it a lot for a bunch of different things - it’s a (free) games engine. There’s a channel on RUclips called Brackeys and he’s like widely regarded as the ultimate Unity teacher; his tutorials are great! I think he has a beginners playlist (ruclips.net/p/PLPV2KyIb3jR53Jce9hP7G5xC4O9AgnOuL). That’s probably where I would’ve liked to start if I was learning from scratch again 🐷
I mean, you can probably just change a few things to reduce your RSI. I had really bad RSI from using my mouse, so I switched to a linux desktop with a tiling window manager, and Neovim to significantly reduce mouse use. If your issue is with using a keyboard, you can get a more ergonomic split keyboard to help that. I also use the Vimium C chrome extension for mouse-free browsing, but I imagine your eye+voice tracking solution would be better for that. I just can't imagine using that for writing everything though. And that pop mouth noise is probably fatiguing too.
Hi, great video! I didn't notice any commands for turning Talon off during your video. Did you do that behind the scenes and then cut it out from thebvideo or have you found a way to be able to speak freely without turning Talon off and it interpreting your speech as weird commands?
Thanks! I just clicked out of any typing areas before I spoke so that it didn't type out what I was saying - if I'd have had the Talon speech log up, you'd have been able to see that it was actually still listening!
Hi, awesome video. Your little show case gave me confidence to try that. I was wondering, if you have experience with the eye tracking on two monitors? I read that it doesn't work for gaming, but I'm interested in using it for work.
I was using the 4C, I'm not sure it's sold anymore. It used to be the case that the 4C was more accurate than the 5, but things might've changed by now and the 5 might've surpassed the one I'm using, I'm not sure!
@@theprogrammingpiglet1681 No worries, better late than never! Thanks for the info. I bought a model 5 a while back but didn't work great so I returned it. Might have to hunt for a 4C, others have recommended that one too. Thanks again!
Hi! I am person with SMA looking for an eye tracker on Mac. I see that you are using Tobii tracker. Did you use it for the whole video? How do you rate its precision? Is there possibility to use mimics as mouse actions, i.e. moving eyebrow for clicking mouse’s left button?
I did use it for the whole video :) I like it a lot - I use the 4C, which used to be more accurate than the 5 (as in the mouse isn't jittery when tracking your eye movements and it's easier to click smaller things on the screen), but I'm not sure how things are these days and whether the 5 has improved. And yep, you can set it up with a bunch of facial expression controls - eyebrows, winking, lip movements etc. - and link that to mouse actions through Talon. Did you end up getting an eye tracker?
@@theprogrammingpiglet1681, I did, I am actually writing to you with 5 but have not tried Talon yet, as I've it from a couple of days. I must check it out!
Thank you so much for sharing this informative video. I'm looking at buying an eye tracker for the RSI in my wrists and hope this will allow me to continue coding. Which type of Tobii eye tracker are you using exactly? Thanks again for making this video!
I was using the 4C, I'm not sure it's sold anymore. It used to be the case that the 4C was more accurate than the 5, but things might've changed by now and the 5 might've surpassed the one I'm using, I'm not sure! Did you end up buying one?
Thanks a lot! You can say the word ‘touch’ and the voice coding software I use will do a mouse click, or you just make a popping noise instead - kind of like you’re imitating a fish haha - and it will click. I do it that way because it’s really fast ☺️ if I want to right click, I say ‘righty’ and if I want to double click, I say ‘dubclick’
@@theprogrammingpiglet1681I am in a similar situation as you. I am not able to se the keyboard, mouse for long periods of time. It has not been diagnosed yet. Your illustration is encouraging for me. Thank you so much. May God bless you!
How do you change the left click command from a word, like the default "touch", to a noise like you do? Thank you for the video, your voice is rlly cute btw :)
You mean setting up Talon? I followed this ruclips.net/video/wizshwYfuRo/видео.html ☺️ it was helpful as I forgot a few steps when trying to do it off the bat by myself and couldn’t get it to work for a while! Once that’s set up, I just browsed through the help menus by saying help context or help alphabet to see what commands were available and get to grips with things
Helpful video, thanks. But how did you stop Talon accidentally recognizing your talking between commands? For example I don't hear you don't say "Talon Sleep" / "Talon Wake" at any time. Another commenter Joel asked the same question, but no response, so asking myself.
I just clicked out of any typing areas before I spoke so that it didn't type out what I was saying - if I'd have had the Talon speech log up, you'd have been able to see that it was actually still listening!
Stumbled upon this video because was looking more about Copilot-like programming, where you just tell AI what to do, and it does. Just a bit higher level than typing everything yourself, but everything, not just "ugh, give me code for sorting fractals". First of all you have very pleasant voiceб but that mouse click command is one of the cutes things I've ever heard o)
Really cool, but I think for regular keyboard and mouse users, its still quite slow. An advantage could be if you could translate a voice command to an actual line of code without having to say the actual syntax. E.g. "print The value of x is 5" result - print("The value of is 5")
I agree. You could do that with Talon, but you'd have to be a coder and make custom commands. I actually started using Serenade AI more often than Talon now because it does exactly that. You can just say 'print The value of x is 5' and it does just that in whichever language you're writing in, which is pretty cool.
It did get much better eventually :) Though it's always lurking and I do still overdo it with typing too much sometimes and then spend the next week regretting it! I try to combine voice coding with typing these days - I'll use speech for the repetitive or standard things, and I'll use the mouse & keyboard to scroll about and type more obscure stuff (e.g. if it has a lot of weird characters in). Means neither my voice or my hands have too much strain :)
@@js_programmer8423 Hm I'd say there was about 3-4 weeks where I wasn't using a keyboard at all or using my phone at all. Then another couple of months where I was typing for only a limited amount of time a day. So maybe 3-4 months to physically be alright (ish) again? But it took me a little longer to get past the mental block of thinking I was going to hurt myself with typing, so it's hard to say for sure. And it does come back every now and then, so I wouldn't say it's 100% okay, but it is fine as long as I don't overdo it :)
I was using the 4C, I'm not sure it's sold anymore. It used to be the case that the 4C was more accurate than the 5, but things might've changed by now and the 5 might've surpassed the one I'm using, I'm not sure!
The 4C, I'm not sure it's sold anymore. It used to be the case that the 4C was more accurate than the 5, but things might've changed by now and the 5 might've surpassed the one I'm using, I'm not sure!
It did get a lot better, and I generally can cope with a full work day of coding, though if I get too into something and do more hours into the evening, I feel it start to creep back! It comes and goes, but it's manageable at the moment :)
I think this is the “missing Talon demo” video. A lot of other videos cover *just* programming and not the rest of the flow where one switches back and forth between testing, looking up documentation, and writing. Also great demonstration of how the eye-tracking works, thanks for making this!
Thank you! That's what I struggled with most when I first got my hands on Talon - I went through some tutorials of how to type the alphabet and words and what not, but I had to keep on using my hands to flick between tabs and scroll and whatnot
@@theprogrammingpiglet1681 Hi again are u using Tobii eye tracker 5 ?
@@theprogrammingpiglet1681 ?
@@l89strike75 x2
@@l89strike75 I was using the 4C :)
I started the same journey in 2016 and this video really spoke to me. It really captures the joy of discovery and the hope that comes from finding tools to continue working productively while managing rsi.
how did it go i wanna start but im scarred it might be a waste of time
@@aaaak4 it is a massive investment in time and effort. The community is incredibly helpful. It’s initially like sitting down at the controls of an airplane. Once you learn to be functionally productive, it really just keeps opening up to you.
you have a beautiful voice. thank you for your video.
I'm a month or so into using Talon voice commands. The eye tracking you're showing is sick, this is my first time seeing it. Thanks very much! 'sauce' made me laugh
I'm starting on this journey today, thank you for documenting it this way. This was really helpful
Hey also a programmer and here from Reddit, this is a pretty cool concept, I didn't know there was accessibility software that was so advanced like this! Though it must take a lot of practice as you are pretty fast at using it too! Glad you found a way to continue with your passion.
Subbed and looking forward to more content and bigger projects.
either until I needed it! I was pleasantly surprised 😀
I could definitely still customise it a lot more to my specific needs, but generally it’s pretty fast to use. Not quite as fast as typing by hand… but it does force me not to have any distractions on (otherwise my computer starts writing down everything the TV or whatever says… which isn’t ideal), so overall I get the same amount of work done in the same time
Thanks, I really appreciate that!
thank you so much for the great explanation
Thank you so much for making this. I'm in the exact same boat as you were. I'll give talon a try!
Hello! I just came from reading your Reddit post and found it wholesome. So, I had to come say hi! I know nothing about programming, yet your video is so intriguing! Keep it up 🥺🐷💖
Ahh, thanks so much, that's so nice of you to come and say hi! Also, why did I not know this emoticon exists?? 🐷🐷🐷 I love it!
This is amazing
Hey - found your channel via Reddit! Super cool video concept - i love the illustration, keep it up! I just started too!
Thanks a lot ☺️
SAME!
Subscribed. I also suffer from RSI and have started to use Dragon together with Talon to get into coding more. Hoping to study programming at university this autumn, and Talon gives me hope that I can actually go through with it. I've been trying to wrap my head around the different commands that comes with the knausj library, and your video was really helpful in sorting out a few questions I had about some of the commands!
I would really like to see a video about making your own macros for voice commands like you talked about at the end of the video, so if you want to make one that would be much appreciated, I would definitely watch it!
All in all, great stuff! Keep it up!
Sorry to hear about your RSI; that can be really hard. Glad you found Talon though - it’s definitely helped me hold down my career so I love it! Can be a steep learning curve though, especially as there aren’t too many examples about of people using it, so try not to be put off if it takes a while to be able to do things at a normal speed.
I hope it all goes well for you at uni this Autumn - programming is awesome so hopefully you’ll enjoy it! Give us an update on how you’re doing once you start :)
Thanks for the suggestion/encouragement - I’ll add it to the list of videos to get round to
This is really cool :-) thanks for making this demo
This is a wonderful demonstration of Talon and programming by voice. Thank you! Hope you are doing well!
I really enjoyed this video! I originally went to school for coding but it ended up to be too much for me, so I switched majors. I loved watching you code though and I love all the things you can do with it! I subbed so I can see more content and hopefully learn a bit more coding through you :)
Ahh thank you! I actually originally studied maths & there were some coding modules - I was totally lost though and had no idea what was going on, ever. Looking back now I know more, the lecturer definitely didn’t do a good job of explaining anything and it completely put me off coding for a few years because I thought I just didn’t have the right brain for it!
I fell in love with it when I started learning it by myself though and like you said, seeing all the things I could now do with it. If you ever do pick up coding again and make anything, let me know because I’d like to see it!
@@theprogrammingpiglet1681 What resources did you use to teach yourself? Do you have any suggestions? I agree, most coding teachers don't explain it well and rush through things because it seems simple to them, even though it is confusing to us! I think if I went back to it at my own pace I would fall in love with it again. I would love to learn how to code my own game someday!
At the very beginning, I used Khan Academy to teach my self some basic JavaScript. It was decent and did get me into programming, but I’m not sure I’d recommend it as the best way into it on reflection. If you want to learn programming specifically for games, Unity is awesome 😀 I use it a lot for a bunch of different things - it’s a (free) games engine. There’s a channel on RUclips called Brackeys and he’s like widely regarded as the ultimate Unity teacher; his tutorials are great! I think he has a beginners playlist (ruclips.net/p/PLPV2KyIb3jR53Jce9hP7G5xC4O9AgnOuL). That’s probably where I would’ve liked to start if I was learning from scratch again 🐷
HEY! This is awesome!! I came here via Reddit as well.
Thanks a lot! ☺️
I mean, you can probably just change a few things to reduce your RSI. I had really bad RSI from using my mouse, so I switched to a linux desktop with a tiling window manager, and Neovim to significantly reduce mouse use. If your issue is with using a keyboard, you can get a more ergonomic split keyboard to help that. I also use the Vimium C chrome extension for mouse-free browsing, but I imagine your eye+voice tracking solution would be better for that. I just can't imagine using that for writing everything though. And that pop mouth noise is probably fatiguing too.
Hi, great video! I didn't notice any commands for turning Talon off during your video. Did you do that behind the scenes and then cut it out from thebvideo or have you found a way to be able to speak freely without turning Talon off and it interpreting your speech as weird commands?
Thanks! I just clicked out of any typing areas before I spoke so that it didn't type out what I was saying - if I'd have had the Talon speech log up, you'd have been able to see that it was actually still listening!
@@theprogrammingpiglet1681 I see. Thank you for the answer
Hi,
awesome video. Your little show case gave me confidence to try that. I was wondering, if you have experience with the eye tracking on two monitors?
I read that it doesn't work for gaming, but I'm interested in using it for work.
hope you are still out there working on it
Awesome video! Which eye tracker are you using?
I am also wondering the same :)
I was using the 4C, I'm not sure it's sold anymore. It used to be the case that the 4C was more accurate than the 5, but things might've changed by now and the 5 might've surpassed the one I'm using, I'm not sure!
I'm apparently very slow to reply to comments :D
I was using the Tobii 4C
@@theprogrammingpiglet1681 No worries, better late than never! Thanks for the info. I bought a model 5 a while back but didn't work great so I returned it. Might have to hunt for a 4C, others have recommended that one too. Thanks again!
Hi! I am person with SMA looking for an eye tracker on Mac. I see that you are using Tobii tracker. Did you use it for the whole video? How do you rate its precision? Is there possibility to use mimics as mouse actions, i.e. moving eyebrow for clicking mouse’s left button?
I did use it for the whole video :) I like it a lot - I use the 4C, which used to be more accurate than the 5 (as in the mouse isn't jittery when tracking your eye movements and it's easier to click smaller things on the screen), but I'm not sure how things are these days and whether the 5 has improved.
And yep, you can set it up with a bunch of facial expression controls - eyebrows, winking, lip movements etc. - and link that to mouse actions through Talon.
Did you end up getting an eye tracker?
@@theprogrammingpiglet1681, I did, I am actually writing to you with 5 but have not tried Talon yet, as I've it from a couple of days. I must check it out!
Thank you so much for sharing this informative video. I'm looking at buying an eye tracker for the RSI in my wrists and hope this will allow me to continue coding. Which type of Tobii eye tracker are you using exactly? Thanks again for making this video!
I was using the 4C, I'm not sure it's sold anymore. It used to be the case that the 4C was more accurate than the 5, but things might've changed by now and the 5 might've surpassed the one I'm using, I'm not sure!
Did you end up buying one?
Hi :) Great video! Did you set up toby eye tracking on your mac?
I did indeed :) Though I don't believe there was much setup involved, I think it was pretty simple to get started with it
Hi, I loved this illustration. Keep it up!
One question though - How do you click without using the mouse/trackpad?
Thanks a lot! You can say the word ‘touch’ and the voice coding software I use will do a mouse click, or you just make a popping noise instead - kind of like you’re imitating a fish haha - and it will click. I do it that way because it’s really fast ☺️ if I want to right click, I say ‘righty’ and if I want to double click, I say ‘dubclick’
@@theprogrammingpiglet1681I am in a similar situation as you. I am not able to se the keyboard, mouse for long periods of time. It has not been diagnosed yet. Your illustration is encouraging for me. Thank you so much. May God bless you!
So this program is specifically for people who work in coding? Not for people who work in Sales for ex?
I have fallen into this boat as well; are you still using eye tracking or has your RSI gotten better?
You should've added the popping cat meme
HA! That would've been very fitting wouldn't it
How do you change the left click command from a word, like the default "touch", to a noise like you do? Thank you for the video, your voice is rlly cute btw :)
Would you be so kind as too elaborate a bit how you got this all setup? I am struggling getting started with this.
You mean setting up Talon? I followed this ruclips.net/video/wizshwYfuRo/видео.html ☺️ it was helpful as I forgot a few steps when trying to do it off the bat by myself and couldn’t get it to work for a while! Once that’s set up, I just browsed through the help menus by saying help context or help alphabet to see what commands were available and get to grips with things
Helpful video, thanks. But how did you stop Talon accidentally recognizing your talking between commands? For example I don't hear you don't say "Talon Sleep" / "Talon Wake" at any time. Another commenter Joel asked the same question, but no response, so asking myself.
I just clicked out of any typing areas before I spoke so that it didn't type out what I was saying - if I'd have had the Talon speech log up, you'd have been able to see that it was actually still listening!
Stumbled upon this video because was looking more about Copilot-like programming, where you just tell AI what to do, and it does. Just a bit higher level than typing everything yourself, but everything, not just "ugh, give me code for sorting fractals". First of all you have very pleasant voiceб but that mouse click command is one of the cutes things I've ever heard o)
Really cool, but I think for regular keyboard and mouse users, its still quite slow. An advantage could be if you could translate a voice command to an actual line of code without having to say the actual syntax.
E.g. "print The value of x is 5"
result - print("The value of is 5")
I agree. You could do that with Talon, but you'd have to be a coder and make custom commands.
I actually started using Serenade AI more often than Talon now because it does exactly that. You can just say 'print The value of x is 5' and it does just that in whichever language you're writing in, which is pretty cool.
Just curious, did you ever heal eventually? Or is your rsi permenant
It did get much better eventually :) Though it's always lurking and I do still overdo it with typing too much sometimes and then spend the next week regretting it! I try to combine voice coding with typing these days - I'll use speech for the repetitive or standard things, and I'll use the mouse & keyboard to scroll about and type more obscure stuff (e.g. if it has a lot of weird characters in). Means neither my voice or my hands have too much strain :)
@@theprogrammingpiglet1681 how long would you say it took u to heal if u had to give a time estimate?
@@js_programmer8423 Hm I'd say there was about 3-4 weeks where I wasn't using a keyboard at all or using my phone at all. Then another couple of months where I was typing for only a limited amount of time a day. So maybe 3-4 months to physically be alright (ish) again? But it took me a little longer to get past the mental block of thinking I was going to hurt myself with typing, so it's hard to say for sure. And it does come back every now and then, so I wouldn't say it's 100% okay, but it is fine as long as I don't overdo it :)
Hi, thank you for the video are you using Tobii eye tracker 5?
Hi again are u using Tobii eye tracker 5 ?
I was using the 4C, I'm not sure it's sold anymore. It used to be the case that the 4C was more accurate than the 5, but things might've changed by now and the 5 might've surpassed the one I'm using, I'm not sure!
@@theprogrammingpiglet1681 Thank you if I'll get the Tobii 4c will l be able to use it as you used it in the video? just for windows control?
@@theprogrammingpiglet1681 hi
@@theprogrammingpiglet1681 in case you've missed the notification
What tobii model do you use to track your eyes?
It's a 4C :) I'm not sure they sell them anymore though, I got it a few years back
what tobii eye tracker are you using?
The 4C, I'm not sure it's sold anymore. It used to be the case that the 4C was more accurate than the 5, but things might've changed by now and the 5 might've surpassed the one I'm using, I'm not sure!
Hi, how are you now?
hi are you using tobii eye tracker 5 or tobii dynavox the similar hardware different software
I was using the tobii eye tracker 4C :)
did your rsi heal by now?
It did get a lot better, and I generally can cope with a full work day of coding, though if I get too into something and do more hours into the evening, I feel it start to creep back! It comes and goes, but it's manageable at the moment :)
@@theprogrammingpiglet1681 same road! Nice
I think I'll use talon voice until the neuralink brain chip comes out.
Just a tip, think you may get more viewership if you add some ASMR tags.
Thanks, interesting idea ☺️ wouldn’t people just click on my video and be like... ‘oh, this isn’t ASMR’ though?
@@theprogrammingpiglet1681 It definitely causes ASMR reactions. I got plenty. Lotta high ranges.