Wow! Really cool progress on the app! It feels like you're really close to implementing the eye tracking if you follow the same method you used for connecting to an external app.
Great work. This was very enlightening. I want to create an implementation using different programming languages and your techniques opened my mind to many new possibilities.
Thanks for the kind words. I'm always happy when I can inspire people to contribute to the Godot community. There is a severe lack of Godot tutorials covering these things yet
I was pleasantly surprised how easy it was for Godot to listen to an external data stream coming from another app! This opens up so many possibilities.
@@LewdGarlic-mh8hj oh, heck yeah! Good to know that use case works well, I want to try both VTubing and using livestream chat data in my Godot projects at some point.
@@rosly_yt streaming chat data into Godot via UDP/TCP is such a neat idea! I haven't thought about that yet. This could potentially provide the opportunity to create a whole streaming overlay with chat integration on screen. Neat!
@@LewdGarlic-mh8hj I was trying to go one step further, making a 3D platformer where chat messages were physical obstacles that dropped out of the sky. I haven't worked on that in months, though. I have however made other stream assets in Godot, specifically a timer that I've been slowly iterating on for my "free steam games, 5 minutes each" streams. Not as exciting, but granular customization and easy integration with OBS both show up in that use of the engine as well.
@@LewdGarlic-mh8hj After a quick look, seems vpuppr is licensed under the Mozilla Public License 2.0, haven't checked the details yet; but the cheat-sheet it has at the top of the page seems to suggest you just can't use the trademark or hold them responsible for anything, and you must disclose the source, provide a notice of the license and copyright, and, include a copy of the license file. Dunno how that would work with your plans; but if it's compatible you might wanna check it out, maybe there could be something there you could borrow, or even just merge the projects and just contribute to that the two projects already seem to share so much in common in terms of intended use-cases. I haven't checked if any components and libraries have different licenses though.
@@LewdGarlic-mh8hj Looks like most other stuff in that repo is either under Apache 2.0, or the same license as the main app. I ddin't check too carefully though.
@@tiagotiagot I skimmed over the project and it seems that they resorted to commercial solutions for eyetracking. I'm still trying to find a good webcam based open source solution for eyetracking.
@@LewdGarlic-mh8hj They got a bunch of trackers supported, their own libraries have those licenses I mentioned. As for the trackers themselves, from the ones I could find a license, OpenSeeFace is BSD 2-Clause "Simplified" License, dunno if it does more than blink detection), and VtubeStudio seems to be MIT (didn't studied all the stuff it does, seems to be in itlsef a vtubbing app, not sure if the phone app that does the tracking is included in that license or just the desktop app that interprets the data; having a hard time finding info on that; seems it might accept tracking data from other sources I think). The author of MeowFace seems to have a few repositories on Github, but not for that specific app.
cool project. Jiggle physics next?
Wow! Really cool progress on the app!
It feels like you're really close to implementing the eye tracking if you follow the same method you used for connecting to an external app.
It doesn't even look like stable diffusion to be honest. You did a good job.
yanderee aprooved
Biggest garlic bulbs I've ever seen. What is this video about?
Great work. This was very enlightening. I want to create an implementation using different programming languages and your techniques opened my mind to many new possibilities.
Thanks for the kind words. I'm always happy when I can inspire people to contribute to the Godot community. There is a severe lack of Godot tutorials covering these things yet
@@LewdGarlic-mh8hj Yes. Godot is a very interesting tool. I will get to learn it better.
i had no idea godot could do something like that. looks awesome
I was pleasantly surprised how easy it was for Godot to listen to an external data stream coming from another app! This opens up so many possibilities.
@@LewdGarlic-mh8hj oh, heck yeah! Good to know that use case works well, I want to try both VTubing and using livestream chat data in my Godot projects at some point.
@@rosly_yt streaming chat data into Godot via UDP/TCP is such a neat idea! I haven't thought about that yet. This could potentially provide the opportunity to create a whole streaming overlay with chat integration on screen. Neat!
@@LewdGarlic-mh8hj I was trying to go one step further, making a 3D platformer where chat messages were physical obstacles that dropped out of the sky. I haven't worked on that in months, though.
I have however made other stream assets in Godot, specifically a timer that I've been slowly iterating on for my "free steam games, 5 minutes each" streams. Not as exciting, but granular customization and easy integration with OBS both show up in that use of the engine as well.
This is so cool. Can't wait to see how else Godot is used
Is this based on vpuppr? Or witten from scratch?
This is written from scratch. All external tools I use in the process have been mentioned in the video.
@@LewdGarlic-mh8hj After a quick look, seems vpuppr is licensed under the Mozilla Public License 2.0, haven't checked the details yet; but the cheat-sheet it has at the top of the page seems to suggest you just can't use the trademark or hold them responsible for anything, and you must disclose the source, provide a notice of the license and copyright, and, include a copy of the license file. Dunno how that would work with your plans; but if it's compatible you might wanna check it out, maybe there could be something there you could borrow, or even just merge the projects and just contribute to that the two projects already seem to share so much in common in terms of intended use-cases. I haven't checked if any components and libraries have different licenses though.
@@LewdGarlic-mh8hj Looks like most other stuff in that repo is either under Apache 2.0, or the same license as the main app. I ddin't check too carefully though.
@@tiagotiagot I skimmed over the project and it seems that they resorted to commercial solutions for eyetracking. I'm still trying to find a good webcam based open source solution for eyetracking.
@@LewdGarlic-mh8hj They got a bunch of trackers supported, their own libraries have those licenses I mentioned. As for the trackers themselves, from the ones I could find a license, OpenSeeFace is BSD 2-Clause "Simplified" License, dunno if it does more than blink detection), and VtubeStudio seems to be MIT (didn't studied all the stuff it does, seems to be in itlsef a vtubbing app, not sure if the phone app that does the tracking is included in that license or just the desktop app that interprets the data; having a hard time finding info on that; seems it might accept tracking data from other sources I think). The author of MeowFace seems to have a few repositories on Github, but not for that specific app.
pretty cool!