Well, _this_ visual is really easy! I used a trick! What I did was taking a screen saver, which 'listens' to computer key strokes at the keyboard. I can just listen to the music, and know when something changes, and just hit a key so that the screen of the screen saver changes. But this is _cheating!_ My other music animations visuals on my channels are _a lot harder!_ I use all kinds of things. For example Blender with the Animation Nodes plugin, which has some nodes to deal with midi. And then I use computer programming skills to put Python code in the script node. To let the notes light up when they are in sync, I have learned to use the node based Shader language of Blender. I also use the Unity game engine, and then C# programming, using a C# midi library to make the data which I use to manipulate game objects. And in Unity I am studying the script based shader language of Unity, called HLSL - High Level Shader Language. I see the integration of music with animations as a separate art form, and devote a lot of time just to learn it. I began by writing my own software from scratch, using Delphi. But that led to too unstable programs. I have succeeded somewhat, though. It taught me the basics. And I have even experimented with Wolfram Mathematica. There is one animation on my Konrad Swart channel made with Mathematica and the Wolfram language. At present I am even considering using Unreal Engine and Houdini, because one can get the most spectacular results with Unreal Engine and with Houdini. But it is tough, especially with Houdini. There exist just two succesful animations on RUclips with Houdini and Midi made by Ramon Levy, with whom I have been inc contact with. ruclips.net/video/pJsRCd5ivyc/видео.html and ruclips.net/video/QHrEWK7eAak/видео.html Notice his in and out zooming effects in the animation.\ And, of course, there is Stephen Malinowski, with whom I have had a lot of contact, and who is the _real professional_ in making 2D animations of classical music. But he doesn't make his own music (except for a few pieces where he has played himself.) www.youtube.com/@smalin/videos He is my greates influencer. Also, I have an influence on him, because he has taken over some of my ideas in his animations. I see him as _the_ professional! because he has written his own software from scratch, including all the shaders, in C++, using a Macintosh. He makes such animatioons for many decades now. What I really want to say, is that making satisfactory animations accompanying music _is extremey tough_ and is an area only a few people explore. Stephen Malinowski is the most prolific in this field. And I hope to reach his level at some future date, but with my 3D approach. And another thing. _Don't rely on AI!_ AI _only helps_ if _may people_ have done that what you want to do, and A_ has been fed with their results. But _midi music animations_ is _a new field!_ There are not many people who know how to do these. And _none_ of them have made their programs available for AI programming. The only help _I_ get from AI is by learning the syntax of programming languages if I want to know somthing. What is, for example, _immutable_ versus _mutable_ in Python. Or what is an _interface_ in C#. But if you try to let AI make something, by asking it the solution of a particular midi problem, or part of it to make some animations, _you will get into a lot of trouble!_ I tried it, and I got _very frustrated_ by the results. Every time I asked it to do something, it forgot what I did before, and just messed up my programming code. And it even _cheated_ in one prompt! So, if you _really_ want to learn making music animations, and your demands are not as high as mine, _learn Blender, Animation Nodes, the midi nodes of Animation Nodes, and learn Python th program the script nodes._ I know, it is a lot of work. But it is, as far as I know, _the shortest rounte to get midi music anomations_ without cheating, as I did in the above animation! You could also make simpler animations, by making use of Synthesia, and then combining it with Adobe Premiere Pro and Adobe After Effects. But you don't have full control then over the end result. And you can make animations like those of Andy Fillebrown. But that doesn't give you _almost no control!_
@@konradswart4069 Konrad, what an awesomely detailed (yet overwhelming) response!! I’m going to try some of the “easier” options you mention. One point of importance is that I do not program the notes in with MIDI. I play everything free-handed to a click track 😊 I will most likely pay a professional to make my videos going forward, but you’ve given me a lot to think about. Many thanks, my friend!
This a a beautifully haunting way to hear Bach! Great patch choices.
Thanks!
I love this, especially with all the different sounds!
Thanks!
Love the music and the visuals !
terrific visuals and realization
Love this!! How did you make the visuals? I struggle to find visuals to accompany my music. I want to figure out how to use AI to do this!
Well, _this_ visual is really easy! I used a trick!
What I did was taking a screen saver, which 'listens' to computer key strokes at the keyboard. I can just listen to the music, and know when something changes, and just hit a key so that the screen of the screen saver changes.
But this is _cheating!_
My other music animations visuals on my channels are _a lot harder!_ I use all kinds of things. For example Blender with the Animation Nodes plugin, which has some nodes to deal with midi. And then I use computer programming skills to put Python code in the script node.
To let the notes light up when they are in sync, I have learned to use the node based Shader language of Blender.
I also use the Unity game engine, and then C# programming, using a C# midi library to make the data which I use to manipulate game objects.
And in Unity I am studying the script based shader language of Unity, called HLSL - High Level Shader Language.
I see the integration of music with animations as a separate art form, and devote a lot of time just to learn it.
I began by writing my own software from scratch, using Delphi. But that led to too unstable programs. I have succeeded somewhat, though. It taught me the basics.
And I have even experimented with Wolfram Mathematica. There is one animation on my Konrad Swart channel made with Mathematica and the Wolfram language.
At present I am even considering using Unreal Engine and Houdini, because one can get the most spectacular results with Unreal Engine and with Houdini. But it is tough, especially with Houdini. There exist just two succesful animations on RUclips with Houdini and Midi made by Ramon Levy, with whom I have been inc contact with.
ruclips.net/video/pJsRCd5ivyc/видео.html
and
ruclips.net/video/QHrEWK7eAak/видео.html
Notice his in and out zooming effects in the animation.\
And, of course, there is Stephen Malinowski, with whom I have had a lot of contact, and who is the _real professional_ in making 2D animations of classical music. But he doesn't make his own music (except for a few pieces where he has played himself.)
www.youtube.com/@smalin/videos
He is my greates influencer. Also, I have an influence on him, because he has taken over some of my ideas in his animations.
I see him as _the_ professional! because he has written his own software from scratch, including all the shaders, in C++, using a Macintosh. He makes such animatioons for many decades now.
What I really want to say, is that making satisfactory animations accompanying music _is extremey tough_ and is an area only a few people explore. Stephen Malinowski is the most prolific in this field. And I hope to reach his level at some future date, but with my 3D approach.
And another thing. _Don't rely on AI!_
AI _only helps_ if _may people_ have done that what you want to do, and A_ has been fed with their results.
But _midi music animations_ is _a new field!_ There are not many people who know how to do these. And _none_ of them have made their programs available for AI programming.
The only help _I_ get from AI is by learning the syntax of programming languages if I want to know somthing. What is, for example, _immutable_ versus _mutable_ in Python. Or what is an _interface_ in C#. But if you try to let AI make something, by asking it the solution of a particular midi problem, or part of it to make some animations, _you will get into a lot of trouble!_
I tried it, and I got _very frustrated_ by the results. Every time I asked it to do something, it forgot what I did before, and just messed up my programming code. And it even _cheated_ in one prompt!
So, if you _really_ want to learn making music animations, and your demands are not as high as mine, _learn Blender, Animation Nodes, the midi nodes of Animation Nodes, and learn Python th program the script nodes._
I know, it is a lot of work. But it is, as far as I know, _the shortest rounte to get midi music anomations_ without cheating, as I did in the above animation!
You could also make simpler animations, by making use of Synthesia, and then combining it with Adobe Premiere Pro and Adobe After Effects. But you don't have full control then over the end result. And you can make animations like those of Andy Fillebrown. But that doesn't give you _almost no control!_
@@konradswart4069
Konrad, what an awesomely detailed (yet overwhelming) response!!
I’m going to try some of the “easier” options you mention. One point of importance is that I do not program the notes in with MIDI. I play everything free-handed to a click track 😊
I will most likely pay a professional to make my videos going forward, but you’ve given me a lot to think about. Many thanks, my friend!