I am using the UMAP for Dimensionality Reduction. It's implementation really bods well with my data. I have a question regarding the feature importance. Suppose, after the dimensionality reduction, the UMAP separates out the labels clearly and creates the 3 subgroups containing all labels. Can I somehow get the list of features corresponding to each group? Which features were more relevant to which group?
One option that I have seen done is to build a classifier based on the clusters and then use SHAP or LIME to get interpretations of what separates the clusters.
Thanks @@lelandmcinnes9501 , it is really helpful. Now I am looking for features contribution to each classes ? Does the earlier question of mine make any sense? With tuning the different hyperparamter , I will get different groups...Does these 2 dimensional cluster have any meaning of original features?
THE ULTIMATE, THE CLEAR, AND THE TRUE MATHEMATICAL UNIFICATION REGARDING PHYSICS/PHYSICAL EXPERIENCE IS PROVEN: Time DILATION proves that electromagnetism/ENERGY IS GRAVITY, AS E=mc2 is DIRECTLY and fundamentally derived from F=ma. Indeed, gravity/acceleration involves BALANCED inertia/INERTIAL RESISTANCE; AS ELECTROMAGNETISM/energy is gravity. Therefore, the rotation of WHAT IS THE MOON matches it's revolution. Moreover, objects fall at the SAME RATE (neglecting air resistance, of course); AS ELECTROMAGNETISM/ENERGY IS GRAVITY. (Gravity IS ELECTROMAGNETISM/energy. "Mass"/ENERGY IS GRAVITY. ELECTROMAGNETISM/energy is gravity.) E=mc2 IS F=ma. The stars AND PLANETS are POINTS in the night sky. (Very importantly, outer "space" involves full inertia; AND it is fully invisible AND black.) INSTANTANEITY is thus FUNDAMENTAL to what is the FULL and proper understanding of physics/physical experience. This NECESSARILY represents, INVOLVES, AND DESCRIBES what is possible/potential AND actual IN BALANCE, AS ELECTROMAGNETISM/ENERGY IS GRAVITY. SO, time is NECESSARILY possible/potential AND actual IN BALANCE; AS ELECTROMAGNETISM/ENERGY IS GRAVITY. BALANCE and completeness go hand in hand. Thoughts are invisible. THINK. NOW, the INTEGRATED EXTENSIVENESS of THOUGHT (AND description) is improved in the truly superior mind. INDEED, the ability of THOUGHT to describe OR reconfigure sensory experience is ULTIMATELY dependent upon the extent to which THOUGHT IS SIMILAR TO sensory experience. I have explained the fourth spatial dimension, as E=mc2 IS F=ma; as this then also explains the significance of c4. Gravity IS ELECTROMAGNETISM/ENERGY. It is proven. Again, BALANCE and completeness go hand in hand. It ALL CLEARLY makes perfect sense. Great !!! E=mc2 IS F=ma. Very carefully consider what is the Moon. I have explained perpetual motion. The planets are not falling in what is "curved" "SPACE" in relation to what is the Sun. SO, a given PLANET sweeps out equal areas in equal times; AS E=mc2 IS F=ma. Consider the man who is standing on what is the Earth/ground. Touch AND feeling BLEND, AS ELECTROMAGNETISM/ENERGY IS GRAVITY. OVERLAY WHAT IS THE EYE in BALANCED RELATION to/with what is the Earth. E=mc2 IS F=ma. LOOK at what is the translucent, semi-spherical, AND BLUE sky. The Earth is ALSO blue ! Great. It is ALL CLEARLY proven. ELECTROMAGNETISM/energy is gravity. Gravity IS ELECTROMAGNETISM/ENERGY. Gravity/acceleration involves BALANCED inertia/INERTIAL RESISTANCE, AS E=mc2 IS F=ma; AS ELECTROMAGNETISM/ENERGY IS GRAVITY. Again, the stars AND PLANETS are POINTS in the night sky. Great !!! BALANCE and completeness go hand in hand. THINK !!! "Mass"/energy is gravity. ELECTROMAGNETISM/energy is gravity. The tides NECESSARILY constitute a BALANCED electromagnetic/gravitational manifestation, form, or effect. In fact, stellar clustering proves that electromagnetism/ENERGY IS GRAVITY. By Frank DiMeglio
Greatest ML innovation of the last decade.
Thanks for the nice and clean explanation for UMAP!
Nice explanation of connection between topological notions and algorithm implementation.
Wow, fantastic talk!! Trying out several ideas from the talk immediately.
Thanks for the Python implementation!
I am using the UMAP for Dimensionality Reduction. It's implementation really bods well with my data. I have a question regarding the feature importance. Suppose, after the dimensionality reduction, the UMAP separates out the labels clearly and creates the 3 subgroups containing all labels. Can I somehow get the list of features corresponding to each group? Which features were more relevant to
which group?
One option that I have seen done is to build a classifier based on the clusters and then use SHAP or LIME to get interpretations of what separates the clusters.
Thanks @@lelandmcinnes9501 , it is really helpful. Now I am looking for features contribution to each classes ? Does the earlier question of mine make any sense? With tuning the different hyperparamter , I will get different groups...Does these 2 dimensional cluster have any meaning of original features?
This is too good to be true!
Whats new about UMAP as compared to other TDA methods? The approach is just like Gunnar Carlson's mapper
The Singular simplices also permitted, but the homotopy quotient is required there.
Very illustrative presentation. Thanks
I will be trying that shortly! Fantastic ideas !
Do we know why it is the case, that the local connectivity assumption solves the curse of dimensionality?
Does anyone have something they'd like to share on this question?
Yup. Using this one tomorrow.
Amazingly Explained
Cool talk, well delivered.
wonderful and informative presentation!
Does anyone have a reference for the triplet networks he talks about?
Amazing talk
19:10 t-sne vs UMAP
Does anyone know which kind of normalized distance is used in 11:29?
Loved it so much, thanks!
Amazing video!
Loved the talk! Thank you!
Amazing，Genius！！
How deal with the obstruction?
permission to learn sir. thank you
You are a great golfer.
great success, my congrats
Amazing, thanks!
Why does he say the "distributions look nice" at 12:10 ? They look pretty close/overlapping and indistinguishable to me
That's the point
very clear, thank you!
Perfect Talk!!!
incredible !
very very very nice thank you so much
Supercool, thank you :D
The sinosuidal type wave only comes if you've 2D data.. & I think when you started, you said that it's a high dimensional data?
Brilliant!!!
amazing
Brilliant
Good talk.
Wow!
fantastic
Comecei sem entender nada, terminei sem entender nada e mais um pouco
Why are we taking 20 nearest neighbours? ~ 12:00
Never using tSNE again 😎
THE ULTIMATE, THE CLEAR, AND THE TRUE MATHEMATICAL UNIFICATION REGARDING PHYSICS/PHYSICAL EXPERIENCE IS PROVEN:
Time DILATION proves that electromagnetism/ENERGY IS GRAVITY, AS E=mc2 is DIRECTLY and fundamentally derived from F=ma. Indeed, gravity/acceleration involves BALANCED inertia/INERTIAL RESISTANCE; AS ELECTROMAGNETISM/energy is gravity. Therefore, the rotation of WHAT IS THE MOON matches it's revolution. Moreover, objects fall at the SAME RATE (neglecting air resistance, of course); AS ELECTROMAGNETISM/ENERGY IS GRAVITY. (Gravity IS ELECTROMAGNETISM/energy. "Mass"/ENERGY IS GRAVITY. ELECTROMAGNETISM/energy is gravity.) E=mc2 IS F=ma. The stars AND PLANETS are POINTS in the night sky. (Very importantly, outer "space" involves full inertia; AND it is fully invisible AND black.) INSTANTANEITY is thus FUNDAMENTAL to what is the FULL and proper understanding of physics/physical experience. This NECESSARILY represents, INVOLVES, AND DESCRIBES what is possible/potential AND actual IN BALANCE, AS ELECTROMAGNETISM/ENERGY IS GRAVITY. SO, time is NECESSARILY possible/potential AND actual IN BALANCE; AS ELECTROMAGNETISM/ENERGY IS GRAVITY. BALANCE and completeness go hand in hand. Thoughts are invisible. THINK. NOW, the INTEGRATED EXTENSIVENESS of THOUGHT (AND description) is improved in the truly superior mind. INDEED, the ability of THOUGHT to describe OR reconfigure sensory experience is ULTIMATELY dependent upon the extent to which THOUGHT IS SIMILAR TO sensory experience. I have explained the fourth spatial dimension, as E=mc2 IS F=ma; as this then also explains the significance of c4. Gravity IS ELECTROMAGNETISM/ENERGY. It is proven. Again, BALANCE and completeness go hand in hand. It ALL CLEARLY makes perfect sense. Great !!!
E=mc2 IS F=ma. Very carefully consider what is the Moon. I have explained perpetual motion. The planets are not falling in what is "curved" "SPACE" in relation to what is the Sun. SO, a given PLANET sweeps out equal areas in equal times; AS E=mc2 IS F=ma. Consider the man who is standing on what is the Earth/ground. Touch AND feeling BLEND, AS ELECTROMAGNETISM/ENERGY IS GRAVITY. OVERLAY WHAT IS THE EYE in BALANCED RELATION to/with what is the Earth. E=mc2 IS F=ma. LOOK at what is the translucent, semi-spherical, AND BLUE sky. The Earth is ALSO blue ! Great. It is ALL CLEARLY proven. ELECTROMAGNETISM/energy is gravity. Gravity IS ELECTROMAGNETISM/ENERGY. Gravity/acceleration involves BALANCED inertia/INERTIAL RESISTANCE, AS E=mc2 IS F=ma; AS ELECTROMAGNETISM/ENERGY IS GRAVITY. Again, the stars AND PLANETS are POINTS in the night sky. Great !!! BALANCE and completeness go hand in hand. THINK !!! "Mass"/energy is gravity. ELECTROMAGNETISM/energy is gravity. The tides NECESSARILY constitute a BALANCED electromagnetic/gravitational manifestation, form, or effect. In fact, stellar clustering proves that electromagnetism/ENERGY IS GRAVITY.
By Frank DiMeglio
fantastic
amazing