This appears to be a unique type of phase transition, distinct from standard grokking, but sharing some of its characteristics? A new kind of grokking specific to multi-geometry models, where spatial curvature acts as an implicit training signal? I think I really need to spend more time absorbing your ideas and brushing up on my hyperbolic geometry math. lol So just curvature differences, poincare disk model, and maybe just how trees and graphs fit with euculidean space? Or deeper still?
🐐
This appears to be a unique type of phase transition, distinct from standard grokking, but sharing some of its characteristics? A new kind of grokking specific to multi-geometry models, where spatial curvature acts as an implicit training signal? I think I really need to spend more time absorbing your ideas and brushing up on my hyperbolic geometry math. lol So just curvature differences, poincare disk model, and maybe just how trees and graphs fit with euculidean space? Or deeper still?
What if you used your RL reasoning strategy to shape and optimize the layers? Or use your fibinacci strategy instead of backprop?
I'll play around with this at some point in the future, I like it!
thats hilarious if they sent this to you. they be watchin lol