Great Talk! The idea that aligned and uniformity in representation space generalize across tasks & domains seems pretty powerful, especially when we do not know our downstream task a priori. Can we perhaps use these metrics to dynamically explore the multiview/augmentation space (ie. use the metrics to guide something like AutoAugment during the contrastive learning phase)?
awesome
Great Talk! The idea that aligned and uniformity in representation space generalize across tasks & domains seems pretty powerful, especially when we do not know our downstream task a priori. Can we perhaps use these metrics to dynamically explore the multiview/augmentation space (ie. use the metrics to guide something like AutoAugment during the contrastive learning phase)?