I'm not sure how I feel about the Platonic Representation Hypothesis.
In some ways it seems like it should be profound, but part of me thinks it might just be saying 'There is an optimal way to perform dimensionality reduction and as things get bigger it is easier to appoximate'
It’s less profound sounding if instead of talking about “representations of the world” you talk about compressed representations of data or decision boundaries in a classifier over data.
In some ways it seems like it should be profound, but part of me thinks it might just be saying 'There is an optimal way to perform dimensionality reduction and as things get bigger it is easier to appoximate'