Let me clear a huge misunderstanding
twitter.com
Let me clear a huge misunderstanding
1–10 of 109 posts
Re: Let me clear a huge misunderstanding
#2This is important, even though the Twitter part is useless. Here's the paper, "Revisiting Feature Prediction for Learning Visual Representations from Video"[1]
A big problem with machine learning so far has been the lack of some underlying, more abstract model of the subject matter. I don't understand much of this, but apparently something called "representation", a purely mathematical concept, is able to help with this.[2] This turns some kinds of abstract problems into linear algebra problems, which means matrix operations, the things GPUs do so well, help.
Code is available, from links in [2].
Would someone comment on this, please. Is this the beginning of a huge breakthrough? One where, instead of working in text token space or image pixel space, it's possible to work in an automatically generated more abstract space?
[1] https://scontent-sjc3-1.xx.fbcdn.net/v/t39.2365-6/427986745_...
Re: Let me clear a huge misunderstanding
#3This is important, even though the Twitter part is useless. Here's the paper, "Revisiting Feature Prediction for Learning Visual Representations from Video"[1] A big problem with machine learning so far has been the lack of some underlying, more abstract model of the subject matter. I don't understand much of this, but apparently something called "representation", a purely mathematical concept, is able to help with t…
The "representation" in "representation theory" that the wikipedia article refers to is a term of art, referring to a class of one-to-one maps between groups (sets endowed with a binary operation with specific properties) and square matrices, in such a way that matrix multiplication preserves the properties of this binary operation between the original group elements being mapped to matrices. There is no mention of this sort of algebraic operation whatsoever in the paper you have linked, which, as far as I can tell, uses the word "representation" only in a nontechnical descriptive sense. I believe you might be misunderstanding the nature of this breakthrough.
Re: Let me clear a huge misunderstanding
#4I can’t tell if his comments came before or after the latest OpenAI product announcement shoeing off what looks like generative video.
Re: Let me clear a huge misunderstanding
#5I can’t tell if his comments came before or after the latest OpenAI product announcement shoeing off what looks like generative video.
World Government Summit was from 12-14 February 2024 in Dubai, so either a day before or at the same time, depending on timezones...
Re: Let me clear a huge misunderstanding
#6I can’t tell if his comments came before or after the latest OpenAI product announcement shoeing off what looks like generative video.
The original video: before, this tweet: after.
Re: Let me clear a huge misunderstanding
#7Just seeing an error message, and cannot sign in as well. Am I the only one?
Re: Let me clear a huge misunderstanding
#8[flagged]
Re: Let me clear a huge misunderstanding
#9More like: "Let me clear a huge misunderstanding here by using poorly-defined terms and cramming niche complex ideas elaborated elsewhere into this tweet."
Someone correct me, but it seems like he's saying:
1- generative models don't understand the real world
2- generative models that work off of just pixels are more expensive and less useful than a model that represents the contents of the frame with abstract representations, particularly when related to higher-level actions like applying logic to a scene and not just interpolating between frames.
3- V-JEPA is such a model, and it performs particuarly well against generative when combining those representations as inputs with a much more easily trained and small model trained on specific tasks.
Re: Let me clear a huge misunderstanding
#10[deleted]