That looks like a classic Actor/Critic setup, yet it's not mentioned even once in the paper. Am I missing some large difference here?
LLMs can see and hear without any training
11–20 of 74 posts
Re: LLMs can see and hear without any training
#12[dead]
Re: LLMs can see and hear without any training
#13[deleted]
Re: LLMs can see and hear without any training
#14This seems to be a system to generate better prompts to be fed into a base multimodal model. Interesting, but title is definitely clickbait.
Exactly! There is definitely something wrong with FAIR.
Re: LLMs can see and hear without any training
#15My photoresistor nightlight can "see" that it is dark and it "knows" to turn on the light - not only does it not have training, it does not have any code! And if you think that is amazing, my bi-metallic strip thermostat "feels" the temperature and then modifies the environment because it "knows" if it's hot to turn on the A/C, and if it's cold to turn on the heat - no training or code! All of this AI stuff is just u…
The nightlight and thermostat's response to stimulus is nowhere near analyzing a picture of a clock tower and responding with "Image of a city's tallest, historic landmark with a sepia filter." To me, recognizing the umbrella in the spoon is one of the most impressive items they list.
Re: LLMs can see and hear without any training
#16Exactly how little training is "without any"? I'm assuming that companies haven't been spending billions trying to train LLMs to better understand things when they can do it without any training.
Re: LLMs can see and hear without any training
#17Paper: https://arxiv.org/pdf/2501.18096
I don't understand how the title relates to the content of this article at all. They're even using CLIP which definitely has been trained.
Re: LLMs can see and hear without any training
#18[dead]
Re: LLMs can see and hear without any training
#19That looks like a classic Actor/Critic setup, yet it's not mentioned even once in the paper. Am I missing some large difference here?
Yes, apparently they've developed new names: Generator and Scorer. This feels a bit like "Tai's Model" https://news.ycombinator.com/item?id=17863514
Re: LLMs can see and hear without any training
#20Find me Jose Monkey will do that too :-)