No "Zero-Shot" Without Exponential Data • Hacker News Board

Re: No "Zero-Shot" Without Exponential Data

#121

Post by a_wild_dandan » Fri, May 10, 2024, 10:36 PM UTC

z7 wrote: post #106

a_wild_dandan wrote: post #74

Better title: Image classification models suck at identifying nouns that they've rarely seen. Crucial context: - They're only looking at image models -- not LLMs, etc - Their models are tiny - A "concept" here just means "a noun." The authors index images via these nouns. - They didn't control for difficulty in visual representation/recognition of these exceptional infrequent, long-tail "concepts." If I didn't know a…

Odd how this went from top voted comment to lowest comment. What's the disagreement?

I show +23 points. Are popular comments down ranked to encourage diversity? Oh well, I'm proud of the brief success in challenging misinformation here!

Re: No "Zero-Shot" Without Exponential Data

#122

Post by yladiz » Sat, May 11, 2024, 10:08 AM UTC

pas wrote: post #119

crote wrote: post #55

Earlier quoted context omitted.

> Progress is still tracking the steep part of the S-curve, and there's no indication that they're near the top yet. If I understand it correctly, that seems to be exactly what this paper is suggesting. Scoring high on the bar exam is pretty trivial for AI - the data needed for that is fairly generic and widely available on the internet. It requires you to demonstrate a relatively basic understanding of the concepts…

what is novel? what if you couple a random text generator with a picture generator, isn't each new picture novel? if we could send all artists to work in the healthcare mines we might discover new treatment for various ailments. is that not novel? is that too indirect? increasing "economic surplus with externalities factored in" is good for society even if it's not novel. arguably philosophers come up with novel stuf…

> if we could send all artists to work in the healthcare mines we might discover new treatment for various ailments. is that not novel? is that too indirect?

You do realize that artists are artists because they want to be, and even if AI can create art, artists will still be artists, right? They won't just be like, "Oh, AI is good at generating art now? Whelp time to go become a doctor."

Re: No "Zero-Shot" Without Exponential Data

#123

Post by chefandy » Mon, May 20, 2024, 4:26 PM UTC

yladiz wrote: post #122

pas wrote: post #119

Earlier quoted context omitted.

what is novel? what if you couple a random text generator with a picture generator, isn't each new picture novel? if we could send all artists to work in the healthcare mines we might discover new treatment for various ailments. is that not novel? is that too indirect? increasing "economic surplus with externalities factored in" is good for society even if it's not novel. arguably philosophers come up with novel stuf…

> if we could send all artists to work in the healthcare mines we might discover new treatment for various ailments. is that not novel? is that too indirect? You do realize that artists are artists because they want to be, and even if AI can create art, artists will still be artists, right? They won't just be like, "Oh, AI is good at generating art now? Whelp time to go become a doctor."

Wait, you're saying people's brains aren't fungible compute cycles? Casually discussing people's lives as top-down resource allocation problems is one of the things I hate most about how "tech optimists" discuss this.