Extracting concepts from GPT-4
openai.com
Extracting concepts from GPT-4
1–10 of 155 posts
Re: Extracting concepts from GPT-4
#2This is super cool, it feels like going in the direction of the "deep"/high level type of semantic searching I've been waiting for. I like their examples of basically filtering documents for the "concept" of price increases, or even something as high level as a rhetorical question
I wonder how this compares to training/fine tuning a model on examples of rhetorical questions and asking it to find it in a given document. This is maybe faster/more accurate? Since it involves just looking at neural network activation, vs running it with input and having it generate an answer...?
Re: Extracting concepts from GPT-4
#3[deleted]
Re: Extracting concepts from GPT-4
#4The worrying part is that first concept in the doc they show/found is "human imperfection". Hope this is just coincidence..
Re: Extracting concepts from GPT-4
#5The worrying part is that first concept in the doc they show/found is "human imperfection". Hope this is just coincidence..
I think its safety implications
Re: Extracting concepts from GPT-4
#6The worrying part is that first concept in the doc they show/found is "human imperfection". Hope this is just coincidence..
Spooky!
Re: Extracting concepts from GPT-4
#7[deleted]
[deleted]
Re: Extracting concepts from GPT-4
#8[deleted]
Re: Extracting concepts from GPT-4
#9The worrying part is that first concept in the doc they show/found is "human imperfection". Hope this is just coincidence..
[deleted]
Re: Extracting concepts from GPT-4
#10Interesting, reminds me of similar work Anthropic did on Claude 3 Sonnet [0].
[0] https://transformer-circuits.pub/2024/scaling-monosemanticit...