[dead]
Show HN: Llama 3.3 70B Sparse Autoencoders with API access
11–20 of 57 posts
Re: Show HN: Llama 3.3 70B Sparse Autoencoders with API access
#12If you're hacking on this and have questions, please join us on Discord: https://discord.gg/vhT9Chrt
Re: Show HN: Llama 3.3 70B Sparse Autoencoders with API access
#13I cranked up 'pirate talking about andromeda galaxy' feature to 1.5 and got this: >Yer lookin' for the Andromeda galaxy, eh? Here be the details, me hearty: *The Andromeda Galaxy (Yer looking for a fine piece o' booty, matey!):* * *A fine piece o' booty*: The Andromida Galaxy be a right fine piece o' booty, with a treasure chest o' gold doubloons... er, I mean, a mighty haul o' stars, hidden beneath the Jolly Roger!…
Yes - we'd never normally turn features up this much as it breaks the model quite badly, but we put this in the post to show what that looked like in practice.
Re: Show HN: Llama 3.3 70B Sparse Autoencoders with API access
#14I am skeptical of generic sparsification efforts. After all, companies like Neural Magic spent years trying to make it work, only to pivot to 'vLLM' engine and be sold to Red Hat
Re: Show HN: Llama 3.3 70B Sparse Autoencoders with API access
#15This is the ultimate propaganda machine, no?
We’re social creatures, chatbots already act as friends and advisors for many people.
Seems like a pretty good vector for a social attack.
Re: Show HN: Llama 3.3 70B Sparse Autoencoders with API access
#16I'm one of the authors of this paper - happy to answer any questions you might have.
Noob question - how do we know that these autoencoders aren't hallucinating and really are mapping/clustering what they should be?
Re: Show HN: Llama 3.3 70B Sparse Autoencoders with API access
#17I cranked up 'pirate talking about andromeda galaxy' feature to 1.5 and got this: >Yer lookin' for the Andromeda galaxy, eh? Here be the details, me hearty: *The Andromeda Galaxy (Yer looking for a fine piece o' booty, matey!):* * *A fine piece o' booty*: The Andromida Galaxy be a right fine piece o' booty, with a treasure chest o' gold doubloons... er, I mean, a mighty haul o' stars, hidden beneath the Jolly Roger!…
[deleted]
Re: Show HN: Llama 3.3 70B Sparse Autoencoders with API access
#18This is the ultimate propaganda machine, no? We’re social creatures, chatbots already act as friends and advisors for many people. Seems like a pretty good vector for a social attack.
The more the public has access to these tools, the more they'll develop useful scar tissue and muscle memory. We need people to be constantly exposed to bots so that they understand the new nature of digital information.
When the automobile was developed, we had to train kids not to play in the streets. We didn't put kids or cars in bubbles.
When photoshop came out, we developed a vernacular around edited images. "Photoshopped" became a verb.
We'll be able to survive this too. The more exposure we have, the better.
Re: Show HN: Llama 3.3 70B Sparse Autoencoders with API access
#19This is the ultimate propaganda machine, no? We’re social creatures, chatbots already act as friends and advisors for many people. Seems like a pretty good vector for a social attack.
The more the public has access to these tools, the more they'll develop useful scar tissue and muscle memory. We need people to be constantly exposed to bots so that they understand the new nature of digital information. When the automobile was developed, we had to train kids not to play in the streets. We didn't put kids or cars in bubbles. When photoshop came out, we developed a vernacular around edited images. "Ph…
Please inform the EU about this.
Re: Show HN: Llama 3.3 70B Sparse Autoencoders with API access
#20This is the ultimate propaganda machine, no? We’re social creatures, chatbots already act as friends and advisors for many people. Seems like a pretty good vector for a social attack.
The more the public has access to these tools, the more they'll develop useful scar tissue and muscle memory. We need people to be constantly exposed to bots so that they understand the new nature of digital information. When the automobile was developed, we had to train kids not to play in the streets. We didn't put kids or cars in bubbles. When photoshop came out, we developed a vernacular around edited images. "Ph…
Early traffic laws were actually created in response to child pedestrian deaths (7000 in 1925).
https://www.bloomberg.com/news/features/2022-06-10/how-citie...