The Coming of Local LLMs

Post by 4dayworkweek4u » Fri, Apr 14, 2023, 12:25 AM UTC

gamegoblin wrote: post #58

rcme wrote: post #45

Earlier quoted context omitted.

LLMs as general purpose classifiers is a really big deal, especially because you can give them fuzzy instructions. I know people are worried about LLMs and spam, but I think LLMs may provide an opportunity to elevate online discourse by being more efficient at filtering out spam and low quality commentary.

I already have a custom browser plugin that calls out to GPT (gpt-3.5-turbo is cheap and good enough for this) to classify and filter out low-effort, overly negative, or intellectually dishonest HN comments. It significantly improves the experience on this site. Bonus points: I had never written a browser plugin, but GPT4 helped me do it in under half an hour.

Post by agumonkey » Sat, Apr 15, 2023, 6:11 PM UTC

skinner_ wrote: post #210

agumonkey wrote: post #111

Were transformers used in other contexts ? biochemistry ? geometry .. whatever.

Alphafold uses something they call Evoformer, it is an attention mechanism. Our group has tried, and so far failed to utilize transformers for a very very specific search problem in geometry ( https://bit.ly/unit-distances ).