Viewing profile — sandkoan

DeepMind.

See https://musiccontrolnet.github.io/web/

sudo !!

Ilya says this here: https://www.youtube.com/watch?v=AKMuA_TVz3A

For anyone else interested, the paper he's referring to is "The Reversal Curse": https://arxiv.org/abs/2309.12288 .

For anyone who's curious, the paper in question, entitled, "Lost in the Middle: How Language Models Use Long Contexts" ( https://arxiv.org/abs/2307.03172 )

This is part of what we're doing at Automorphic. Building shareable, stackable adapters that you can compose like lego bricks.

This is what we did at Trex ( https://github.com/automorphic-ai/trex ). The tricky part is doing it quickly and efficiently.

Also using a similar method: https://github.com/automorphic-ai/trex Playground: https://automorphic.ai/playground

Relevant: Built this which generalizes to arbitrary regex patterns / context free grammars with 100% adherence and is model-agnostic — https://news.ycombinator.com/item?id=36750083…

Yeah, then it seems we agree. I was just pointing out that it's not necessary to finetune OSS models to behave like OpenAI functions if you're able to do something similar to what …

Ahh, no, the value of this isn't as much the model as it is the infrastructure enabling structure enforcement.

https://news.ycombinator.com/item?id=36752991

You wouldn't actually want to, because you'd be losing generalizability, and it's a lot of unnecessary work. I think approach #1 outlined above is the better (more cost- and time-e…

Ahh, I've been meaning to try FLARE—was it a marked improvement over traditional RAG?

Thanks for the reminder—done!

This is model agnostic, actually—any model on HuggingFace is compatible. So if someone wanted to run this with their own model, they could.

Custom LLM—hence the self-hostability.

Costs add up surprisingly quickly. A quote-colon-space-quote combo alone is four tokens wasted. Now scale that up....

https://news.ycombinator.com/item?id=36753254 Does this help clarify?

The prompt is given to our model as a guiding aid (a suggestion), and the cfg is used to constrain the model to generate only tokens that abide by the schema (an enforcement). That…