Viewing profile — btwillard

I hope that person is paying you for this positive PR spin!

As others here are saying, the rules are the same for everyone in that anyone can effectively buy their freedom (even if only gradually over time). The practical difference is that…

Our project, Outlines, now offers guided/constrained generation (e.g. according to a JSON schema) via the VLLM library. My colleague, Rémi, created some patches that allow one to p…

Obviously it depends on exactly what those opinions will end up being. It's hard to dispel the idea that every other big company isn't trying to find a way to do exactly the same t…

OpenAI function calling provides a means of producing valid JSON from a function signature, or a simplified version of a JSON schema definition; however, it has two big downsides: …

In my experience, that's always been the standard among Vim--and even some Emacs--users.

We've considered it, but I haven't started any work on it. Feel free to create an issue to track the status, if only to find out who else might be interested and/or working on it.

We provide this in https://github.com/outlines-dev/outlines .

Our project Outlines provides JSON output in a near optimal way that also works for all types of pre-trained transformer-based LLMs: https://github.com/outlines-dev/outlines Our ap…

In case anyone is wondering, this is essentially a few complaints about the basic transpilation/source-to-source approach taken by Cython and then some promotion for Rust. It unfor…

We also had an implementation of grammar-driven guidance around the same time: https://github.com/normal-computing/outlines/pull/131 . I imagine many others did as well, given all …

FYI: We've had grammar constraints available in Outlines for a while, but not using the FSM and indexing approach that makes the regex case so fast. My open PR only adds that.

Ha, yeah, in a distant, but really fun, past!

The underlying approach can improve the performance of anything that requires the set of non-zero probability tokens at each step, and anything that needs to continue matching/pars…

Yeah, and our addition to all that is to almost completely remove the cost of determining the next valid tokens on each step.

With our indexing approach, it only costs a dictionary lookup to get the next valid tokens during each sampling step, so very little latency.

> It means I have exceptionally high confidence that this will be the biggest thing to hit the economy, society and markets in the last hundred years for good and ill. How does hav…

We're working on some of the DSL-related parts of this in https://github.com/aesara-devs

It sounds like you're saying you want to hire people who weren't laid off? If so, what's the reasoning behind this?

Eh, Steve!?

Not a complete replacement, but very cool and related: https://github.com/webyrd/Barliman

> Arxiv's submission policy says: "Submissions to arXiv should be topical and refereeable scientific contributions that follow accepted standards of scholarly communication." ( htt…

Do you think he's trying to poison the minds of young mathematicians? At the very least, you're raising ArXiV and YouTube to a standard they openly do not meet. Also, did you raise…