Viewing profile — throwaway1851

I’ve had opiates for wisdom tooth extraction and a couple of relatively minor but very painful injuries. I was very glad to have them. They made the experiences much more bearable.…

If you've reviewed the facts in this case, and that's what you took from it, then I seriously question your reading comprehension ability.

And, with that, we’re back to pre-LLM chatbot design: intent classification, entity extraction, business logic, return a result. Only the whole process rests on a more rickety foun…

Bard hasn’t been using Google’s best language models. I believe it just got an upgrade, however, and I’m now getting output that is significantly more coherent and useful than Chat…

That’s only going to get you so far. Sparsely represented subjects have have an actual reality you’re trying to model. So while yes, you can generate synthetic data to interpolate …

Especially weird since SFO is not in San Francisco.

OpenAI’s fear-mongering efforts have been really transparent. As an example, in the ABC News piece, one of their employees discusses asking GPT to help build a bomb. Your employees…

OpenAI explicitly disclaims ownership interest in the model outputs. A user who both generates outputs from OpenAI AND uses it to train a “foundational” model that competes with Op…

I think a review of the state of frontend tooling will show that efficiency with respect to developer hours is not a widely shared priority. I only say this with only 50% intention…

> It gets basic facts wrong and often times misunderstands what I'm trying to ask it. In haven’t tried Bard, but I’ve tried ChatGPT extensively and this sounds like a very good des…

Any news on whether they're pursuing downstream weights? That's a really interesting question for me - if you started at the LLaMA weights and arrived somewhere else by supplying a…

It’s not a lazy refrain, it’s a serious downside of the technology. It’s tiring and stressful to supervise the work product of an assistant that is extremely capable sometimes, but…

A concern I have about OpenAI is that, if you're using their APIs to develop an application, they can mine your data to compete with you, or even beat you to market. They can do th…

OpenAI disclaims ownership interest in the model output. If a subscriber (who has a contractual relationship with OpenAI) chooses to generate outputs that could be used to train a …

A language model takes in a sequence of tokens and outputs a probability (0-1) for each token in the vocabulary (the set of all tokens the model knows). Based on this probability d…

If we continue on this trajectory, I have a suspicion that the big players will increasingly cry “danger!” and, as Sam Altman has done already, call for government regulation of AI…

Hm. I haven’t tried the local installs yet. However, when the Alpaca web demo was live, I did find it to be comparable (though not quite as capable) to davinci-003. It answered arb…

I don’t put much stock in the claims about GPT4 “passing” professional exams. Many copies of previously administered exams are available, and the exams are formulaic in their const…

Well, consider the source. These are the same people who withheld measly little GPT2 because it was too dangerous for the grubby masses. They profess to have all of this concern fo…

$100. “For our initial run, fine-tuning a 7B LLaMA model took 3 hours on 8 80GB A100s, which costs less than $100 on most cloud compute providers. We note that training efficiency …

It’s a really thorny set of issues. I remember reading a discussion recently about gender bias in coreference resolution. (Coreference resolution is the task of linking words such …

I read it. I’d call it a press release.

I’ve been playing with the Alpaca demo, and I’m really impressed! The outputs are generally excellent, especially for a model of that size, fine tuned on a $100 (!!) compute budget…

Sorry. I wasn’t characterizing your comment; I was going off on a bit of a tangent.