Viewing profile — minxomat

Experimenting with and/or reading about ChatGPT and then interacting with Siri feels almost offensive now. All of the assistants still suck - get on it AmaGooPple!

Is this related in any way to the actual ChatLLama project that is developed here: https://github.com/nebuly-ai/nebullvm ?

The former. Makes sense for their business model.

> The GPU version is commercial software. Please contact... Shame.

Some numbers here: https://github.com/qwopqwop200/GPTQ-for-LLaMa#result

Follow up recommendation: for Spanish, “Madrigals Key” is language transfer in book form. It can in fact be used as a workbook for this course.

Sure. Sent a ping.

We're not far off: https://imgur.com/a/nJxxcUg

A plot point in an episode of Person of Interest, where AGI "Samaritan" funds a charity (free tablets for students, Samaritan access pre-installed) to take over education and recru…

I'm building this, for (mostly) non-scientific non-fiction works (books, articles, news, etc.). Launching soon, with about 7,500 books indexed. Generally, what I found useful to bu…

For me the hangup was always the hidden rule: host won’t open a door with a car. That is unstated and remains unstated even in modern discussions of the problem (see Pinker’s “Rati…

The whole point of the LLaMa paper is that large models are undertrained and oversized.

A laptop and a desktop (Mac Studio)

This has been fixed almost 2 days ago now. It’s literally mentioned at the top of the repo.

The full use case includes quantisation, which the repo points out uses a large amount of system RAM. Of course that’s not required if you skip that step.

You’re missing something. Both SHP ( https://huggingface.co/datasets/stanfordnlp/SHP ) and OpenAssistant datasets are referenced. And the TOS violation might be the case, the proje…

With 16 threads, about 140ms per token for 30B, 300ms per token for 65B I should also mention that 65B should be able to run on 64GB systems. Total system memory consumption on M1 …

No catch, just works. 30B works fine on an M1 Max with 64GB of RAM, had to go for the M1 Ultra at 128GB for 65B.

So if I'm reading this right, 65B at 4bit would consume around 20GB of VRAM and ~130GB of system RAM?

There are open datasets (see the chatllama harness project and its references). You can of course also cross train it using actual ChatGPT.

AdGuard

> not really competitive with ChatGPT That's impossible to judge. LLama is a foundational model. It has received neither instructional fine tuning (davinci-3) nor RLHF (ChatGPT). I…