Viewing profile — rjb7731

Isn't this similar to the Deepmind paper on long form factuality posted a few days ago? https://arxiv.org/abs/2403.18802 https://github.com/google-deepmind/long-form-factuality/tre…

I've previously noticed when playing with GPT-4 it can sometimes 'autocomplete' on different sections of the text its feeding back, sometimes what looks like 4 or more different se…

Its interesting this paper & the Orca LLM paper from Microsoft are using GPT3/4 model outputs to train 'powerful' models. Big question is will they allow your average joes/business…

Thanks Jeremy for putting this course out for everyone, looking forward to completing it.

Seems not too bad, you can tell its been trained on shorter responses. Example #1 Input: explain a neural network in simple terms Alpaca-Output: A neural network is a type of machi…

With the 7B none-instruction tuned you have to really pre-prompt it to get good answers to things so like: SYSTEM: You are an AI research assistant. You use a tone that is technica…

The inference on the gradio demo seems pretty slow, about 250 seconds for a request. Maybe I am too used to the 4-bit quant version now ha!

if you look in the dev tools you will see a request to a 'join' file when you click the agree button it adds you to a queue. You can watch where you are up to in the dev tools.

Even with patience, I can see nothing happening in the dev tools when i click agree? Edit: From looking when you click agree you can see a request to a 'join' file with a 101 statu…

interesting, looks like the web demo doesn't work at the moment though. The prompt.txt will be useful, looks very similar to the pre-prompts i have been feeding in before making an…

Looks like it might be no bueno on google colab for now, chatbot.py takes prompts via input() too rather then a command line argument.

I wish him the best, I find his streams incredibly useful and they motivate me to be better at solving problems and coding. Hopefully he still does work on AGI and makes tinygrad e…