Live data from Hacker News

Mistral Le Chat

mistral.ai

51–56 of 56 posts

Re: Mistral Le Chat

#52
post #32

Very excited for them. Tried it and works quite well. Very evident that each of the foundational model developers need to offer a free chat(till now) interface for RLHF/DPO to improve their models. It's costly for them to run servers, but even higher opportunity cost if they don't do this and offer a free service. Intuitively, I think GPT-4 was very good with various questions because they used the early data from Ch…

OpenAI also had years "flying under the radar" training on API requests

Don't think it adds a lot of value. One, the instruction-following models do not create high quality q&a pairs, chats do it by default. Two, at the time the usage was very low compared to ChatGPT. I am fairly confident, one month of people trying all sorts of things w ChatGPT gave them a lot more data - both in quantity and range - compared to API usage previously. Third, they always maintained they do not train on API inputs, and I think it's fair to assume that. They do not get feedback whether the output was any good, so it's always dicey to feed that directly to a model without those signals.

Re: Mistral Le Chat

#53

FYI This is a public beta with a wait list. I was not able to access directly.

Maybe it was for previous few hours after launch, I just did a normal signup and instant access to large, next and small model

Re: Mistral Le Chat

#55

FYI This is a public beta with a wait list. I was not able to access directly.

Does work for me, just registered with a Google Account. Perhaps they have troubles with the load and throttle the user inflow because of this. Or could be location-related, I joined from Europe.

Re: Mistral Le Chat

#56

Very excited for them. Tried it and works quite well. Very evident that each of the foundational model developers need to offer a free chat(till now) interface for RLHF/DPO to improve their models. It's costly for them to run servers, but even higher opportunity cost if they don't do this and offer a free service. Intuitively, I think GPT-4 was very good with various questions because they used the early data from Ch…

This can be (could be) a total hallucination. There may be some training data from OpenAI but outside it responding that way, except for me aforementioned point, where is the proof thus far?
Post reply on HN