Live data from Hacker News

Mistral Large

mistral.ai

271–280 of 282 posts

Re: Mistral Large

#271
post #24
post #7

Earlier quoted context omitted.

I've been saying this for months but every time I get down voted for saying it. It annoys me that people fall for these marketing tactics and keep promoting and advertising the product for free. It's not just the models though- even tools that started off as open source ended up aiming for VC and stopped being totally open. Examples: LlamaIndex, Langchain, and most likely Ollama.

Haven't been following closely, what's the issue with langchain?

why the hell the downvotes for asking a genuine question?

Re: Mistral Large

#272
post #221

Earlier quoted context omitted.

There really isn't though? I've not seen anything close to Mistral yet in the 7b space - and it's even going downhill, Gemma is a total joke surprisingly, almost non functional.

Not having (yet) produced as good a product is not evidence of a monopoly!

And raising prices to match that of the highest priced competitor (gpt-4-turbo), also owned by Microsoft. Is price fixing not evidence of monopolistic behaviour?

Re: Mistral Large

#273

Interesting, I didn’t know they had le chat. I’ve been wanting a chatgpt competitor with mistral. Also love the fact they put “le” in front of their products

Reminds me of the rage comics of old.

that was my impression, given that the main word is not in french also. that might've come across very snub.

Re: Mistral Large

#274

Earlier quoted context omitted.

Which - importantly - is better than Mistral at 81.2% ... Gemini Ultra scored 90% which is better than GPT-4. This reads like a paid-for press release from Microsoft to pretend like they're almighty and Google is incompetent.

Didn't Gemini 1.0 Ultra turn out to be worse than GPT 4 Turbo in practice? Synthetic benchmarks aren't a perfect representation of anything.

I think they're close enough that it depends on your use case. IME, which is mostly generating Python and shell code, Gemini Advanced is faster, less lazy and generates overall better solutions than GPT-4. It also seems to be more up-to-date with libraries and stuff. It can also directly go to URLs (e.g. summarise a paper), which GPT-4 refuses to do.

Re: Mistral Large

#275

Earlier quoted context omitted.

Ultra 1.0 is theoretically available via API, but it's only available to allowlisted customers, which seems to be a very small number right now. It's not generally available.

Ultra 1.0 is the model behind Gemini Advanced, which is generally available.

Not via an API, which is needed to perform proper tests.

Re: Mistral Large

#276

Earlier quoted context omitted.

It didn't take long for perplexity, anyscale, together.ai, groq, deepinfra, or lepton to all host mistral's 8x7B model, both faster and cheaper then Mistral's own api. https://artificialanalysis.ai/models/mixtral-8x7b-instruct/h...

Hosting a 7B model is completely different than hosting a 150B+ model. I thought this would be obvious, but I should have been explicit.

It's not really. And 8x7B is not a 7B model, it's a MoE that's closer to 60B that has to be kept in memory, and uses 2 experts per token so it runs at 15B speeds.

All of the current frameworks support MoE and sharding among GPUs so I don't see what the issue is.

Re: Mistral Large

#277
post #193

Earlier quoted context omitted.

is it? I always thought that it was just the corrected spelling (a lot of composite words have been merged together in a spelling reform in 1990), and that the English word was actually borrowed from French.

Ha, apparently I’m the uneducated one. I’d assumed it was an anglicisme that happened to work nicely, but it came to English from Middle French. However, the modern tech-related usage certainly first showed up in English, and then was upstreamed to French I assume? That’s kind of amusing… I’ll leave this as a testament to my hubris as a non-native French speaker.

It (the word plateform) never died out in French.

Wiktionary's "etymology" section is great for 98% of words: https://en.wiktionary.org/wiki/platform#Etymology

In general, Modern English has many words from French or other Romance (Latin-origin) languages due to French being an important vector through which Latin-origin words entered English, evolving it in competition with Germanic-origin words.

Re: Mistral Large

#278

Performance not so great. prompt: write python code to find the intersection of two axis aligned rectangles Response: Here is some Python code that finds the intersection of two axis-aligned rectangles: def find_intersection(rect1, rect2): # rect1 and rect2 are dictionaries representing the rectangles, # with keys "x", "y", "width", and "height" # find the x-coordinate of the left side of the intersection x = max(rec…

> Obviously the bottom right corner of a rectangle cannot be 10,10 if the top left corner is 0,0

What you said is only true for a mathematician. In mathematical conventions, Y axis is directed upwards.

For programmers however, Y axis is usually directed downwards. In programming, the top left corner of a window has coordinates [ 0, 0 ], and a rectangle with top left [ 0, 0 ] and bottom right [ 10, 10 ] is a perfectly valid one.

Re: Mistral Large

#279
post #221

Earlier quoted context omitted.

Not having (yet) produced as good a product is not evidence of a monopoly!

And raising prices to match that of the highest priced competitor (gpt-4-turbo), also owned by Microsoft. Is price fixing not evidence of monopolistic behaviour?

Cartel behaviour. But ok, that is more compelling for the general point.

Re: Mistral Large

#280
post #66

Changelog is also updated: [1] Feb. 26, 2024 API endpoints: We renamed 3 API endpoints and added 2 model endpoints. open-mistral-7b (aka mistral-tiny-2312): renamed from mistral-tiny. The endpoint mistral-tiny will be deprecated in three months. open-mixtral-8x7B (aka mistral-small-2312): renamed from mistral-small. The endpoint mistral-small will be deprecated in three months. mistral-small-latest (aka mistral-small…

I know marketing folks prefer poetic names, but I wish we had consistent naming like v1.0, 2.0 etc, instead of renaming your product line every year like Apple and Xbox does. Confusing and opaque.

What's wrong with the Google names?

It seems pretty clear, they started with Bert, to borrow from AllenAIs Elmo, then Big Bird, and made some friends with Palms along the way. So of course Bard would make sense and is a natural next name.

Then it gets even simpler really, by switching Bard to Gemini it really streamlined the naming. Gemini nano < Gemini Pro 1.0 == Gemini Advanced Then after that Gemini 1.5 Pro, but that's still worse than Gemini Ultra 1.0 which is still better than Advanced. They have made it a bit easier now though with Gemma, which is worse than all of them, but still a little bigger than what you want to run on a phone, which is a great reason to introduce Germa X. I'm mostly excited for Germa X2 version deXbox though. That's when we finally get a decent model for desktop boxes.

Post reply on HN