Viewing profile — breadislove

we have not converged at all, if you look at how different the chinese models in terms of architecture you can guess that the labs are experimenting a lot as well. we are seeing al…

On what do you guys test the model. Its very dubious that there is no common retrieval benchmark such as browsecomp plus or similar tested. And what metric do you report?

adam, i'd like to get in touch and would love to run the benachmark with mixedbread as a search backend. we are doing this right now with a lot of compliance companies. would be ve…

yes, your are right. what heading would you have taken here?

everything worth writing, you should write yourself

ah whoops, I'll fix it. ty!

The ndcg loss is minimal 90.26 -> 89.65. This means it maintains most of the quality.

to which email did you send it? can u send it to support please?

this is the reason why we report ndcg and not recall. ndcg respects fine grained details so you get the an overview of how much details you are trading off since it would hurt the …

yes exactly.

slop complaining about other slop

very bad take. with most modern multomodal models you get way better performance then going to text first

this might be interesting: https://www.theinformation.com/articles/chatgpt-doctors-star... > $150M RR on just ads, +3x from August. On source: https://x.com/ArfurRock/status/199961…

a good system (like openevidence) indexes every paper released and semantic search can incredible helpful since the the search api of all those providers are extremely limited in t…

you should check mixedbread out. we support indexing multimodal data and making data ready for ai. we are adding video and audio support by the end of the year. might be interestin…

or deberta but nevertheless super interesting!

For everyone wondering how good this and other benchmarks are: - the OmniAI benchmark is bad - Instead check OmniDocBench[1] out - Mistral OCR is far far behind most Open Source OC…