Live data from Hacker News

DBRX: A new open LLM

databricks.com

131–140 of 360 posts

Re: DBRX: A new open LLM

#132

It's great how we went from "wait.. this model is too powerful to open source" to everyone trying to shove down their 1% improved model down the throats of developers

People are building and releasing models. There's active research in the space. I think that's great! The attitude I've seen in open models is "use this if it works for you" vs any attempt to coerce usage of a particular model.

To me that's what closed source companies (MSFT, Google) are doing as they try to force AI assistants into every corner of their product. (If LinkedIn tries one more time to push their crappy AI upgrade, I'm going to scream...)

Re: DBRX: A new open LLM

#133

Looking at the license restrictions: https://github.com/databricks/dbrx/blob/main/LICENSE "If, on the DBRX version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Databricks, which we may grant to you in our sole discretion, a…

The release notes on the databricks console definitely says open source. If you click the gift box you will see: Try DBRX, our state-of-the-art open source LLM!

Re: DBRX: A new open LLM

#134
post #89
post #35

The scale on that bar chart for "Programming (Human Eval)" is wild. Manager: "looks ok, but can you make our numbers pop? just make the LLaMa bar smaller"

I believe it's a reasonable range for the scores. If a model gets everything half wrong (worse than a coin flip), it's not a useful model at all. So every model below a certain threshold is trash, and no need to get granular about how trash it is. An alternative visualization that could be less triggering to an "all y-axes must have zero" guy would be to plot the (1-value), that is, % degraded from perfect score. You…

> less triggering to an "all y-axes must have zero" guy

Ever read 'How to Lie with Statistics'? This is an example of exaggerating a smaller difference to make it look more significant. Dismissing it as just being 'triggered' is a bad idea.

Re: DBRX: A new open LLM

#136

Earlier quoted context omitted.

OTOH having the chart start at zero would REALLY emphasize how saturated this field is, and how little this announcement matters.

The difference between 32% and 70% wouldn't be significant if the chart started at zero?

It would be very obvious indeed how small the difference between 73.7,73.0,71.4,and 69.8 actually is.

Re: DBRX: A new open LLM

#137
post #107

Just curious, what business benefit will Databricks get by spending potentially millions of dollars on an open LLM?

Their goal is to always drive enterprise business towards consumption. With AI they need to desperately steer the narrative away from API based services (OpenAI). By training LLMs, they build sales artifacts (stories, references, even accelerators with LLMs themselves) to paint the pictures needed to convince their enterprise customer market that Databricks is the platform for enterprise AI. Their blog details how th…

Do they use spark for the training?

Re: DBRX: A new open LLM

#140

Looking at the license restrictions: https://github.com/databricks/dbrx/blob/main/LICENSE "If, on the DBRX version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Databricks, which we may grant to you in our sole discretion, a…

[deleted]
Post reply on HN