Liquid Foundation Models: Our First Series of Generative AI Models • Hacker News Board

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#31

Post by bluelightning2k » Mon, Sep 30, 2024, 4:59 PM UTC

zozbot234 wrote: post #30

> How many r's in "strawberry"? Think step by step! What a nice question! Well, let's just count: 1. S 2. T 3. R! So, we have our answer: there are 3 R's in "strawberry". Totally checks out!

Let's break it down step by step:

The word is "strawberry". The first "r" is in the second position of the word. The second "r" is in the fourth position of the word. So, there are two "r's" in "strawberry".

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#32

Post by mrbonner » Mon, Sep 30, 2024, 5:01 PM UTC

Let me start counting how many minutes it would take for someone to post a comment blasting this model for reasoning capabilities. For me LLM, is as useful as it is a word calculator, borrowing from Simon Wilson, a frequent poster here and author of the LLM python package I use.

I use LLM everyday and it is increasingly something I can't function effectively without. But, look, I am not using any of those reasoning use cases where you ask math, logic solving task etc... Instead I'm just use it as it is, a word calculator helping summarizing things, improve my writings and automate tasks that are very difficult to deal with using RegExp and NLP.

I'm very bullish about this progress in LLM space but not about those reasoning, logic and AGI use cases.

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#33

Post by alach11 » Mon, Sep 30, 2024, 5:02 PM UTC

zozbot234 wrote: post #30

> How many r's in "strawberry"? Think step by step! What a nice question! Well, let's just count: 1. S 2. T 3. R! So, we have our answer: there are 3 R's in "strawberry". Totally checks out!

This is one of the least interesting questions to ask LLMs. I wish it wasn't so popular.

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#34

Post by moralestapia » Mon, Sep 30, 2024, 5:02 PM UTC

>Press F to doubt.

I just tried their best model, Liquid-40B, and it gives some good responses on some questions, but also terrible ones more often than you'd wish (GPT-2 level, try it and you'll see).

It's also quite easy to make it become stuck on a loop.

No idea how they scored so high in those benchmarks. Maybe they overfitted on MMLUPro? Lol.

Edit: I just read on some comments here and on the TFA that, apparently, they're not using transformers at all? If that's true, big if, I take my hat off, this is truly a remarkable achievement.

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#35

Post by moralestapia » Mon, Sep 30, 2024, 5:03 PM UTC

alach11 wrote: post #33

zozbot234 wrote: post #30

> How many r's in "strawberry"? Think step by step! What a nice question! Well, let's just count: 1. S 2. T 3. R! So, we have our answer: there are 3 R's in "strawberry". Totally checks out!

This is one of the least interesting questions to ask LLMs. I wish it wasn't so popular.

And yet ... all they have to do is answer it properly.

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#36

Post by Jackson__ » Mon, Sep 30, 2024, 5:05 PM UTC

API only model, yet trying to compete with only open models in their benchmark image.

Of course it'd be a complete embarrassment to see how hard it gets trounced by GPT4o and Claude 3.5, but that's par for the course if you don't want to release model weights, at least in my opinion.

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#37

Post by GaggiX » Mon, Sep 30, 2024, 5:05 PM UTC

mrbonner wrote: post #32

Let me start counting how many minutes it would take for someone to post a comment blasting this model for reasoning capabilities. For me LLM, is as useful as it is a word calculator, borrowing from Simon Wilson, a frequent poster here and author of the LLM python package I use. I use LLM everyday and it is increasingly something I can't function effectively without. But, look, I am not using any of those reasoning u…

People use these models for different reasons.

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#38

Post by coding123 » Mon, Sep 30, 2024, 5:06 PM UTC

zozbot234 wrote: post #30

> How many r's in "strawberry"? Think step by step! What a nice question! Well, let's just count: 1. S 2. T 3. R! So, we have our answer: there are 3 R's in "strawberry". Totally checks out!

Can it write a python function to count the letters?

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#39

Post by NoCoooode » Mon, Sep 30, 2024, 5:07 PM UTC

alach11 wrote: post #33

zozbot234 wrote: post #30

> How many r's in "strawberry"? Think step by step! What a nice question! Well, let's just count: 1. S 2. T 3. R! So, we have our answer: there are 3 R's in "strawberry". Totally checks out!

This is one of the least interesting questions to ask LLMs. I wish it wasn't so popular.

That they can't do this sort of simple question speaks volumes to the entire approach.

I don't think generative AI will ever be able to reach AGI, and most people selling LLM today pretend it is AGI

Re: Liquid Foundation Models: Our First Series of Generative AI Models

#40

Post by GaggiX » Mon, Sep 30, 2024, 5:07 PM UTC

Jackson__ wrote: post #36

API only model, yet trying to compete with only open models in their benchmark image. Of course it'd be a complete embarrassment to see how hard it gets trounced by GPT4o and Claude 3.5, but that's par for the course if you don't want to release model weights, at least in my opinion.

Yes, I agree, for these small models it's wasted potential to be closed source, they can only be used effectively if they are open.

EDIT: HN is rate-limiting me so I will reply here: In my opinion 1B and 3B truly shine on edge devices, if not than it's not worth the effort, you can have much better models for already dirt cheap using an API.