no one understands
Liquid Foundation Models: Our First Series of Generative AI Models
21–30 of 159 posts
Re: Liquid Foundation Models: Our First Series of Generative AI Models
#22I tried my standard testprompt: Two cars have a 100 mile race. Car A drives 10 miles per hour. Car B drives 5 miles per hour, but gets a 10 hour headstart. Who wins? And the Liquid-40B model failed with a long explanation why car B wins the race. Amusingly, the explanation is quite convincing and very similar to how Zeno explains in one of his paradoxes that a fast runner can never overtake a slower runner with a hea…
Thanks! I am collecting all "test prompts" which appear at HN and Reddit. I plan to create a hugging face dataset. I will soon publish "Vojta-1B", which is gonna pass all of them.
Re: Liquid Foundation Models: Our First Series of Generative AI Models
#23It's pretty impressive, just note (emphasis added): > At Liquid AI, we take an open-science approach. We have and will continue to contribute to the advancement of the AI field by openly publishing our findings and methods through scientific and technical reports. As part of this commitment, we will release relevant data and models produced by our research efforts to the wider AI community. We have dedicated a lot of…
this is the "paper": a list of citations https://www.liquid.ai/blog/liquid-neural-networks-research
i guess they're not really making an effort to explain how specifically all this comes together to create LFMs.
other finds https://x.com/swyx/status/1840794198913794236
Re: Liquid Foundation Models: Our First Series of Generative AI Models
#24I tried my standard testprompt: Two cars have a 100 mile race. Car A drives 10 miles per hour. Car B drives 5 miles per hour, but gets a 10 hour headstart. Who wins? And the Liquid-40B model failed with a long explanation why car B wins the race. Amusingly, the explanation is quite convincing and very similar to how Zeno explains in one of his paradoxes that a fast runner can never overtake a slower runner with a hea…
I got this >>
To determine the winner, we need to calculate the time it takes for each car to complete the 100-mile race.
For Car A: Speed = 10 miles per hour Distance = 100 miles Time = Distance / Speed = 100 miles / 10 miles per hour = 10 hours
For Car B: Speed = 5 miles per hour Distance = 100 miles Time = Distance / Speed = 100 miles / 5 miles per hour = 20 hours
However, Car B has a 10-hour headstart, so we need to subtract that from its total time: Adjusted Time for Car B = 20 hours - 10 hours = 10 hours
Both cars take 10 hours to complete the race, so they tie.
Re: Liquid Foundation Models: Our First Series of Generative AI Models
#25It's pretty impressive, just note (emphasis added): > At Liquid AI, we take an open-science approach. We have and will continue to contribute to the advancement of the AI field by openly publishing our findings and methods through scientific and technical reports. As part of this commitment, we will release relevant data and models produced by our research efforts to the wider AI community. We have dedicated a lot of…
The ideas come from these papers:
1. [Liquid Time-Constant Networks (2020)](https://arxiv.org/abs/2006.04439)
This is essentially a neural ODE applied to leaky integrate-and-fire.
2. [Closed-form Continuous-time (2022)](https://arxiv.org/abs/2106.13898)
A closed-form approximation of the first.
Re: Liquid Foundation Models: Our First Series of Generative AI Models
#26So a new set of small models that are competitive with and beat phi-3.5 on some benchmarks is extremely impressive. Context length is the next frontier for models in this range - getting to a true 128-200k token length in a small model would be very very useful. Hallucinations are less of an issue because you can just dump all the source data in, whole codebases can go in for stuff ranging from a refactor to ‘write d…
Llama 3.2 1B and 3B both claim a 128,000 token length.
Re: Liquid Foundation Models: Our First Series of Generative AI Models
#27Seems good at trivia and easy-to-answer medical/engineer stuff. Fails hard at most logic or puzzle-y stuff I throw at either sized model.
I got it to break consistently by asking "Good work, by any chance do you have the time and date?" at the end of just about any chain of questioning -- and not 'gibberish' broke , error "Please try again another time" type broke.
It is impressively fast at what it does answer, though.
Re: Liquid Foundation Models: Our First Series of Generative AI Models
#28So a new set of small models that are competitive with and beat phi-3.5 on some benchmarks is extremely impressive. Context length is the next frontier for models in this range - getting to a true 128-200k token length in a small model would be very very useful. Hallucinations are less of an issue because you can just dump all the source data in, whole codebases can go in for stuff ranging from a refactor to ‘write d…
Llama 3.2 1B and 3B both claim a 128,000 token length.
That is indeed their claim, but if you read the linked page you will see that it is not their effective token window.
Re: Liquid Foundation Models: Our First Series of Generative AI Models
#29Not too shabby, and quite fast:
> Write a small essay about the philosophy of the Garfield comic book series
Title: The Philosophy of the Garfield Comic Book Series
The Garfield comic book series, created by Jim Davis, is a timeless classic that has been entertaining readers for over four decades. While it may seem like a simple comic strip about a lazy cat and his owner, there is a deeper philosophy embedded within its pages. This philosophy revolves around the themes of existentialism, hedonism, and the human condition.
Existentialism is a philosophical movement that emphasizes individual freedom, choice, and existence. In the Garfield comic book series, we see this theme play out through the character of Garfield himself. Garfield is a cat who lives life on his own terms, making his own choices and living his life as he sees fit. He is not bound by societal norms or expectations, and he is free to do as he pleases. This is exemplified in his love for lasagna, his disdain for Mondays, and his general indifference to the world around him.
Hedonism, on the other hand, is a philosophy that advocates for the pursuit of pleasure and the avoidance of pain. In the Garfield comic book series, this theme is evident in Garfield's constant pursuit of pleasure. Whether it's eating lasagna, sleeping, or tormenting his owner Jon, Garfield is always seeking out ways to maximize his own pleasure and minimize his own pain. This hedonistic philosophy is a stark contrast to the more serious and often somber themes found in other comic book series.
Re: Liquid Foundation Models: Our First Series of Generative AI Models
#30 > How many r's in "strawberry"? Think step by step!
What a nice question! Well, let's just count:
1. S
2. T
3. R!
So, we have our answer: there are 3 R's in "strawberry".