11–20 of 177 posts
Markov Chains are cool stuff. Back in 2015 in one of my senior class projects, I built a haiku bot that would take a seed word and make a haiku from a corpus of Tweets I collected from the firehose API.
Intriguing. How did you get it to fit the syllable count?
I wasn't able to get far enough to make each haiku make perfect grammatical sense, but it very often produced interesting results.
> Since there is a 25% probability Alice is at the grocery store, we multiply that with the probility of her transitioning to the Planetarium: 25% ∗ 75%
Shouldn't this be 25% * 70%?
This is what I've been saying to people, LLMs aren't much smarter than a Markov Chain - a lot of twitter bots and earlier chat agents were driven by them. What I do see though is the infrastructure around LLMs making a difference.
This is what I've been saying to people, LLMs aren't much smarter than a Markov Chain - a lot of twitter bots and earlier chat agents were driven by them. What I do see though is the infrastructure around LLMs making a difference.
I've never seen a Markov chain do anything like GPT4. I'm not sure how you can say with a straight face they are basically the same.
Markov chains were one of the coolest discoveries of my programming career and I spent years using them to make forum and social media bots trained on people’s post histories for them. I think that experience is part of why I’ve been generally unimpressed with a lot of LLM hype. Like yeah, it’s cool and definitely more useful than a markov chain - but for the amount of resources that went into it I’d expect the gap t…
Also same as you why I've been very cool to LLM hype. Not that LLMs aren't feats of their own but they're not nearly as smart as their hype suggests.
This is what I've been saying to people, LLMs aren't much smarter than a Markov Chain - a lot of twitter bots and earlier chat agents were driven by them. What I do see though is the infrastructure around LLMs making a difference.
I've never seen a Markov chain do anything like GPT4. I'm not sure how you can say with a straight face they are basically the same.
Here's a good post on how effective these can be: https://colab.research.google.com/github/norvig/pytudes/blob...
(The people saying modern LLMs are just fancy Markov chains in practice are being silly, though.)
This is what I've been saying to people, LLMs aren't much smarter than a Markov Chain - a lot of twitter bots and earlier chat agents were driven by them. What I do see though is the infrastructure around LLMs making a difference.
Earlier quoted context omitted.
I'm also getting a client side error where the demo should be? Not sure if its just on my end.
My goodness. Thank you for letting me know. I'll look into it right away.