I fed 24 years of my blog posts to a Markov model
1–10 of 131 posts
Re: I fed 24 years of my blog posts to a Markov model
#2now i wonder if you can compare vs feeding into a GPT style transformer of a similar Order of Magnitude in param count..
Re: I fed 24 years of my blog posts to a Markov model
#3I usually have this technical hypothetical discussions with ChatGpt, I can share if you like, me asking him this: aren't LLMs just huge Markov Chains?! And now I see your project... Funny
Re: I fed 24 years of my blog posts to a Markov model
#4I recall a Markov chain bot on IRC in the mid 2000s. I didn't see anything better until gpt came along!
Re: I fed 24 years of my blog posts to a Markov model
#5I did something similar many years ago. I fed about half a million words (two decades of mostly fantasy and science fiction writing) into a Markov model that could generate text using a “gram slider” ranging from 2-grams to 5-grams.
I used it as a kind of “dream well” whenever I wanted to draw some muse from the same deep spring. It felt like a spiritual successor to what I used to do as a kid: flipping to a random page in an old 1950s Funk & Wagnalls dictionary and using whatever I found there as a writing seed.
Re: I fed 24 years of my blog posts to a Markov model
#6I recall a Markov chain bot on IRC in the mid 2000s. I didn't see anything better until gpt came along!
Yes, I made one using bitlbee back in the 2000s, good times!
Re: I fed 24 years of my blog posts to a Markov model
#7I recall a Markov chain bot on IRC in the mid 2000s. I didn't see anything better until gpt came along!
Yes, I made one using bitlbee back in the 2000s, good times!
I made one for Hipchat at a company. I can't remember if it could emulate specific users, or just channels, but both were definitely on my roadmap at the time.
Re: I fed 24 years of my blog posts to a Markov model
#8I usually have this technical hypothetical discussions with ChatGpt, I can share if you like, me asking him this: aren't LLMs just huge Markov Chains?! And now I see your project... Funny
> I can share if you like
Respectfully, absolutely nobody wants to read a copy-and-paste of a chat session with ChatGPT.
Re: I fed 24 years of my blog posts to a Markov model
#9I usually have this technical hypothetical discussions with ChatGpt, I can share if you like, me asking him this: aren't LLMs just huge Markov Chains?! And now I see your project... Funny
LLMs are indeed Markov chains. The breakthrough is that we are able to efficiently compute well performing probabilities for many states using ML.
Re: I fed 24 years of my blog posts to a Markov model
#10now i wonder if you can compare vs feeding into a GPT style transformer of a similar Order of Magnitude in param count..
I thought for a moment your comment was the output of a Markov chain trained on HN