I know it's secret how GPT-4 actually works but are there any of these local LLMs that are also multimodal?
Yes, there are. For example: https://laion.ai/blog/open-flamingo/
The Coming of Local LLMs
181–190 of 214 posts
Re: The Coming of Local LLMs
#182Earlier quoted context omitted.
I don’t know how anyone can trust to run code on their machine that they don’t understand and hasn’t been reviewed by a third party.
How many line of codes are in the kernel, drivers, and apps on your laptop/desktop? How sure are you that all that code has been reviewed by a 3rd party? How many CVEs a year impact your laptop/desktop? Do you have any reason to think that increased productivity with LLM assistance will result in lower quality code? Personally I find LLM assistance increases productivity, decreases the penalty of using a more difficu…
I meant reviewed by a (competent) human; not, audited by a security team/whatever. Generative computer code is in a whole new category of risk, because it can hallucinate a `rm -rf *` that you might overlook if you don't understand the code yourself.
Re: The Coming of Local LLMs
#183Earlier quoted context omitted.
How many line of codes are in the kernel, drivers, and apps on your laptop/desktop? How sure are you that all that code has been reviewed by a 3rd party? How many CVEs a year impact your laptop/desktop? Do you have any reason to think that increased productivity with LLM assistance will result in lower quality code? Personally I find LLM assistance increases productivity, decreases the penalty of using a more difficu…
I meant reviewed by a (competent) human; not, audited by a security team/whatever. Generative computer code is in a whole new category of risk, because it can hallucinate a `rm -rf *` that you might overlook if you don't understand the code yourself.
Well at least for now, any non-trivial code is going to be written by a human+AI, likely one function at a time. It's pretty rare for the AI to give me exactly what I want, often I have to tweak my prompts multiple times, and even just give up and write a function based on the useful bits from previous queries.
I just don't see it chatbot assisted programming any worse than what we have today.
Re: The Coming of Local LLMs
#184Earlier quoted context omitted.
Like almost all machine learning stuff, I expect these things to only be useful in places where it doesn't really matter if the results are correct. When you apply a classifier in real life its critically important to understand its statistical characteristics which is typically done via model characterization, which involves cross validation or boot strapping or whatever. I think the idea that you can just zero-shot…
Nothing about a zero or few-shot classifier precludes you from validating on a data set.
I think most users are not going to do this; they have no reason to even know such a thing might be done, let alone that it’s useful.
Re: The Coming of Local LLMs
#185Earlier quoted context omitted.
Disagree. Adding signed communications as the default to replace email's completely nonsense zero encryption model is not upping the stakes. Email is the most successful federated software in the universe, but it's fucking time to get some encryption and authn.
you are having a good laugh if you think the average granny is going to do that anytime soon
Why would they? If actually implemented it will be a few checkboxes behind a prompt next time they login.
Re: The Coming of Local LLMs
#186Earlier quoted context omitted.
Disagree. Adding signed communications as the default to replace email's completely nonsense zero encryption model is not upping the stakes. Email is the most successful federated software in the universe, but it's fucking time to get some encryption and authn.
you are having a good laugh if you think the average granny is going to do that anytime soon
Yea, lol, what was I thinking!? It’s not like my granny uses TLS ECDH SHA1 right!? Oh, wait, everyday she does? The tools adapt; email has never had to.
Re: The Coming of Local LLMs
#187Earlier quoted context omitted.
Agree, though plain old Bayesian classifiers have been able to handle some significant portion of that office work for a long time. And not much ever came from it for everyday stuff outside of spam filters. Maybe both the buzz factor and broader applicability means it's more likely to happen this go around?
More like: the accessibility is what will make it go around. The accessibility is what changes everything! Getting an easy to use interface (instructions) over python changes the accessibility from the denizens of this website to ~anyone with a computer If you're interested, see this paper that argues that point: https://arxiv.org/abs/2302.06541 Essentially, being label efficient is more important than being compute…
Re: https://arxiv.org/abs/2302.06541 - how are we supposed to take the phrase "agile text classification" seriously?
They could have just said "efficient". But no - they had to go for "agile".
Re: The Coming of Local LLMs
#188It would be nice to be able to run an LLM-driven spamassassin on a VPS for acceptable cost.
I don't think it will help. Actual friends occasionally send me mail that says "test" from a random account. And spammers do too... There is no way to seperate them.
Don't you do it somehow? Plus a filter doesn't have to be 100% right all the time. Filtering out what is 99% certain to be or not be spam and leaving the human to cover the tiny number of messages that fall into a grey area would still save a ton of time.
Re: The Coming of Local LLMs
#189Earlier quoted context omitted.
It was never possible to keep this technology secret for any length of time.
I thought the possibility to run these LLMs on everyday hardware would be further on the future and in the beginning more limited to big servers. But this could be the equivalent of the Low Orbit Ion Canon for phishers and scammers
My local LLM will automatically detect scams and phishing attempts so it'll all balance out.
Re: The Coming of Local LLMs
#190Earlier quoted context omitted.
They are comparable to the first ChatGPT proof of concept from say early 2022. The reason many of us are excited is because we may be a year or two away from being able to run a ChatGPT if the open source models follow a similar curve.
I have been using ChatGPT from the beginning :) ChatGPT did not have a PoC in early 2022. They are not comparable with late 2022 ChatGPT.
[deleted]