41–50 of 79 posts
This is really cool but the output is such garbage at that weight size that you might as well be running a markov chain.
Earlier quoted context omitted.
> I'm still amazed that Apple invests so much into every other bit of hardware on a high end phone, yet always gives you the bare minimum amount of RAM they can get away with. Advanced hardware makes bullet points on advertising to sell the device; giving the bare minimum of RAM accelerates the device planned obsolescence, so that user will be forced to upgrade sooner to the next model.
How is that an iPhone 7 is completely current vs give me a branded Android from the same year of release that has even security updates, not even features.
Earlier quoted context omitted.
What are you comparing it to? Without instruction tuning and a two character prompt "He" I am not sure why you would expect it to perform any better.
I was replying to a comment that said it “seems fine.” It does not seem fine. It is incomprehensible and doesn’t match the results I’ve seen from 7B through 65B. It is true that RLHF could improve it, and perhaps then this severe of optimization will seem fine.
Earlier quoted context omitted.
I'm still amazed that Apple invests so much into every other bit of hardware on a high end phone, yet always gives you the bare minimum amount of RAM they can get away with. There are so many use cases (like this) that require more RAM. And even if a use case doesn't theoretically require more RAM, getting a developer to dedicate time to optimizing RAM is time taken away from making a wonderful app.
> I'm still amazed that Apple invests so much into every other bit of hardware on a high end phone, yet always gives you the bare minimum amount of RAM they can get away with. Advanced hardware makes bullet points on advertising to sell the device; giving the bare minimum of RAM accelerates the device planned obsolescence, so that user will be forced to upgrade sooner to the next model.
Apple still does security updates for IOS - last was 12.5.7 - 23 Jan 2023 - that's back to the iPhone 5S
They've literally provided security updates for a 10 year old device, has any competitor even come close to that?
Earlier quoted context omitted.
How is that an iPhone 7 is completely current vs give me a branded Android from the same year of release that has even security updates, not even features.
The problem with iPhones is once updates stop there's nothing you can do. The iPhone 7 isn't current, it's stuck on iOS 15 while the newest is 16. And while the pixel 2 (which is only a month younger than the iPhone 7) only got official support up to Android 11; you actually own the device and can easily unlock the boot-loader to upgrade to Android 13.
Feature updates with the current IOS 16 goes back to the iPhone 8
Yeah you do lose feature updates and slowly app support after the latest version drops support, but it's not like they're dropping support after 2 years, and you can stay on it for years later if you'd like.
I'm not saying it couldn't be better but they're clearly far above the vast majority of their competition.
This is really cool but the output is such garbage at that weight size that you might as well be running a markov chain.
That's why Alpaca is so exciting: it instruction-tunes LLaMA to the point that even the tiny 7B model (the one that fits on a phone) produces useful output: https://simonwillison.net/2023/Mar/13/alpaca/
Earlier quoted context omitted.
That's why Alpaca is so exciting: it instruction-tunes LLaMA to the point that even the tiny 7B model (the one that fits on a phone) produces useful output: https://simonwillison.net/2023/Mar/13/alpaca/
But they won’t give us the model… so it’s ultimately meaningless because they’ll just sell out
This would be useful for predictive text. That's exactly what LLMs are actually built for.
Earlier quoted context omitted.
But they won’t give us the model… so it’s ultimately meaningless because they’ll just sell out
My understanding is they legally can't. It was trained used OpenAI, which doesn't allow using their output to train new models. Someone would need to find another data source to fine tune llama.