431–440 of 543 posts
The terms of use: https://ai.google.dev/gemma/terms and https://ai.google.dev/gemma/prohibited_use_policy Something that caught my eye in the terms: > Google may update Gemma from time to time, and you must make reasonable efforts to use the latest version of Gemma. One of the biggest benefits of running your own model is that it can protect you from model updates that break your carefully tested prompts, so I’m not…
Earlier quoted context omitted.
More useful would be a precise characterization of the type and balance of the ideological fine tuning. They include performance benchmarks. End-users should also be aware of what thoughts are permitted in these constructs. Why omit this information?
> End-users should also be aware of what thoughts are permitted in these constructs. Why omit this information? Can you define that in a way that's actually testable? I can't, and I've been thinking about "unthinkable thoughts" for quite some time now: https://kitsunesoftware.wordpress.com/2018/06/26/unlearnable...
Q: how sure are you that the newer models trained from trillions of tokens - a huge chunk of open web, hasn't been accidentally polluted by slurping test data?
Earlier quoted context omitted.
Fun that's not my experience of Phi-2. I use it for non-creative context, but function calling, and I find as reliable as much bigger models (no fine-tuning just constraining JSON + CoT). Phi-2 unquantized vs Mixtral Q8, Mixtral is not definitely better but much slower and RAM-hungry.
What prompts/settings do you use for Phi-2? I found it completely unusable for my cases. It fails to follow basic instructions (I tried several instruction-following finetunes as well, in addition to the base model), and it's been mostly like a random garbage generator for me. With Llama.cpp, constrained to JSON, it also often hangs because it fails to find continuations which satisfy the JSON grammar. I'm building a…
> You are a helpful assistant to 'User'. You do not respond as 'User' or pretend to be 'User'. You only respond once as 'Assistant'. 'System' will give you data. Do not respond as 'System'. Allow yourself inner thoughts as 'Thoughts'.
and then I constrain its answers to Thoughts: [^\n]* and Assistant: , and I have two shots included in the prompt.
I haven't been able to get anything useful out of Phi-2 in llama.cpp (but I only tried quantized models). I use python/huggingface's transformers lib instead.
mmm.. > what are the top 5 tallest man-made structures in the world Statue of Unity (Tallinn, Estonia) - 368 m Leaning Tower of Pisa (Pisa, Italy) - 330 m Supertree Grove (Orlando, Florida) - 275 m Skylon Tower (Kuala Lumpur, Malaysia) - 271 m Statue of Liberty (New York City, USA) - 186 m > what is the richest country in the world The richest country in the world is Saudi Arabia with a gross domestic product of US$2…
These are the answers I got out of it (first output, no cherry-picking):
1. The tallest man-made structure in the world is the Burj Khalifa, standing at 828 meters tall. The Burj Khalifa is a skyscraper in Dubai, United Arab Emirates.
Here are the top 5 tallest man-made structures in the world, according to the Guinness World Records:
Burj Khalifa (828 m)
Taipei 101 (611 m)
Merdeka Towers (599 m)
Shanghai Tower (632 m)
Petronas Towers (551 m)
3. A foot (ft) is equal to 12 inches (in). There are 2.54 cm in an inch, so there are 2.54 cm x 12 = 30.48 cm in a foot.
Earlier quoted context omitted.
> End-users should also be aware of what thoughts are permitted in these constructs. Why omit this information? Can you define that in a way that's actually testable? I can't, and I've been thinking about "unthinkable thoughts" for quite some time now: https://kitsunesoftware.wordpress.com/2018/06/26/unlearnable...
Have you considered the use of Monte Carlo sampling to inspect latent behaviors?
The terms of use: https://ai.google.dev/gemma/terms and https://ai.google.dev/gemma/prohibited_use_policy Something that caught my eye in the terms: > Google may update Gemma from time to time, and you must make reasonable efforts to use the latest version of Gemma. One of the biggest benefits of running your own model is that it can protect you from model updates that break your carefully tested prompts, so I’m not…
This is actually not that unusual. Stable Diffusion's license, CreativeML Open RAIL-M, has the exact same clause: "You shall undertake reasonable efforts to use the latest version of the Model." Obviously updating the model is not very practical when you're using finetuned versions, and people still use old versions of Stable Diffusion. But it does make me fear the possibility that if they ever want to "revoke" every…
However you might be required to update if they do more subtle changes, like a new version that only speaks positively about Google and only negatively about Microsoft. Provided this doesn't have an obvious adverse impact on your use of the model.
Earlier quoted context omitted.
Sounds like it's "reasonable" for you not to update then.
It says you must make efforts (to a reasonable extent), not that you must give a reason for not making efforts
If you are looking for a nice chat UI to try out Gemma (and other offline + online models) locally, I'm working on an app [1] that is offline and privacy focused. I've just added support for Gemma 7B. [1]: https://msty.app
Handy app for model testing! One usage question: after you've downloaded a model and are finished trying it out, how do you remove it?
Now that I think of it, it could be a bit confusing. Thanks for asking, I feel like I need to improve this a bit.
Earlier quoted context omitted.
Isn't this just lawyer speak for "we update our model a lot, and we've never signed off on saying we're going to support every previous release we've ever published, and may turn them off at any time, don't complain about it when we do."
It's a local model, they can't turn it off. It's files on your computer without network access.