Earlier quoted context omitted.
:) I love my Amiga 500 and I miss her :)
Me too! Guru meditations and all.
FAKIR HAS NAILS ON BOOT
SCREEN
:)
Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
41–50 of 58 posts
Re: Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
#42> How do we make sure that the output is factual and not hallucinated?
One method the readme doesn't mention: ask the same question multiple times. Apparently research suggests that when LLMs hallucinate answers, their hallucination is likely to be a different one every time, where as factual answers will tend to be consistent.
Re: Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
#43> How do we make sure that the output is factual and not hallucinated? One method the readme doesn't mention: ask the same question multiple times. Apparently research suggests that when LLMs hallucinate answers, their hallucination is likely to be a different one every time, where as factual answers will tend to be consistent. https://arxiv.org/abs/2305.18248
Purely anecdotally this is not a very successful method in my usage
To reproduce: I've had it be consistent on hallucinations on the stable homotopy groups of spheres; on the quote "who speaks of victory to endure is all"; and many other fact based questions. Model: gpt4
Re: Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
#44> How do we make sure that the output is factual and not hallucinated? One method the readme doesn't mention: ask the same question multiple times. Apparently research suggests that when LLMs hallucinate answers, their hallucination is likely to be a different one every time, where as factual answers will tend to be consistent. https://arxiv.org/abs/2305.18248
Purely anecdotally this is not a very successful method in my usage To reproduce: I've had it be consistent on hallucinations on the stable homotopy groups of spheres; on the quote "who speaks of victory to endure is all"; and many other fact based questions. Model: gpt4
[deleted]
Re: Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
#45I didn't quite understand this. Why is llama offered as a .cpp file instead of a compiled binary? I mean, obviously there are benefits from having the code, but most of the time people will give you an executable. Why isnt this the same?
Binaries are published in the release section, in the form of a bootable ISO.
Instructions also are there too
Re: Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
#46> How do we make sure that the output is factual and not hallucinated? One method the readme doesn't mention: ask the same question multiple times. Apparently research suggests that when LLMs hallucinate answers, their hallucination is likely to be a different one every time, where as factual answers will tend to be consistent. https://arxiv.org/abs/2305.18248
[deleted]
Re: Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
#47> How do we make sure that the output is factual and not hallucinated? One method the readme doesn't mention: ask the same question multiple times. Apparently research suggests that when LLMs hallucinate answers, their hallucination is likely to be a different one every time, where as factual answers will tend to be consistent. https://arxiv.org/abs/2305.18248
Asking repeatedly would be impractical. I have some vague idea in my mind called the fact engine. It's like a wiki where people could key in facts. Also facts based on "timeframes", ie 1800's 1900's etc (eg Moon Landing). The fact engine feeds a model that checks for hallucinations, and also rule based engines. Then a final score would be assigned based on consensus. Something like that.
Re: Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
#48Sweet, now someone do Mistral-7B-Everywhere and make it also take advantage of any available Nvidia GPU's or M1 Mac GPU's
Re: Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
#49Creator here. Thank you for sharing!
Pretty cool! > My research goal is to train models using various hardware telemetry data with the hope that the models learn to interpret sensor inputs and control actuators based on the insights they glean from the sensor inputs. This research direction may open up exciting possibilities in fields such as automation, space, robotics and IoT, where L2E can play a pivotal role in bridging the gap between AI and physic…
> What does L2E stand for?
um...
Re: Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
#50Sweet, now someone do Mistral-7B-Everywhere and make it also take advantage of any available Nvidia GPU's or M1 Mac GPU's
bigger, better models soon