Ask HN: What's the best self hosted/local alternative to GPT-4?

Post by throwaway292939 » Thu, Jun 01, 2023, 11:15 PM UTC

inductive_magic wrote: post #108

icapybara wrote: post #96

Earlier quoted context omitted.

This point is understated. So many people are going around like "I'm building an AI app!" when the reality is, OpenAI built an AI app, you're just designing a front end for it.

OpenAI builds an LLM and an api-interface to that model. The design of abstractions, prompt engineering, custom fine-tunes and software engineering required to ship a valuable application on top of that interface counts as "building an app" in my book.

Post by jomohke » Fri, Jun 02, 2023, 5:13 AM UTC

londons_explore wrote: post #34

catwalk_moto wrote: post #14

[dead]

Worth noting that Llama and derivatives most likely can be used for commercial use, despite what the licensing terms say. There seems to be growing consensus that model weights are not copyrightable, and therefore adhering to the terms of the license isn't required if you downloaded them from a third party. Obviously being legally right doesn't necessarily save you from having Meta's legal team breathing down your ne…

Post by balu548411 » Wed, Jun 07, 2023, 1:07 PM UTC

MacsHeadroom wrote: post #54

AndroTux wrote: post #19

https://gpt4all.io/ works fairly well on my 16 GB M1 Pro MacBook. It's certainly not on a level with ChatGPT, but what is? It's a simple app download and allows you to select from multiple available models. No hacking required.

> It's certainly not on a level with ChatGPT, but what is? Guanaco-65B is per https://arxiv.org/abs/2305.14314 CPU Version: https://huggingface.co/TheBloke/guanaco-65B-GGML GPU Version: https://huggingface.co/TheBloke/guanaco-65B-HF 4bit GPU Version: https://huggingface.co/TheBloke/guanaco-65B-GPTQ