121–130 of 314 posts
Trying it out: > Answer this Jeopardy question: This long-handled gardening tool can also mean an immoral pleasure seeker. The correct answer for the given jeopardy question would be "A hoe". The word 'ho' is slang term used to describe a promiscuous woman or prostitute, which makes it clear that this long-handled gardening tool can also mean an immoral pleasure seeker.
Earlier quoted context omitted.
Are you sure there isn’t some additional tricks? Is it possible they are doing summarization when you use the web interface to gpt4? Because I have some extremely long conversations and I ask it if it remembers the beginning of the conversation and it does.
Somehow I doubt there is any type of “prompt compression” being done.
Earlier quoted context omitted.
Given recent guidance from the US Copyright Office, I doubt there are real copyright issues or enforceable restrictions on commercial use. I would say that someone trying to sell the original model would be the only case that could have a real challenge, and even then its not that clear cut to me. Everyone else using these fine tuned models, I don't think there is a case. Everyone's making non-copyrightable scaffoldi…
There’s a big difference between copyright for material produced by a model, and copyright on the software and weights for the model. As far as I know, USPTO has said that works crested primarily by AI may not receive copyright protection, but I don’t think there’s any indication that the software to run AI is not copyrightable. Maybe?
That said, regulatory capture is strong in the US. It would not surprise me if we see these laws changed.
Earlier quoted context omitted.
We're a long long long way off that. So check back in two months. Jokes aside, the limiting factor will be either a technique to pack all of the code into smaller tokens like semantic search (someone else will be able to comment on this as that's the limit of my understanding) or GPU memory for input tokens. Buying a "high end GPU" isn't buying a 4090 or even two, it's 250k on a DGX unit and putting it in a datacentr…
>Buying a "high end GPU" isn't buying a 4090 or even two, it's 250k on a DGX unit and putting it in a datacentre. You will probably be able to find a service that would sign a confidentiality agreement and provide you with this service for less than 250k. I haven't started to play with LLMs locally in anger yet, but I was under the impression that you could use a 4090 in combination with FlexGen to achieve this rathe…
But it is pretty cheap to rent something at vast.ai or whatever to get 40GB for a final run.
The important takeaway for both GPT4All and Alpaca is that once an expensive proprietary model is released, people can easily train cheaper OSS models on input/output pairs. ⇒ LLMs are not defensible ⇒ LLMs will become commoditized ⇒ Prices will drop ⇒ Great for open source
Only concern is this violates terms of use of the proprietary LLM API, at least that is true for the current OpenAI API
Earlier quoted context omitted.
I’ll ask a dumb question. On another of the numerous LLM related posts I was asking if any of the self host-able open model can do code summaries at close to the quality of GPT 3.5 turbo. I was basically told nowhere close yet. Can this potentially do that? Ideally I’d like to have it generate descriptions of large amounts of code but would rather not burn tokens and lose privacy via OpenAI api. But I’d gladly keep a…
Same question here - alpaca does not do well with long inputs :( Ideally i can throw a 100 pages PDF at it and get a summary and a response document :)
The real question is what is OpenAI going to do with someone who so clearly flaunted their ToS? If nothing, then OpenAI is going to have a hell of a time making any money out of this for long. But I suspect, that the people who made this are going to get slapped hard with a lawsuit, and essentially forced to shut it down.
Earlier quoted context omitted.
Same question here - alpaca does not do well with long inputs :( Ideally i can throw a 100 pages PDF at it and get a summary and a response document :)
Can’t you just break it into chunks and the summarize the summaries?