131–140 of 162 posts
Earlier quoted context omitted.
ChatGPT 4 currently accepts 8000 tokens and will eventually support 32k
I can't get it to eat 8k tokens. I assume this is only available via the api. The web interface is limited to around 2k tokens.
Earlier quoted context omitted.
This is already legal without AI. Copyright protects only expression, not ideas, systems or methods. This is why directly reverse-engineering a proprietary binary to extract the algorithms and systems is legal.
For anyone interested, this is called "clean room design"[1]. Unfortunately it doesn't protect against patents, but it does against copyright. [1] https://en.wikipedia.org/wiki/Clean_room_design
Earlier quoted context omitted.
6c per thousand tokens, so $2 per maxed out API call
Still super expensive. You cant build a business arround it with these rates. It should be at least 1000 times cheaper if not more.
Earlier quoted context omitted.
Depends how good it is now, doesn’t it? If it actually writes code (it does), which is ‘good enough’ compared to a 25-150$/hr human (it does for the lower part of that scale), the $2 is definitely a good business case. For instance, I had to write 1500 lines of js yesterday because one of my colleagues who took the task could not manage it in the previous 2 days and the deadline was today. We would’ve saved about 500…
> which is ‘good enough’ compared to a 25-150$/hr human (it does for the lower part of that scale), I'm not exactly sure you define that scale, perhaps Minecraft bots or the like, where the damage after complete failure is self contained to perhaps a few dollars or a few hours of human annoyance. I'm sure there are many niches where a 50% success rate of mass generated programs can earn you big bucks. But in my exper…
I tried it with phone number formats and it came up with more than I could.
Earlier quoted context omitted.
This is already legal without AI. Copyright protects only expression, not ideas, systems or methods. This is why directly reverse-engineering a proprietary binary to extract the algorithms and systems is legal.
> Copyright protects only expression, not ideas, systems or methods Copyright is a law agreed by a humans in a social contract created to protect humans and further their interests in a 'fair' manner. There is no inalienable right to copyright, no universal law that requires it, it's not an emergent property of intelligence that mechanically applies to artificial entities. So while the current copyright laws could be…
Functional purposes where never meant to be covered by copyright.
Earlier quoted context omitted.
It has no post-2021 knowledge, but while playing with it, I found that you can just paste the documentation (no need to even format it) and it'll just "learn" it. For example, safetensors wasn't available back then apparently, I just copied the docs into it and was able to get it write pretty good pytorch code that incorporates safetensors.
i just asked it about safetensors today! also, got a response that amounted to "i don't know what that is. i'm guessing it's X"
Earlier quoted context omitted.
I imagine few shot learning would kick in for most new language features. A feature may be new to a particular language, but is it really new?
I tried a new Lisp dialect on it, my own hobby language. It could cope well given explanations initially, but with some degradation after a while. The full transcript went to 84kB, so it must be doing some kind of intelligent summarization behind the scenes to stay as coherent as it did, right? (The standard context window is supposed to be 8k tokens.) ( https://gist.github.com/darius/b463c7089358fe138a6c29286fe2d...…
Seeing a lot of comments in here about the token limits. Another path you can take is to fine tune a model on your business. Each training item has to fit within the token limit, but you can send hundreds of megs of these for training. It's more expensive to run a FT model, but you don't have to include any prior context (assuming it's common to all prompts).
You can't fine tune gpt-3.5 or gpt-4 though
ChatGPT is just a big tech demo of what anyone could achieve. Granted, the training data is the hardest part. But, if you have a narrow domain and piles of existing data to work with, I don't see why you can't exceed the performance of these offerings for topics that actually matter to you.