51–60 of 89 posts
- is it counted for a single user message or the sum of all previous messages?
- if there's a file, will it be counted every time a user interacts or only the first time?
This website is now like 30% about this probability based autocomplete nonsense. Feels like all those bitcoin hypes and "running everything on blockchain" fad of few years ago. Now it's running everything through "large autocomplete" model. I really hope this will fade and focus will turn back to highlighting some broader actual human ingenuity in IT, rather than constant stream of "we used autocomplete for this new…
Earlier quoted context omitted.
If deep learning algorithms are "autocomplete" then so is the human mind when it strings words together. No, that's not how it works.
[citation needed] Just because that makes for a nice narrative in the copyright infringement argument, doesn't make it so. We know next to nothing about how the human brain works.
Here's a paper from 1990 by the Godfather himself https://www.cs.toronto.edu/~hinton/absps/AIJmapping.pdf
"This 1990 paper demonstrated how neural networks could learn to represent and reason about part-whole hierarchical relationships, using family trees as the example domain.
By training on examples of family relations like parent-child and grandparent-grandchild, the neural network was able to capture the underlying logical patterns and reason about new family tree instances not seen during training.
This seminal work highlighted that neural networks can go beyond just memorizing training examples, and instead learn abstract representations that enable reasoning and generalization"
> We know next to nothing about how the human brain works
We understand how parts of it work.
Finally! I've been using the assistants api in building an ai mock interviewer ( https://comp.lol ) but the responses were painfully slow when using the latest iterations of the gpt-4 model. This will make things so much more responsive
I'd still want to see the entire response all at once. Having it stream in while I read it would be very distracting and make it difficult for me to read.
For all the brilliance in the AI and infra departments of OpenAI, their official Python library (which is the flagship one as I understand) feels pretty unidiomatic, designed without much thought for common patterns in the language. 2012 JavaScript called, it wants its callbacks wrapped in objects back. Why do we have a context manager named "stream" for which you call `.until_done()`? This could've been an iterator,…
Probably written by GPT4
As a Stainless contributor I can guarantee you a lot of thoughts has been put into the design, and it definitely isn’t written by an ML model
I am interested to use the assistant api for my commercial project but it is not clear from the article what the token count looks like? - is it counted for a single user message or the sum of all previous messages? - if there's a file, will it be counted every time a user interacts or only the first time?
- it is correlated to the sum, every new interaction adds the whole history again
- yes, but you probably pay for the retrieved fragments, not the whole file
Earlier quoted context omitted.
I'd still want to see the entire response all at once. Having it stream in while I read it would be very distracting and make it difficult for me to read.
yes, it like surfing porn in the early internet year using a dialup modem. One line a the time until you finally can see enough of the picture (reply) to realize that is was not the reply you were looking for. LLM streaming must be a cost saving feature to prevent you from overloading the servers by asking to many questions with in a short time frame. Annoying feature IMHO
I am interested to use the assistant api for my commercial project but it is not clear from the article what the token count looks like? - is it counted for a single user message or the sum of all previous messages? - if there's a file, will it be counted every time a user interacts or only the first time?
I think - it is correlated to the sum, every new interaction adds the whole history again - yes, but you probably pay for the retrieved fragments, not the whole file
Any way to have a consistent system prompt across queries without sending it (and using tokens) for each completion?
The assistant has its own "instructions" (replacement for system prompt) and then on each run, you have the option to add more guidance to the run explicitly, without modifying the assistant instructions (system prompt) It's a little bit different but kind of the same