Viewing profile — grph123dot

Yesterday I asked chatgpt to compute the probability that two words of five letters both began with the same three letters and it could not solve it. It gave me about 10 different …

Perhaps the concepts of vector embedding and the attention mechanism could be explained. Also you could use some prompts for LLM to generate new content for your intended audience,…

The Alpaca lora result is incorrect since, for example, if all elements in array are the same the result in just an array with one element.

>> that the change in the weights as you train also have low intrinsic rank It seems that the initial matrix of weights has a low rank approximation A and this implies that the dif…

Since we are in ELI5, it seems that the concept of low rank approximation is required to understand this method. (1) https://en.wikipedia.org/wiki/Low-rank_approximation Edited: By…

Your explanation is crystal clear. I suppose it works well in practice, but is there any reason it works that well?

I think that google could use a LLM with wxmaxima and some database, for example using maxima the LLM could show the source code used and perhaps it could adapt the code to new pro…