Viewing profile — heisenburgzero

In my own experience, if the problem is not solvable by a LLM. No amount of prompt "engineering" will really help. Only way to solve it would be by partially solving it (breaking d…

So did you just combine Title+Abstracts+Authors into a single chunk and embed them or embedded them individually?

I always wondered where to start learning reverse-engineering. Most people will say learn Assembly first. But from there on, there seems to be not much more concrete information on…

Thanks. "In-context learning" was the phrase I was looking for. Also, I found these 2 links pretty good too. 1. http://ai.stanford.edu/blog/understanding-incontext/ 2. http://ai.st…

I think some earlier NLP applications have something called "Unknown token", which they will replace any unseen word. But for recent implementations, I don't think they are being u…

Not completely related. Does anyone know where I can find articles / papers that discuss why transformers, while acting as merely "next token predictor" can handle questions with: …

Thanks, that make sense. I think my comment was not worded properly. I was thinking "geometry properties = linear properties", what I really should say is: Why does the latent spac…

Why does the embeddings have linear properties such that you can use functions like cosine similarity to compare? It seems that after the signal going through so many non-linear ac…

This is not the first time something is fishy. Back in the early stages of the repo. They were advertising on the front page that they are achieving similar MAP to the original C++…

where did ).exe came from? I thought you need to use VBscript of some sort to download a file from command line.