Viewing profile — albystein

Hi Peter, Thanks for hosting this AMA. I’ve an immigration issue related to status transition. So I came to the U.S on an F-1 visa about 6 years ago. However, during the course of …

Just increased message limits to 100 per day

Hi HN About three weeks ago, I was playing around with the popular app generation tools, but at the time, none of the major platforms supported mobile app gen. So I thought it woul…

this seems like a plausible outcome, and if true could spell disaster for OpenAI models relative to the competition and open source models. Currently, reliability is one of the cor…

this hypothesis makes a lot of sense. if indeed gpt-4 is a sparse MoE—which i believe it is—then OpenAI must have tested and proved their initial idea of a large capacity MoE LLM m…

I think hallucination is akin to encountering a problem on a test to which you don’t fully remember the right concept to solve it. You might attempt the problem with whatever littl…

I think it depends on the sampling/decoding method. Also, perhaps you could elaborate more on what you mean by top_p

this is not what language models typically output as logits though. perhaps the term now is being misused and it’s causing a lot of confusion

Basically, logits are the raw outputs of the last linear layer of a neural network just before the softmax(for multi-class classification tasks) or the sigmoid(for binary classific…

This is exactly how I understand it. Although, I feel the thermodynamics analogy might be more intuitive to most people

I’m not sure if comparing it to the greedy algorithm is the correct way to think about it. Even after applying the temperature, if you use greedy decoding, you’ll still pick the ou…

Typically, in new markets and product categories, you should not consider early complimentary products as competitors, but rather as partners. During these early days, all particip…

I think this line of reasoning is misguided. What’s striking and more important to focus on are the abstract reasoning abilities of these systems. Language, as you mentioned, abstr…

This a very well put comment with a great analogy. A new emerging paradigm of action-driven LLMs is taking the approach of using the reasoning abilities of LLMs to drive agents tha…

The problem of hallucination in LLMs is a well-known and studied problem and solutions have been proposed to counter it. The most promising one is augmenting LLMs with a retrieval …

Alchemy API is a suite of developer tools that powers 70% of the top ethereum DApps and projects like CrytoKitties, Compound, MakeDAO, Aave, Dharma, etc. They just officially opene…