Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
31–40 of 137 posts
Re: Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
#32Isn't this similar to models that have "double check the answer"? First pass runs your input through, second pass runs it's output as input? Just, in double check it presumably runs the entire stack while you're trying to skip the translation steps and only double check the logic?
Re: Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
#33Re: Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
#34Re: Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
#35Re: Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
#36Extra thanks for making it written in a readable and approachable way! I don't have much of a background in this topic, but still managed to understand about 70-80% of it :) You're a good writer
Re: Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
#37[flagged]
Re: Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
#38I think you may have cracked latent space reasoning. I've had a hunch that something like this would work, but couldn't figure out how the training would back propagate. But you've shown that you just need to duplicate existing layers. Have you tried a simple inline loop over the duplicated layers? Would be interesting to see performance. Also, would be interesting to compare with a MOE model. See if these layers are…
Re: Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
#39[flagged]
Have a look at the boundaries in the heatmaps. They are of course open to interpretation, but it suggest to me that the models develop 'organs' for processing different types of data, and without duplicating the 'whole organ' you don't get the benefits. This is quite different to what you usually see, which is via layer ablation experiments. Thoughts?
Re: Show HN: How I topped the HuggingFace open LLM leaderboard on two gaming GPUs
#40Do you think karpathy's autoresearch would be useful here?