Viewing profile — saurabh20n

Looks like you’re one of the authors. It would be nice if you could post if the actual data matches your reconstruction—now that you have it in hand. Would help us not worry about …

Discussion of the 72B model happening here: https://news.ycombinator.com/item?id=38475501

Summary from https://arxiv.org/pdf/2309.16609.pdf --- (q: how does one format lists on HN?) * qwen-{1.8B,7B,14B}: * 3 trillion tokens; start with BPE tiktoken, cl100k base vocab, a…

actual title: “Prompting Frameworks for Large Language Models: A Survey” LLM frameworks might imply stack for building models (pertaining, fine tuning, inference etc)

Notes from quick read of paper at https://arxiv.org/abs/2302.10866 . Title of popsci is overreaching, this is a drop-in subquadratic replacement for attention. Could be promising, …

Congrats on the launch. I think you should share some technical details for a more substantial pitch. You are using the OSS BigCode effort and "The Stack" [1, 2] (as you say in ano…

Quick notes from first glance at paper https://research.facebook.com/publications/llama-open-and-ef... : * All variants were trained on 1T - 1.4T tokens; which is a good compared t…

The last author's tweet thread and replies have some interesting tidbits: https://twitter.com/Eric_Wallace_/status/1620449934863642624 * "We propose to extract memorized images by …

For the curious, here are direct links: * Initialization was done 42 days ago: https://etherscan.io/tx/0x53fd92771d2084a9bf39a6477015ef53b7... -- "Click to see More" and notice "In…

https://ericpony.github.io/z3py-tutorial/guide-examples.htm should be a quick start.

For this problem, an enumerative solver may be more optimal (and faster); where optimality is finding the word with the least number of guesses: There are ~158k 5-letter words. Sta…