Viewing profile — jensb1

Not more stupid IMO, but significnatly less token efficient or they have decreased tokens for subscription users, difficult to know.

Hi, always wanted to create a toy lisp compiler in LLVM for some reason, but never had the time to get it working. Took a new stab at it with Claude 3.7. Got a working version up i…

typo

Could someone explain how token generation speed relates to latency for the first token to be outputted? And if anyone have any metrics on latency on a 4090 for the 70B model, that…